-
Notifications
You must be signed in to change notification settings - Fork 41
EMR Add Hive Step
Nate Weisz edited this page Oct 6, 2015
·
3 revisions
Adds a Hive step to an EMR cluster.
org.finra.dm.service.activiti.task.AddEmrHiveStep
Name | Required | Accepted Values | Default Value | Case Sensitive | Description |
---|---|---|---|---|---|
namespace | Y | N | The name of a valid namespace known by the system. | ||
emrClusterDefinitionName | Y | N | The name of EMR definition. Available definitions are defined EMR Cluster Defintion. | ||
emrClusterName | Y | N | The name of EMR cluster. | ||
stepName | Y | The name os Step. | |||
scriptLocation | Y | The location of hive script. | |||
scriptArguments | N | The arguments delimited by the pipe character ( | ). Delimiter can be escaped by a backslash ( \ ). | |||
continueOnError | N | true, false | false | N | Action on step failure, "true": continue, "false": cancel. |
Name | Description |
---|---|
{taskId}_emrStepId | The step ID. |
<serviceTask id="addHiveStepServiceTask" name="Add Hive Step" activiti:class="org.finra.dm.service.activiti.task.AddEmrHiveStep">
<extensionElements>
<activiti:field name="namespace" stringValue="testNamespace"/>
<activiti:field name="emrClusterDefinitionName" expression="${emrClusterDefinitionName}"/>
<activiti:field name="emrClusterName" expression="${clusterName}"/>
<activiti:field name="stepName" expression="${stepName}"/>
<activiti:field name="scriptLocation" expression="${scriptLocation}"/>
<activiti:field name="scriptArguments" expression="${scriptArguments}"/>
<activiti:field name="continueOnError" expression="${continueOnError}"/>
</extensionElements>
</serviceTask>
- Data Registration and Availability
- DDL Generation
- Cluster Management
- Workflow Control/Debugging