Create Cluster

Operation Name

Create Cluster

Function Overview

Create a cluster of Azure HDInsight.

This operation uses Azure Active Directory for authentication. For more details on Azure Active Directory configuration, refer to the following pages.

“Azure Active Directory developer's guide” (http://go.microsoft.com/fwlink/?LinkId=290817)
“Authorization Code Grant Flow” (https://msdn.microsoft.com/en-us/library/azure/dn645542.aspx)

This operation uses Azure Resource Manager REST API. For more details on API specifications, refer to the following page.

“REST API reference of Azure Resource Manager“ (https://msdn.microsoft.com/library/azure/dn790568.aspx)

Properties

For details on use of variables, refer to "Variables".

Basic settings

Item name	Required/Optional	Use of variables	Description	Remarks
Name	Required	Not available	Enter the name to show on the script canvas.

Required settings

Item name

Required/Optional

Use of variables

Description

Remarks

Destination

Required

Not available

Select a global resource.

[Add]:
Add a new global resource.
[Edit list]:
Global resource settings can be edited in “Edit resource list” screen.

For more details on how to configure global resource, refer to the following.

“Global Resource Properties (OpenID Connect 1.0)”
You need to specify the following in additional parameters.

[Additional parameters/Key] [Additional parameters/Value]

resource https://management.core.windows.net/

Subscription ID

Required

Not available

Select a subscription ID.

Resource group name

Required

Not available

Select a resource group name.

Cluster name

Required

Available

Enter a cluster name.

Wait for create completion

Optional

Not available

Select whether to wait for completion of cluster creation or not.

[Checked]: (default)
Wait for completion of cluster creation.
[Not checked]:
Proceed to the subsequent operation without waiting after a create cluster request is sent.

Property actions

Item name	Description	Remarks
Update subscription IDs	Get subscription IDs from the specified [Destination] and set them in [Subscription ID].	Enabled when [Destination] is selected.
Update resource group names	Get resource group names from the specified [Subscription ID] and set them in [Resource group name]	Enabled when [Destination] and [Subscription ID] are selected.

Storage settings

Item name	Required/Optional	Use of variables	Description	Remarks
Destination BLOB storage	Required	Not available	Select a global resource of BLOB storage. [Add]: Add a new global resource. [Edit list]: Global resource settings can be edited in “Edit resource list” screen.	For more details on how to configure global resource, refer to the following. “Global Resource Properties (Azure BLOB Storage)” BLOB storage has to belong to the resource group specified in [Resource group name].
Container name	Required	Available	Select or enter a container name.

Property actions

Item name	Description	Remarks
Update container names	Get container names from the specified [Destination BLOB storage] and set them in [Container name].	Enabled when [Destination BLOB storage] is selected.

Cluster settings

Item name	Required/Optional	Use of variables	Description	Remarks
Number of worker nodes	Required	Available	Enter the number of worker nodes.
Fee level of worker node	Required	Not available	Select a fee level of worker node.
Fee level of head node	Required	Not available	Select a fee level of head node.
Cluster user name	Required	Available	Enter a cluster user name.
Cluster password	Required	Available	Enter the cluster password.	Check the password restrictions in Azure portal.
SSH user name	Required	Available	Enter a SSH user name.
SSH password	Required	Available	Enter the SSH password.	Check the password restrictions in Azure portal.

Comment

Item name	Required/Optional	Use of variables	Description	Remarks
Comment	Optional	Not available	You can write a short description of this adapter. The description will be reflected in the specifications.

Schema

Input schema

None.

Output schema

None.

Transaction

Transaction is not supported.

PSP Usage

PSP is not supported.

Available Component Variables

Component variable name	Description	Remarks
message_category	When an error occurs, category of the corresponding message code is stored.	Default value is null.
message_code	When an error occurs, code of the corresponding message code is stored.	Default value is null.
message_level	When an error occurs, severity of the corresponding message code is stored.	Default value is null.
error_type	When an error occurs, the error type is stored.	Default value is null. The error type would be in the following format. Example: “java.io.FileNotFoundException” The contents that will be stored may vary depending on DataSpider Servista versions.
error_message	When an error occurs, the error message is stored.	Default value is null. The contents that will be stored may vary depending on DataSpider Servista versions.
error_trace	When an error occurs, trace information of the error is stored.	Default value is null. The contents that will be stored may vary depending on DataSpider Servista versions and client applications.

Specification Limits

Clusters will be created with Linux OS.

Major Exceptions

Exception name	Cause	Solution
ResourceNotFoundException Resource definition is not found. Name: []	[Destination] or [Destination BLOB Storage] is not specified.	Specify [Destination] and [Destination BLOB Storage].
ResourceNotFoundException Resource definition is not found. Name: [<global resource name>]	The resource definition selected in [Destination] or [Destination BLOB Storage] is not found.	Check the global resource specified in [Destination] or [Destination BLOB Storage].
InvalidPropertyConfigurationException <property name> is not specified.	[<property name>] is not specified.	Specify [<property name>].
AzureManagementRestException status=<HTTP status>, code=SubscriptionNotFound, message=<error message>	The subscription is not found.	Check [Subscription ID].
AzureManagementRestException status=<HTTP status>, code=AuthorizationFailed, message=<error message>	The resource group may not exist, or the user of [Destination] cannot access that.	Check [Resource group name]. Check whether user permissions for the resource group of [Destination] exist.
AzureManagementRestException	Failed to create a cluster.	Check the contents of the error message. Check the error details in Azure portal.
AzureHdinsightException cluster=<cluster name>, status=<HTTP status>, detail=The cluster already exists	Could not create the cluster as on with the same name exists.	Check [Cluster name].
AzureHdinsightException cluster=<cluster name>, provisioningState=<cluster state>	The cluster state is invalid.	Check the error details in Azure portal.

Notes

HTTPS is used in communication between Azure HDInsight and this adapter.

This specifications is subject to change without any prior notification depending on the changes in Azure HDInsight specifications.

Refresh token has an expiration date in Azure Active Directory authentication. When the token cannot be renewed, you need to reissue a token in the specified [Destination] global resource.