Azure HDInsight Cmdlets
The topics in this section document the Azure PowerShell HDInsight cmdlets that are used to manage the Hadoop clusters and the jobs run on them. The HDInsight cmdlets are in the Microsoft.WindowsAzure.Management.HDInsight.Cmdlet.PSCmdlets namespace. The cmdlets in the namespace are used to manage the Azure HDInsight Service and Azure blob storage accounts, to create and manage Hadoop clusters, and to submit Hive, Pig, MapReduce, and Sqoop jobs to these clusters.
For instructions on how to install and get started using the Window Azure cmdlets, see Azure PowerShell.
Cmdlets for the HDInsight Service
The documentation for the Azure PowerShell cmdlets is available at Azure Cmdlet Reference. Those cmdlets specifically used to manage HDInsight are available at Azure HDInsight Cmdlets.
The following table lists the cmdlets available to manage the HDInsight service. Each cmdlet in the table is linked to its respective documentation page.
| Cmdlet | Description |
|---|---|
Add-AzureHDInsightConfigValues |
Adds custom configuration values to a specified config object. The custom settings will be added to the xml configuration files of the relevant Hadoop services during cluster deployment. |
Add-AzureHDInsightMetastore |
Adds a SQL Database account to the Windows Azure HDInsight cluster configuration. |
Add-AzureHDInsightScriptAction |
Invokes a script action used to customize a cluster at deployment. |
Add-AzureHDInsightStorage |
Adds a Windows Azure Blob Storage account entry to a target HDInsight configuration. |
Get-AzureHDInsightCluster |
Retrieves and lists all of the Windows Azure HDInsight clusters associated with the current subscription or retrieves a specific named cluster. |
Get-AzureHDInsightJob |
Retrieves the Azure HDInsight jobs from a cluster and lists them in reverse chronological order. |
Get-AzureHDInsightJobOutput |
Retrieves the log output for a job from the storage account associated with a specified cluster. |
Get-AzureHDInsightProperties |
Retrieves properties specific to a Windows Azure HDInsight service. |
Grant-AzureHDInsightHttpServicesAccess |
Grants HTTP access to the cluster. |
Invoke-AzureHDInsightHiveJob |
Submits Hive queries to the HDInsight cluster, shows progress of the query execution, and retrieves query results in one operation. |
New-AzureHDInsightCluster |
Creates a new Windows Azure HDInsight cluster for the current subscription. |
New-AzureHDInsightClusterConfig |
Creates a non-persisted configuration that describes a Windows Azure HDInsight cluster configuration. |
New-AzureHDInsightHiveJobDefinition |
Defines a hive job for an Azure HDInsight service. |
New-AzureHDInsightMapReduceJobDefinition |
Defines a new Map Reduce job. |
New-AzureHDInsightPigJobDefinition |
Defines a new pig job for an Azure HDInsight service. |
New-AzureHDInsightSqoopJobDefinition |
Defines a new Sqoop job. |
New-AzureHDInsightStreamingMapReduceJobDefinition |
Defines a new streaming Map Reduce job. |
Remove-AzureHDInsightCluster |
Deletes the specified HDInsight cluster from your Windows Azure subscription. |
Revoke-AzureHDInsightHttpServicesAccess |
Disables HTTP access to the cluster. |
Set-AzureHDInsightDefaultStorage |
Sets default storage account setting in the HDInsight cluster configuration object. |
Start-AzureHDInsightJob |
Starts an Azure HDInsight job on a specified cluster. |
Stop-AzureHDInsightJob |
Stops running an Azure HDInsight job on a specified cluster. |
Use-AzureHDInsightCluster |
Selects Azure HDInsight cluster that will be used by the Invoke-Hive cmdlet for job submission. |
Wait-AzureHDInsightJob |
Awaits the completion or failure of the HDInsight job and shows its progress. |
Azure HDInsight .NET SDK
The documentation of the.NET SDK for the Azure HDInsight Service is available at HDInsight SDK Reference Documentation.