Get-​Azure​Rm​HD​Insight​Job​Output

Gets the log output for a job from the storage account associated with a specified cluster.

Syntax

Get-AzureRmHDInsightJobOutput
   [-ClusterName] <String>
   [-JobId] <String>
   [[-DefaultContainer] <String>]
   [[-DefaultStorageAccountName] <String>]
   [[-DefaultStorageAccountKey] <String>]
   [-HttpCredential] <PSCredential>
   [-DisplayOutputType <JobDisplayOutputType>]
   [-ResourceGroupName <String>]
   [<CommonParameters>]

Description

The Get-AzureRmHDInsightJobOutput cmdlet gets the log output for a job from the Storage account associated with an Azure HDInsight cluster.

Examples

Example 1: Get the log output for a job

PS C:\># Cluster info
PS C:\> $clusterName = "your-hadoop-001"
PS C:\> $clusterCreds = Get-Credential

# Hive job details
PS C:\> $statusFolder = "<status folder>"
PS C:\> $query = "<query here>"

PS C:\> New-AzureRmHDInsightHiveJobDefinition -StatusFolder $statusFolder `
            -Query $query `
        | Start-AzureRmHDInsightJob `
            -ClusterName $clusterName `
            -ClusterCredential $clusterCreds `
        | Get-AzureRmHDInsightJobOutput `
            -ClusterName $clusterName `
            -ClusterCredential $clusterCreds

This command gets the log output from the cluster named your-hadoop-001.

Required Parameters

-ClusterName

Specifies the name of the cluster.

Type:String
Position:0
Default value:None
Accept pipeline input:False
Accept wildcard characters:False
-HttpCredential

Specifies the cluster login (HTTP) credentials for the cluster.

Type:PSCredential
Aliases:ClusterCredential
Position:5
Default value:None
Accept pipeline input:False
Accept wildcard characters:False
-JobId

Specifies the job ID of the job whose output will be fetched.

Type:String
Position:1
Default value:None
Accept pipeline input:False
Accept wildcard characters:False

Optional Parameters

-DefaultContainer

Specifies the default container name.

Type:String
Position:2
Default value:None
Accept pipeline input:False
Accept wildcard characters:False
-DefaultStorageAccountKey

Specifies the default Storage account key.

Type:String
Position:4
Default value:None
Accept pipeline input:False
Accept wildcard characters:False
-DefaultStorageAccountName

Specifies the default Storage account name.

Type:String
Position:3
Default value:None
Accept pipeline input:False
Accept wildcard characters:False
-DisplayOutputType

Specifies the job output type being requested. The acceptable values for this parameter are:

  • StandardOutput
  • StandardError
Type:JobDisplayOutputType
Parameter Sets:StandardOutput, StandardError
Position:Named
Default value:None
Accept pipeline input:False
Accept wildcard characters:False
-ResourceGroupName

Specifies the name of the resource group.

Type:String
Position:Named
Default value:None
Accept pipeline input:False
Accept wildcard characters:False