Get-AzureRmHDInsightJobOutput

Gets the log output for a job from the storage account associated with a specified cluster.

Syntax

Get-AzureRmHDInsightJobOutput
   [-ClusterName] <String>
   [-JobId] <String>
   [[-DefaultContainer] <String>]
   [[-DefaultStorageAccountName] <String>]
   [[-DefaultStorageAccountKey] <String>]
   [-HttpCredential] <PSCredential>
   [-ResourceGroupName <String>]
   [-DisplayOutputType <JobDisplayOutputType>]
   [-DefaultProfile <IAzureContextContainer>]
   [<CommonParameters>]

Description

The Get-AzureRmHDInsightJobOutput cmdlet gets the log output for a job from the Storage account associated with an Azure HDInsight cluster.

Examples

Example 1: Get the log output for a job

PS C:\># Cluster info
PS C:\> $clusterName = "your-hadoop-001"
PS C:\> $clusterCreds = Get-Credential

# Hive job details
PS C:\> $statusFolder = "<status folder>"
PS C:\> $query = "<query here>"

PS C:\> New-AzureRmHDInsightHiveJobDefinition -StatusFolder $statusFolder `
            -Query $query `
        | Start-AzureRmHDInsightJob `
            -ClusterName $clusterName `
            -ClusterCredential $clusterCreds `
        | Get-AzureRmHDInsightJobOutput `
            -ClusterName $clusterName `
            -ClusterCredential $clusterCreds

This command gets the log output from the cluster named your-hadoop-001.

Required Parameters

-ClusterName

Specifies the name of the cluster.

Type:String
Position:0
Default value:None
Accept pipeline input:False
Accept wildcard characters:False
-HttpCredential

Specifies the cluster login (HTTP) credentials for the cluster.

Type:System.Management.Automation.PSCredential
Aliases:ClusterCredential
Position:5
Default value:None
Accept pipeline input:False
Accept wildcard characters:False
-JobId

Specifies the job ID of the job whose output will be fetched.

Type:String
Position:1
Default value:None
Accept pipeline input:False
Accept wildcard characters:False

Optional Parameters

-DefaultContainer

Specifies the default container name.

Type:String
Position:2
Default value:None
Accept pipeline input:False
Accept wildcard characters:False
-DefaultProfile

The credentials, account, tenant, and subscription used for communication with azure

Type:Microsoft.Azure.Commands.Common.Authentication.Abstractions.IAzureContextContainer
Aliases:AzureRmContext, AzureCredential
Position:Named
Default value:None
Accept pipeline input:False
Accept wildcard characters:False
-DefaultStorageAccountKey

Specifies the default Storage account key.

Type:String
Position:4
Default value:None
Accept pipeline input:False
Accept wildcard characters:False
-DefaultStorageAccountName

Specifies the default Storage account name.

Type:String
Position:3
Default value:None
Accept pipeline input:False
Accept wildcard characters:False
-DisplayOutputType

Specifies the job output type being requested. The acceptable values for this parameter are:

  • StandardOutput
  • StandardError
Type:Microsoft.Azure.Commands.HDInsight.Models.Job.JobDisplayOutputType
Parameter Sets:StandardOutput, StandardError
Position:Named
Default value:None
Accept pipeline input:False
Accept wildcard characters:False
-ResourceGroupName

Specifies the name of the resource group.

Type:String
Position:Named
Default value:None
Accept pipeline input:False
Accept wildcard characters:False

Outputs

System.String