Edit

Get-AzHDInsightJobOutput

  • Reference
Module:
Az.HDInsight

Gets the log output for a job from the storage account associated with a specified cluster.

Syntax

Get-AzHDInsightJobOutput
   [-ClusterName] <String>
   [-JobId] <String>
   [[-DefaultContainer] <String>]
   [[-DefaultStorageAccountName] <String>]
   [[-DefaultStorageAccountKey] <String>]
   [-HttpCredential] <PSCredential>
   [-ResourceGroupName <String>]
   [-DisplayOutputType <JobDisplayOutputType>]
   [-DefaultProfile <IAzureContextContainer>]
   [<CommonParameters>]

Description

The Get-AzHDInsightJobOutput cmdlet gets the log output for a job from the Storage account associated with an Azure HDInsight cluster.

Examples

Example 1: Get the log output for a job

# Cluster info
$clusterName = "your-hadoop-001"
$clusterCreds = Get-Credential

# Hive job details
$statusFolder = "<status folder>"
$query = "<query here>"

New-AzHDInsightHiveJobDefinition -StatusFolder $statusFolder `
            -Query $query `
        | Start-AzHDInsightJob `
            -ClusterName $clusterName `
            -ClusterCredential $clusterCreds `
        | Get-AzHDInsightJobOutput `
            -ClusterName $clusterName `
            -ClusterCredential $clusterCreds

This command gets the log output from the cluster named your-hadoop-001.

Parameters

-ClusterName

Specifies the name of the cluster.

Type:String
Position:0
Default value:None
Required:True
Accept pipeline input:False
Accept wildcard characters:False

-DefaultContainer

Specifies the default container name.

Type:String
Position:2
Default value:None
Required:False
Accept pipeline input:False
Accept wildcard characters:False

-DefaultProfile

The credentials, account, tenant, and subscription used for communication with azure

Type:IAzureContextContainer
Aliases:AzContext, AzureRmContext, AzureCredential
Position:Named
Default value:None
Required:False
Accept pipeline input:False
Accept wildcard characters:False

-DefaultStorageAccountKey

Specifies the default Storage account key.

Type:String
Position:4
Default value:None
Required:False
Accept pipeline input:False
Accept wildcard characters:False

-DefaultStorageAccountName

Specifies the default Storage account name.

Type:String
Position:3
Default value:None
Required:False
Accept pipeline input:False
Accept wildcard characters:False

-DisplayOutputType

Specifies the job output type being requested. The acceptable values for this parameter are:

  • StandardOutput
  • StandardError
Type:JobDisplayOutputType
Accepted values:StandardOutput, StandardError
Position:Named
Default value:None
Required:False
Accept pipeline input:False
Accept wildcard characters:False

-HttpCredential

Specifies the cluster login (HTTP) credentials for the cluster.

Type:PSCredential
Aliases:ClusterCredential
Position:5
Default value:None
Required:True
Accept pipeline input:False
Accept wildcard characters:False

-JobId

Specifies the job ID of the job whose output will be fetched.

Type:String
Position:1
Default value:None
Required:True
Accept pipeline input:False
Accept wildcard characters:False

-ResourceGroupName

Specifies the name of the resource group.

Type:String
Position:Named
Default value:None
Required:False
Accept pipeline input:False
Accept wildcard characters:False

Inputs

None

Outputs

String