HDInsightHadoopAndYarnLogs
Logs from HDInsight Hadoop Clusters and YARN-related logs such as ResourceManager, NodeManager, and TimelineServer logs from all cluster types that use YARN.
Table attributes
Attribute | Value |
---|---|
Resource types | microsoft.hdinsight/clusters |
Categories | Azure Resources |
Solutions | LogManagement |
Basic log | No |
Ingestion-time transformation | Yes |
Sample Queries | - |
Columns
Column | Type | Description |
---|---|---|
_BilledSize | real | The record size in bytes |
ClusterName | string | Name of cluster. |
ClusterType | string | Type of the cluster. |
CorrelationId | string | The ID for correlated events. Can be used to identify correlated events between multiple tables. |
HostName | string | Name of host where log was emitted. |
_IsBillable | string | Specifies whether ingesting the data is billable. When _IsBillable is false ingestion isn't billed to your Azure account |
LogLevel | string | log level of message (INFO, WARN, ERROR, etc.). |
LogType | string | The name of the log file that a record came from (e.g. YarnTimeLineServer, YarnResourceManager, etc.). |
Message | string | message from Hadoop or YARN log. |
OperationName | string | The operation associated with log record. |
_ResourceId | string | A unique identifier for the resource that the record is associated with |
SourceSystem | string | The type of agent the event was collected by. For example, OpsManager for Windows agent, either direct connect or Operations Manager, Linux for all Linux agents, or Azure for Azure Diagnostics |
_SubscriptionId | string | A unique identifier for the subscription that the record is associated with |
TenantId | string | The Log Analytics workspace ID |
TimeGenerated | datetime | The timestamp (UTC) of when the log was generated. |
Type | string | The name of the table |
Feedback
https://aka.ms/ContentUserFeedback.
Coming soon: Throughout 2024 we will be phasing out GitHub Issues as the feedback mechanism for content and replacing it with a new feedback system. For more information see:Submit and view feedback for