What's new in Azure Data Explorer documentation
Welcome to what's new in Azure Data Explorer. This article details new and significantly updated content in the Azure Data Explorer documentation.
October 2021
This section lists the major changes to docs during October 2021.
General
Management
| Article title | Description |
|---|---|
| Role-based Authorization in Kusto | Updated article. Materialized views rename source table. |
| Cache policy (hot and cold cache) | Updated article. Caching with long storage. |
| Role-based Authorization in Kusto | Updated article. Using the AllDatabasesMonitor role. |
September 2021
This section lists the major changes to docs during September 2021.
General
| Article title | Description |
|---|---|
| Ingest data from event hub into Azure Data Explorer | Updated article. Learn how to connect event hub with managed identity. |
Query
| Article title | Description |
|---|---|
| Views | New article. Learn how to use views, which are virtual tables based on the result-set of a query. |
| Entity types | Updated article. Added information on how to use views. |
August 2021
This section lists the major changes to docs during August 2021.
General
| Article title | Description |
|---|---|
| Use wizard for ingestion with LightIngest (preview) | New article. Learn how to use a wizard for one-time ingestion of historical data with LightIngest. |
| Use one-click ingestion to create an event hub data connection for Azure Data Explorer | Updated article. One click event hub experience. |
| Use LightIngest to ingest data into Azure Data Explorer | Updated article. Generate LightIngest commands - one click experience. |
Query
| Article title | Description |
|---|---|
| series_pow() | New article. Calculates the element-wise power of two numeric series inputs. |
| Aggregation function types at a glance | New article. Lists aggregation functions, which perform a calculation on a set of values and return a single value. |
| Scalar function types at a glance | Updated article. Updated aggregation function and added series_pow. |
| materialized_view() function | Updated article. Updated aggregation function. |
Management
| Article title | Description |
|---|---|
| .alter query weak consistency policy | New article. |
| Query weak consistency policy | New article. |
| .show query weak consistency policy | New article. |
Functions library
| Article title | Description |
|---|---|
| pair_probabilities_fl()] | New article. The function pair_probabilities_fl()calculates probabilities and metrics. |
| bartlett_test_fl() | New article. The function bartlett_test_fl() performs the Bartlett Test. |
| levene_test_fl() | New article. The function levene_test_fl() performs the Levene Test. |
| mann_whitney_u_test_fl() | New article. The function mann_whitney_u_test_fl() performs the Mann-Whitney U Test. |
| wilcoxon_test_fl() | New article. The function wilcoxon_test_fl() performs the Wilcoxon Test. |
| Functions library | Updated article. Added pair_probabilities_fl(), normality_test_fl. |
July 2021
General
| Article title | Description |
|---|---|
| Monitor batching ingestion with metrics | New article. Learn how to use Azure Data Explorer metrics to monitor batching ingestion to Azure Data Explorer in Azure portal. |
| Create an external table using the Web UI wizard | Updated article. New UI |
| Use one-click ingestion to create an event hub data connection for Azure Data Explorer | Updated article. New UI. |
| Use one-click ingestion to ingest JSON data from a local file to an existing table in Azure Data Explorer | Updated article. New UI |
| Ingest data from a container/ADLS into Azure Data Explorer | Updated article. New UI |
| Create a table in Azure Data Explorer | Updated article. New UI |
Query
| Article title | Description |
|---|---|
| replace_string() | New article. Replaces all string matches with another string. |
| take_any() (aggregation function) | New article. Replaces any(). |
| take_anyif() (aggregation function) | New article. Replaces anyif(). |
| replace_regex() | Updated article. Replace() function changed to replace_regex(). |
Management
| Article title | Description |
|---|---|
| .alter extent tags retention policy | New article. |
| .delete extent tags retention policy | New article. |
| Extent tags retention policy | New article. The extent tags retention policy controls the mechanism that automatically removes extent tags from tables, based on the age of the extents. |
| .show extent tags retention policy | New article. |
| Stored query results | Updated article. General Availability. |
Functions library
| Article title | Description |
|---|---|
| two_sample_t_test_fl() | New article. The function two_sample_t_test_fl() performs the Two-Sample T-Test. |
June 2021
This section lists the major changes to docs during June 2021.
General
| Article title | Description |
|---|---|
| Monitor Azure Data Explorer ingestion, commands, queries, and tables using diagnostic logs, Monitor Azure Data Explorer performance, health, and usage with metrics | Updated articles. Document batching types. |
Query
| Article title | Description |
|---|---|
| rows_near() plugin | New article. Finds rows near a specified condition. |
| has_any_ipv4() | New article. Returns a value indicating whether one of specified IPv4 addresses appears in a text. |
| has_any_ipv4_prefix() | New article. Returns a value indicating whether one of specified IPv4 address prefixes appears in a text. |
Management
| Article title | Description |
|---|---|
| IngestionBatching policy | Updated article. Document batching types |
May 2021
This section lists the major changes to docs during May 2021.
General
| Article title | Description |
|---|---|
| Use follower databases | Updated article. Add table level sharing. |
April 2021
This section lists the major changes to docs during April 2021.
Query
| Article title | Description |
|---|---|
| has_ipv4() | New article. Returns a value indicating whether a specified IPv4 address appears in a text. |
| has_ipv4_prefix() | New article. Returns a value indicating whether a specified IPv4 address prefix appears in a text. |
| scan operator (preview) | New article. Scans data, matches, and builds sequences based on the predicates. |
| Query results cache | Updated article. Per shard query results cache added. |
| The string data type | Updated article. |
| Null Values | Updated article. |
Management
| Article title | Description |
|---|---|
| Workload groups - Control commands | Updated article. General Availability (GA). |
| Workload groups | Updated article. General Availability (GA). |
| Materialized views | Updated article. General Availability (GA). |
| Materialized views policies | Updated article. General Availability (GA). |
Functions library
| Article title | Description |
|---|---|
| time_weighted_avg_fl() | New article. The function time_weighted_avg_fl() calculates the time weighted average of a metric in a given time window, over input time bins. |
API
| Article title | Description |
|---|---|
| Request properties and ClientRequestProperties | Updated article. Per shard query results cache added. |
March 2021
This section lists the major changes to docs during March 2021.
General
| Article title | Description |
|---|---|
| Create an external table (preview) | New article. An external table is a schema entity that references data stored outside the Azure Data Explorer database. |
Management
| Article title | Description |
|---|---|
| Auto delete policy command, Auto delete policy | New articles. An auto delete policy on a table sets an expiry date for the table. |
| Stored query results (Preview) | Updated article. Added async mode. |
Functions library
| Article title | Description |
|---|---|
| binomial_test_fl() | New article. The function binomial_test_fl() performs the binomial test. |
| comb_fl() | New article. The function comb_fl()calculates C(n, k), the number of combinations for selection of k items out of n, without order. |
| factorial_fl() | New article. The function factorial_fl()calculates factorial of positive integers (n!). |
| perm_fl() | New article. The function perm_fl()calculates P(n, k), the number of permutations for selection of k items out of n, with order. |
February 2021
This section lists the major changes to docs during February 2021.
General
| Article title | Description |
|---|---|
| Optimize for high concurrency with Azure Data Explorer | New article. In this article, you learn to optimize your Azure Data Explorer setup for high concurrency. |
| Quickstart: Query data in Azure Data Explorer Web UI | Updated article. Explanation of table grid options. |
Query
| Article title | Description |
|---|---|
| ipv4_is_in_range() | New article. Checks if IPv4 string address is in IPv4-prefix notation range. |
| ipv4_netmask_suffix() | New article. Returns the value of the IPv4 netmask suffix from IPv4 string address. |
| has_all operator | New article. has_all operator filters based on the provided set of values (all values must be present). |
| row_rank() | New article. Returns the current row's rank in a serialized row set. |
| Null Values | Updated article. New behavior in Engine V3. |
| String operators | Updated article. String term indexing for Engine V3. |
Management
| Article title | Description |
|---|---|
| Materialized views data purge | New article. Data purge commands can be used to purge records from materialized views. |
| .alter materialized-view lookback | New article. Alters the lookback value of an existing materialized view. |
| .alter materialized-view autoUpdateSchema | New article. Sets the autoUpdateSchema value of an existing materialized view to true or false. |
| .alter materialized-view docstring | New article. Alters the DocString value of an existing materialized view. |
| .alter materialized-view folder | New article. Alters the folder value of an existing materialized view. |
| .create-or-alter materialized-view | New article. Creates a materialized view or alters an existing materialized view. |
| Materialized views policies | New article. This article includes information about policies that can be set on a materialized view. |
| Request queuing policy (Preview) | New article. A workload group's request queuing policy controls queueing of requests for delayed execution, once a certain threshold of concurrent requests is exceeded. |
Functions library
| Article title | Description |
|---|---|
| series_dbl_exp_smoothing_fl() | New article. Applies a double exponential smoothing filter on a series. |
January 2021
This section lists the major changes to docs during January 2021.
General
| Article title | Description |
|---|---|
| Azure Policy Regulatory Compliance controls for Azure Data Explorer | New article. This page lists the compliance domains and security controls for Azure Data Explorer. |
| Allow cross-tenant queries and commands | New article. In this article, you will learn how to give cluster access to principals from another tenant. |
Management
| Article title | Description |
|---|---|
| Clean extent containers commands | New article. This article describes the .clean databases extentcontainers and .show database extentcontainers clean operations commands in Azure Data Explorer. |
| Request classification policy (Preview) Request classification policy (Preview) - Control commands |
New articles. The classification process assigns incoming requests to a workload group, based on the characteristics of the requests. |
| Request limits policy (Preview) | New article. A workload group's request limits policy allows limiting the resources used by the request during its execution. |
| Request rate limit policy (Preview) | New article. The workload group's request rate limit policy lets you limit the number of concurrent requests classified into the workload group. |
| Workload groups (Preview) Workload groups (Preview) - Control commands |
New articles. A workload group serves as a container for requests (queries, commands) that have similar classification criteria. A workload allows for aggregate monitoring of the requests, and defines policies for the requests. |
| Queries management | Updated article. Syntax updated |
December 2020
This section lists the major changes to docs during December 2020.
General
| Article title | Description |
|---|---|
| Ingestion error codes in Azure Data Explorer | New article. This list contains error codes you may come across during ingestion. |
Management
| Article title | Description |
|---|---|
| .create table based-on | New article. Creates a new empty table based on existing table. |
| Stored query results (Preview) | New article. Stored query results is a mechanism that temporarily stores the result of a query on the service. |
| Create and alter Azure Storage external tables | Updated article. Document filesPreview and dryRun external table definition options |
| Export data to an external table | Updated article. New external table syntax in export docs |
Functions library
| Article title | Description |
|---|---|
| series_metric_fl() | New article. The series_metric_fl() function selects and retrieves time series of metrics ingested to Azure Data Explorer using the Prometheus monitoring system. |
| series_rate_fl() | New article. The function series_rate_fl() calculates the average rate of metric increase per second. |
| series_fit_lowess_fl() | New article. The function series_fit_lowess_fl() applies a LOWESS regression on a series. |
November 2020
This section lists the major changes to docs during November 2020.
General
| Article title | Description |
|---|---|
| Azure Policy built-in definitions for Azure Data Explorer | New article. Index of Azure Policy built-in policy definitions for Azure Data Explorer. |
| Use one-click ingestion to create an event hub data connection for Azure Data Explorer | New article. Connect an event hub to a table in Azure Data Explorer using the one-click ingestion experience. |
| Configure managed identities for your Azure Data Explorer cluster | Updated article. Supports both user-assigned managed identities and system-assigned managed identities |
| Create a table in Azure Data Explorer | Updated article. General availability (GA). |
| Quickstart: Query data in Azure Data Explorer Web UI | Updated article. New capabilities. |
| What is one-click ingestion? | Updated article. Added ingestion from JSON nested levels. General availability (GA). |
| Customize Azure Data Explorer dashboard visuals | Updated article. New dashboard visuals and parameter changes. |
Query
| Article title | Description |
|---|---|
| mysql_request plugin (Preview) | New article. The mysql_request plugin sends a SQL query to a MySQL Server network endpoint and returns the first rowset in the results. |
| ipv4_lookup plugin | New article. The ipv4_lookup plugin looks up an IPv4 value in a lookup table and returns rows with matched values. |
| ipv4_is_private() | New article. Checks if IPv4 string address belongs to a set of private network IPs. |
| Splunk to Kusto Query Language map | New article. This article is intended to assist users who are familiar with Splunk learn the Kusto Query Language to write log queries with Kusto. |
| gzip_compress_to_base64_string() | New article. Performs gzip compression and encodes the result to base64. |
| gzip_decompress_from_base64_string() | New article. Decodes the input string from base64 and performs gzip decompression. |
| array_reverse() | New article. Reverses the order of the elements in a dynamic array. |
Management
| Article title | Description |
|---|---|
| .disable plugin | New article. Disables a plugin. |
| .enable plugin | New article. Enables a plugin. |
| .show plugins | New article. Lists all plugins of the cluster. |
| Cluster follower commands | Updated article. Syntax changed, added .alter follower database prefetch-extents. |
Functions library
| Article title | Description |
|---|---|
| series_downsample_fl() | The function series_downsample_fl() downsamples a time series by an integer factor. |
| series_exp_smoothing_fl() | Applies a basic exponential smoothing filter on a series. |