What's new in Azure Data Explorer documentation

Welcome to what's new in Azure Data Explorer. This article details new and significantly updated content in the Azure Data Explorer documentation.

October 2021

This section lists the major changes to docs during October 2021.

General

Article title Description
Create an Event Grid data connection for Azure Data Explorer by using C# Updated article. Add Event Grid data connection from Azure portal.
Create an Event Grid data connection for Azure Data Explorer by using Python Updated article.
Manually create resources for Event Grid ingestion Updated article. Add Event Grid data connection from Azure portal.
Event Grid data connection Updated article. Add Event Grid data connection from Azure portal.
Ingest blobs into Azure Data Explorer by subscribing to Event Grid notifications Updated article. Add Event Grid data connection from Azure portal.
Add cluster principals for Azure Data Explorer by using C# Updated article. Add AllDatabasesMonitor role
Add cluster principals for Azure Data Explorer by using Python Updated article. Add AllDatabasesMonitor role
Add cluster principals for Azure Data Explorer by using an Azure Resource Manager template Updated article. Add AllDatabasesMonitor role
Add database principals for Azure Data Explorer by using Python Updated article. Add AllDatabasesMonitor role
Manage Azure Data Explorer database permissions Updated article. Add AllDatabasesMonitor role

Management

Article title Description
Role-based Authorization in Kusto Updated article. Materialized views rename source table.
Cache policy (hot and cold cache) Updated article. Caching with long storage.
Role-based Authorization in Kusto Updated article. Using the AllDatabasesMonitor role.

September 2021

This section lists the major changes to docs during September 2021.

General

Article title Description
Ingest data from event hub into Azure Data Explorer Updated article. Learn how to connect event hub with managed identity.

Query

Article title Description
Views New article. Learn how to use views, which are virtual tables based on the result-set of a query.
Entity types Updated article. Added information on how to use views.

August 2021

This section lists the major changes to docs during August 2021.

General

Article title Description
Use wizard for ingestion with LightIngest (preview) New article. Learn how to use a wizard for one-time ingestion of historical data with LightIngest.
Use one-click ingestion to create an event hub data connection for Azure Data Explorer Updated article. One click event hub experience.
Use LightIngest to ingest data into Azure Data Explorer Updated article. Generate LightIngest commands - one click experience.

Query

Article title Description
series_pow() New article. Calculates the element-wise power of two numeric series inputs.
Aggregation function types at a glance New article. Lists aggregation functions, which perform a calculation on a set of values and return a single value.
Scalar function types at a glance Updated article. Updated aggregation function and added series_pow.
materialized_view() function Updated article. Updated aggregation function.

Management

Article title Description
.alter query weak consistency policy New article.
Query weak consistency policy New article.
.show query weak consistency policy New article.

Functions library

Article title Description
pair_probabilities_fl()] New article. The function pair_probabilities_fl()calculates probabilities and metrics.
bartlett_test_fl() New article. The function bartlett_test_fl() performs the Bartlett Test.
levene_test_fl() New article. The function levene_test_fl() performs the Levene Test.
mann_whitney_u_test_fl() New article. The function mann_whitney_u_test_fl() performs the Mann-Whitney U Test.
wilcoxon_test_fl() New article. The function wilcoxon_test_fl() performs the Wilcoxon Test.
Functions library Updated article. Added pair_probabilities_fl(), normality_test_fl.

July 2021

General

Article title Description
Monitor batching ingestion with metrics New article. Learn how to use Azure Data Explorer metrics to monitor batching ingestion to Azure Data Explorer in Azure portal.
Create an external table using the Web UI wizard Updated article. New UI
Use one-click ingestion to create an event hub data connection for Azure Data Explorer Updated article. New UI.
Use one-click ingestion to ingest JSON data from a local file to an existing table in Azure Data Explorer Updated article. New UI
Ingest data from a container/ADLS into Azure Data Explorer Updated article. New UI
Create a table in Azure Data Explorer Updated article. New UI

Query

Article title Description
replace_string() New article. Replaces all string matches with another string.
take_any() (aggregation function) New article. Replaces any().
take_anyif() (aggregation function) New article. Replaces anyif().
replace_regex() Updated article. Replace() function changed to replace_regex().

Management

Article title Description
.alter extent tags retention policy New article.
.delete extent tags retention policy New article.
Extent tags retention policy New article. The extent tags retention policy controls the mechanism that automatically removes extent tags from tables, based on the age of the extents.
.show extent tags retention policy New article.
Stored query results Updated article. General Availability.

Functions library

Article title Description
two_sample_t_test_fl() New article. The function two_sample_t_test_fl() performs the Two-Sample T-Test.

June 2021

This section lists the major changes to docs during June 2021.

General

Article title Description
Monitor Azure Data Explorer ingestion, commands, queries, and tables using diagnostic logs, Monitor Azure Data Explorer performance, health, and usage with metrics Updated articles. Document batching types.

Query

Article title Description
rows_near() plugin New article. Finds rows near a specified condition.
has_any_ipv4() New article. Returns a value indicating whether one of specified IPv4 addresses appears in a text.
has_any_ipv4_prefix() New article. Returns a value indicating whether one of specified IPv4 address prefixes appears in a text.

Management

Article title Description
IngestionBatching policy Updated article. Document batching types

May 2021

This section lists the major changes to docs during May 2021.

General

Article title Description
Use follower databases Updated article. Add table level sharing.

April 2021

This section lists the major changes to docs during April 2021.

Query

Article title Description
has_ipv4() New article. Returns a value indicating whether a specified IPv4 address appears in a text.
has_ipv4_prefix() New article. Returns a value indicating whether a specified IPv4 address prefix appears in a text.
scan operator (preview) New article. Scans data, matches, and builds sequences based on the predicates.
Query results cache Updated article. Per shard query results cache added.
The string data type Updated article.
Null Values Updated article.

Management

Article title Description
Workload groups - Control commands Updated article. General Availability (GA).
Workload groups Updated article. General Availability (GA).
Materialized views Updated article. General Availability (GA).
Materialized views policies Updated article. General Availability (GA).

Functions library

Article title Description
time_weighted_avg_fl() New article. The function time_weighted_avg_fl() calculates the time weighted average of a metric in a given time window, over input time bins.

API

Article title Description
Request properties and ClientRequestProperties Updated article. Per shard query results cache added.

March 2021

This section lists the major changes to docs during March 2021.

General

Article title Description
Create an external table (preview) New article. An external table is a schema entity that references data stored outside the Azure Data Explorer database.

Management

Article title Description
Auto delete policy command, Auto delete policy New articles. An auto delete policy on a table sets an expiry date for the table.
Stored query results (Preview) Updated article. Added async mode.

Functions library

Article title Description
binomial_test_fl() New article. The function binomial_test_fl() performs the binomial test.
comb_fl() New article. The function comb_fl()calculates C(n, k), the number of combinations for selection of k items out of n, without order.
factorial_fl() New article. The function factorial_fl()calculates factorial of positive integers (n!).
perm_fl() New article. The function perm_fl()calculates P(n, k), the number of permutations for selection of k items out of n, with order.

February 2021

This section lists the major changes to docs during February 2021.

General

Article title Description
Optimize for high concurrency with Azure Data Explorer New article. In this article, you learn to optimize your Azure Data Explorer setup for high concurrency.
Quickstart: Query data in Azure Data Explorer Web UI Updated article. Explanation of table grid options.

Query

Article title Description
ipv4_is_in_range() New article. Checks if IPv4 string address is in IPv4-prefix notation range.
ipv4_netmask_suffix() New article. Returns the value of the IPv4 netmask suffix from IPv4 string address.
has_all operator New article. has_all operator filters based on the provided set of values (all values must be present).
row_rank() New article. Returns the current row's rank in a serialized row set.
Null Values Updated article. New behavior in Engine V3.
String operators Updated article. String term indexing for Engine V3.

Management

Article title Description
Materialized views data purge New article. Data purge commands can be used to purge records from materialized views.
.alter materialized-view lookback New article. Alters the lookback value of an existing materialized view.
.alter materialized-view autoUpdateSchema New article. Sets the autoUpdateSchema value of an existing materialized view to true or false.
.alter materialized-view docstring New article. Alters the DocString value of an existing materialized view.
.alter materialized-view folder New article. Alters the folder value of an existing materialized view.
.create-or-alter materialized-view New article. Creates a materialized view or alters an existing materialized view.
Materialized views policies New article. This article includes information about policies that can be set on a materialized view.
Request queuing policy (Preview) New article. A workload group's request queuing policy controls queueing of requests for delayed execution, once a certain threshold of concurrent requests is exceeded.

Functions library

Article title Description
series_dbl_exp_smoothing_fl() New article. Applies a double exponential smoothing filter on a series.

January 2021

This section lists the major changes to docs during January 2021.

General

Article title Description
Azure Policy Regulatory Compliance controls for Azure Data Explorer New article. This page lists the compliance domains and security controls for Azure Data Explorer.
Allow cross-tenant queries and commands New article. In this article, you will learn how to give cluster access to principals from another tenant.

Management

Article title Description
Clean extent containers commands New article. This article describes the .clean databases extentcontainers and .show database extentcontainers clean operations commands in Azure Data Explorer.
Request classification policy (Preview)
Request classification policy (Preview) - Control commands
New articles. The classification process assigns incoming requests to a workload group, based on the characteristics of the requests.
Request limits policy (Preview) New article. A workload group's request limits policy allows limiting the resources used by the request during its execution.
Request rate limit policy (Preview) New article. The workload group's request rate limit policy lets you limit the number of concurrent requests classified into the workload group.
Workload groups (Preview)
Workload groups (Preview) - Control commands
New articles. A workload group serves as a container for requests (queries, commands) that have similar classification criteria. A workload allows for aggregate monitoring of the requests, and defines policies for the requests.
Queries management Updated article. Syntax updated

December 2020

This section lists the major changes to docs during December 2020.

General

Article title Description
Ingestion error codes in Azure Data Explorer New article. This list contains error codes you may come across during ingestion.

Management

Article title Description
.create table based-on New article. Creates a new empty table based on existing table.
Stored query results (Preview) New article. Stored query results is a mechanism that temporarily stores the result of a query on the service.
Create and alter Azure Storage external tables Updated article. Document filesPreview and dryRun external table definition options
Export data to an external table Updated article. New external table syntax in export docs

Functions library

Article title Description
series_metric_fl() New article. The series_metric_fl() function selects and retrieves time series of metrics ingested to Azure Data Explorer using the Prometheus monitoring system.
series_rate_fl() New article. The function series_rate_fl() calculates the average rate of metric increase per second.
series_fit_lowess_fl() New article. The function series_fit_lowess_fl() applies a LOWESS regression on a series.

November 2020

This section lists the major changes to docs during November 2020.

General

Article title Description
Azure Policy built-in definitions for Azure Data Explorer New article. Index of Azure Policy built-in policy definitions for Azure Data Explorer.
Use one-click ingestion to create an event hub data connection for Azure Data Explorer New article. Connect an event hub to a table in Azure Data Explorer using the one-click ingestion experience.
Configure managed identities for your Azure Data Explorer cluster Updated article. Supports both user-assigned managed identities and system-assigned managed identities
Create a table in Azure Data Explorer Updated article. General availability (GA).
Quickstart: Query data in Azure Data Explorer Web UI Updated article. New capabilities.
What is one-click ingestion? Updated article. Added ingestion from JSON nested levels. General availability (GA).
Customize Azure Data Explorer dashboard visuals Updated article. New dashboard visuals and parameter changes.

Query

Article title Description
mysql_request plugin (Preview) New article. The mysql_request plugin sends a SQL query to a MySQL Server network endpoint and returns the first rowset in the results.
ipv4_lookup plugin New article. The ipv4_lookup plugin looks up an IPv4 value in a lookup table and returns rows with matched values.
ipv4_is_private() New article. Checks if IPv4 string address belongs to a set of private network IPs.
Splunk to Kusto Query Language map New article. This article is intended to assist users who are familiar with Splunk learn the Kusto Query Language to write log queries with Kusto.
gzip_compress_to_base64_string() New article. Performs gzip compression and encodes the result to base64.
gzip_decompress_from_base64_string() New article. Decodes the input string from base64 and performs gzip decompression.
array_reverse() New article. Reverses the order of the elements in a dynamic array.

Management

Article title Description
.disable plugin New article. Disables a plugin.
.enable plugin New article. Enables a plugin.
.show plugins New article. Lists all plugins of the cluster.
Cluster follower commands Updated article. Syntax changed, added .alter follower database prefetch-extents.

Functions library

Article title Description
series_downsample_fl() The function series_downsample_fl() downsamples a time series by an integer factor.
series_exp_smoothing_fl() Applies a basic exponential smoothing filter on a series.