ADX Transactional Update Policy Guarantees
The update policy documentation for Azure Data Explorer makes the following statements about transactional update policies (these statements are inconsistent with each other): "guarantees consistency between data in the source and target…
Azure Data Explorer dashboard
Hi Friends, I am new to Azure Synapse Analytics. I have deployed my Synapse workspace and also Data Explorer. I have ingested a CSV file. When I click on "Dashboard" in Azure Data Explorer page, I get an error: ""Unexpected server…
Web content failed to get content error
We are importing ADX(kusto) dataset in Power BI using direct query mode. Since we scaled up the cpu count in ADX, the visuals got crashed in Power BI desktop/Service and got the below error. Web.Contents failed to get contents from…
How can I connect Azure Cognitive Search with Azure Data Explorer if Azure Data Explorer is not available as a data source?
How can I connect Azure Cognitive Search with Azure Data Explorer if Azure Data Explorer is not available as a data source?
Regex matches are running very slow
Hi, I have a query like below - This query is running very slow. is there anyway I can speedup this query. My table is big and I am ingesting 60 billion rows in one hour. Also I have around 40 regex in the where clause, for simplicity I mentioned only…
Connecting to Azure Data Explorer with JDBC
I am trying to connect to Azure Data Explorer with JDBC using MATLAB but I keep running into the error shown in the insert below. A little bit of googling revealed that this issue could potentially be resolved by "opening port 443 and the necessary…
how to cancel the multiple jobs created by the '.set-or-append async' command in Kusto
Hi Dear fellows, I have created plenty of failure ingestion jobs with individual operations by the '. set-or-append async' command in Kusto, and those jobs continue growing every day, thousands of times a day. I have no idea how to cancel Infinity jobs…
How to faster/optimize data deduplicate process in ADX Cluster with 'take_any' and 'leftanti' operators?
Hi We are encountering a complex issue with deduplicating our data in our ADX cluster We're ingesting our data into the cluster via Auto Ingest from/with our Azure Blob, the ingestion process works super fast and is capable of scaling rapidly -- the…
How can I set multiple variables inside a KQL iff statement?
I have an SQL statement like this: if @stopDate is null begin set @stopDate=dateadd(day,-1,convert(date,getdate())) set @startDate=dateadd(day,1,dateadd(month,-1,@stopDate)) end How can I convert this to KQL? I can set one variable…
What is the best way to ingest data into ADX for Production workloads
Option A : Synapse Pipelines using Azure Data Explorer activity using ingestion statement. as mentioned here https://learn.microsoft.com/en-us/azure/data-explorer/data-factory-command-activity Option B : Synapse Notebook using Python or C# SDKs …
How to achieve streaming ingestion for ASA input to ADX?
Hi, I've set up an ADX Dev cluster which has been configured for streaming. I created a Database and Table which both had their streamingingestion policies enabled. I used this MS Link to create an ADX output from an Azure Stream Analytics job I…
Need help on generating KQL query
Currently, I am facing difficulty in constructing KQL to display a chart on our dashboard for the following requirements: Requirements: We're fetching log messages from Application Insights, which is a text as like …
Ingestion mapping from parquet source to Kusto using ADF copy activity failing because of mapping kind?
Hi, I have a blob storage with parquet files that I want to ingest into Kusto using copy activity in ADF V2. I have created my source dataset as parquet source. I have created my sink dataset to point to my Kusto table. I have created an ingestion…
Are there any plans to create a docker container for Kustainer / Data Explorer emulator that is compatible with MacOS on arm64?
Hi everybody. As the title says, I would greatly appreciate to use the Kustainer image on my Mac with M1 processor. I can run the linux container but it fails with an exception: /kusto/Kusto.Personal / Kusto.Personal: Exception:…
best approach to get telemetry data for 'in real time' analysis in Power BI and create historical data at the same time
Hi, my plan is to collect telemetry data from a KQL DB stored in ADX, currently the service is retaining the data for only 30 days and my plan is to create a long retention for at least 2 years and at the same time have dashboards of the current…
How to query Kusto data with an appID and REST API using a cross-cluster join query
I am writing code for an Azure function app that query Kusto using the REST API. The function app uses an appID which has access to various clusters in the tenant. To use the API, you of course need a bearer token, which works. A simple query to the…
What is the capacity for storing data in a Azure Data Explorer Database?
How does storage work with Azure Data Explorer in terms of capacity? For example: In the following document it is described as separating computing and storage spaces. https://learn.microsoft.com/en-us/azure/data-explorer/how-it-works#data-storage The…
Azure Function connection string to Azure Data Explorer
Hi, I do have an Azure Function in C# with Kusto bindings to get data from Azure Data Explorer, in my local.settings.json I added the connection string like this: "ConnectionStrings"``: { "KustoConnectionString":…
How to convert decimal number into binary number in Azure data explorer?
I not able to find adx decimal number conversion function. i am trying to convert 20321 [decimal] to binary
Is there a way to deploy KQL - Time Series Query to get alerts for anomalies?
We have a KQL query that reads last 365 days of data from custom table (Log analytics workspace) and using Time-series functions it calculates anomalies in it. Now we are looking for deploying this query to get an alert email if there is anomaly. Is it…