Delete specific contents of file in blob container
I have log files in container, I want to search a list of strings in the log file and delete the specific record of the file matching with the string and save the file in same container with same name. Say the log file is abc.txt 10/20/2020 …
Azure Stream Analytics Job has water mark delay consistenly over 1 hour
Hi, We are consistently facing a watermark delay issue in one of our stream analytics job in productions, the SU% utilization seems below 10%. Due to this there is a latency of up to 4 hours in our NRT pipeline. The Stream analytic job reads from an…
Azure Logic App : Logs not showing in Log Analytics workspace and AzureDiagnostics log table
I have been following the following article : https://learn.microsoft.com/en-gb/azure/logic-apps/monitor-logic-apps-log-analytics But even after following all the steps in the article , I cant see any data in Logic Apps Management section of my…
Handling If else conditions in stream analytics query
Hi, I have one stream analytics query where i want to handle the condition like If today is a weekday then execute code1 else code2. As stream analytics is not supporting IF else or subquery in Case statement how to handle this? Can I get some guidance…
Stream Analytics Job Failed - Query Compilation error (Incorrect Syntax?)
Hello, I am having issues sending my MX Chip data from an IoT Hub > through Stream Analytics > into PowerBI It appears that when I create an Input from the IoT hub, it confirms: Testing Input, mxchip-bulk = Successful When I create…
Streaming ETL with eventhub
We have SAP and Hybris hosted onprem, which are the book of record for product and promo. The goal is to build a ETL solution to send to partner systems on products on promotion (effectively joining the feeds from both systems), the technical…
Struggling with geting data into table via streaming job.
A total newbie question here. I have successfully set up a job to stream data directly to PowerBI. That is working correctly. However, I also need to gather some analytics to display in somewhat realtime. I created a second stream job with an output…
Azure Powershell - Test Stream analytics job refererence input
Hi, I'm trying to test Stream analytics job inputs and outputs from Powershell (it is part of release pipeline). Everything is fine unless I come across an input of type "reference" (eg. SQL database). I'm using command…
Realtime time data from on premise databases
Hi Suppose I have 8 databases on premise and if i want to implement the lambda architecture then How can i ETL the data from these on-premise databases into cloud databases/storage in realtime. Can i use the Event hub for this? Is there any…
Failed to add Microsoft.StreamAnalyticsJob in Japanese environment
I tried to add new Stream Analytics job on Azure Portal but, it returned an error 404. My Language & Region: setting was Japanese. Once I changed it to English, the error was removed and could create the resource. Because the error has…
Not getting proper Output of Stream Analytics job in storage account table
Hi, I am trying to capture data using event hub and the output of the stream analytics job is directed to a table in storage account where a 'record' column gets created alongwith some autogenerated timestamp columns. This record column contains only…
azure stream analytics query too complex??? not giving proper output and now error... what to do next....
Hi, Query I use attached. I am using an event hub to ingest messages in json format from a push api. Json msg has some arrays in it. Now I am getting an error like "We cannot connect to Event Hub partition [0] because the maximum number of…
ASA aggregates
Hi, I have a list of sensor values coming in with some details every 10 seconds. I would like to know (on each entering event=10 seconds) what was the last maximum value of the last 60 values. I can make several blocks like below to output one of the…
Azure stream analytic input from IoT hub
I have a iot solution with iot hub and sql db . so I use stream analytics that integrated in sql db. The problem is: The Input came from iot hub's event endpoint and enriched with iot hub's message enrichment feature. In stream analytic I could get…
Azure Stream Analytics on Edge logging Metrics
Hello, I'm trying to track the output metrics from the azure stream analytics on edge module using the monitoring tools built into the Azure portal. The guides I've found online have this working for the stream analytics in the cloud. Is there any…
Return two outputs from Azure ML Service in Stream Analytics query
I have an Azure ML webservice that returns a string as an output. Within the string, there are two values that were returned from a model, such as a prediction and the probability associated with the prediction. Since I need both values as an output, I…
Azure Stream Analytics: ML Service function call in cloud job results in no output events
Hey, I've got a problem with an Azure Stream Analytics (ASA) job that should call an Azure ML Service function to score the provided input data. The query was developed und tested in Visual Studio (VS) 2019 with the "Azure Data Lake and…
Map Array in Stream Analytics
Is it possible to map an array contained in a message via the geospatial functions? { "id": "<msgid>", "location": {50.2, 30.3}, "geofences": [{"name": xxx, "polygon":…
Clarification on how to calculate watermark for Azure Streaming Analytics
I'm working on understanding watermarks in Azure Streaming Analytics. Per MS documentation, there are two ways that watermarks can be calculated. …
Stream Analytics job - input - error
I'm using IoT hub as input from my stream analytics job however getting following error - There was an error processing the request. Please try again in a few moments. it was working before however after some change in message routing of IoT hub…