331 questions with Azure Stream Analytics tags

Sort by: Updated
0 answers

Delete specific contents of file in blob container

I have log files in container, I want to search a list of strings in the log file and delete the specific record of the file matching with the string and save the file in same container with same name. Say the log file is abc.txt 10/20/2020 …

Azure Storage Explorer
Azure Storage Explorer
An Azure tool that is used to manage cloud storage resources on Windows, macOS, and Linux.
232 questions
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,449 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
331 questions
asked 2020-10-23T19:00:04.617+00:00
Amey Pimpley 1 Reputation point
commented 2020-10-23T20:59:45.92+00:00
Amey Pimpley 1 Reputation point
1 answer

Azure Stream Analytics Job has water mark delay consistenly over 1 hour

Hi, We are consistently facing a watermark delay issue in one of our stream analytics job in productions, the SU% utilization seems below 10%. Due to this there is a latency of up to 4 hours in our NRT pipeline. The Stream analytic job reads from an…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
331 questions
asked 2020-10-14T19:50:11.527+00:00
Anand Pangare (Tata Consultancy Services) 1 Reputation point Microsoft Vendor
commented 2020-10-21T18:08:13.85+00:00
Anand Pangare (Tata Consultancy Services) 1 Reputation point Microsoft Vendor
3 answers

Azure Logic App : Logs not showing in Log Analytics workspace and AzureDiagnostics log table

I have been following the following article : https://learn.microsoft.com/en-gb/azure/logic-apps/monitor-logic-apps-log-analytics But even after following all the steps in the article , I cant see any data in Logic Apps Management section of my…

Azure Logic Apps
Azure Logic Apps
An Azure service that automates the access and use of data across clouds without writing code.
2,873 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
331 questions
asked 2020-08-26T17:02:29.473+00:00
Mulchandani, Jaideep 1 Reputation point
commented 2020-10-20T07:20:56.967+00:00
MayankBargali-MSFT 68,746 Reputation points
2 answers

Handling If else conditions in stream analytics query

Hi, I have one stream analytics query where i want to handle the condition like If today is a weekday then execute code1 else code2. As stream analytics is not supporting IF else or subquery in Case statement how to handle this? Can I get some guidance…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
331 questions
asked 2020-09-30T15:40:40.947+00:00
Rock 41 Reputation points
answered 2020-10-13T13:54:09.893+00:00
Rock 41 Reputation points
1 answer

Stream Analytics Job Failed - Query Compilation error (Incorrect Syntax?)

Hello, I am having issues sending my MX Chip data from an IoT Hub > through Stream Analytics > into PowerBI It appears that when I create an Input from the IoT hub, it confirms: Testing Input, mxchip-bulk = Successful When I create…

Azure IoT
Azure IoT
A category of Azure services for internet of things devices.
383 questions
Azure IoT Hub
Azure IoT Hub
An Azure service that enables bidirectional communication between internet of things (IoT) devices and applications.
1,128 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
331 questions
asked 2020-10-02T14:09:28.96+00:00
MS 21 Reputation points
commented 2020-10-02T14:25:13.573+00:00
António Sérgio Azevedo 7,666 Reputation points Microsoft Employee
1 answer

Streaming ETL with eventhub

We have SAP and Hybris hosted onprem, which are the book of record for product and promo. The goal is to build a ETL solution to send to partner systems on products on promotion (effectively joining the feeds from both systems), the technical…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
562 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
331 questions
asked 2020-09-17T02:38:36.127+00:00
Tommy Wang 1 Reputation point
commented 2020-10-01T02:28:00.367+00:00
Tommy Wang 1 Reputation point
0 answers

Struggling with geting data into table via streaming job.

A total newbie question here. I have successfully set up a job to stream data directly to PowerBI. That is working correctly. However, I also need to gather some analytics to display in somewhat realtime. I created a second stream job with an output…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
331 questions
asked 2020-09-04T13:30:23.867+00:00
Charles Sutton 1 Reputation point
commented 2020-09-30T15:58:09.847+00:00
MartinJaffer-MSFT 26,036 Reputation points
2 answers One of the answers was accepted by the question author.

Azure Powershell - Test Stream analytics job refererence input

Hi, I'm trying to test Stream analytics job inputs and outputs from Powershell (it is part of release pipeline). Everything is fine unless I come across an input of type "reference" (eg. SQL database). I'm using command…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
331 questions
asked 2020-09-23T10:03:53.897+00:00
DeeplyGrow 21 Reputation points
commented 2020-09-29T00:25:22.967+00:00
KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee
0 answers

Realtime time data from on premise databases

Hi Suppose I have 8 databases on premise and if i want to implement the lambda architecture then How can i ETL the data from these on-premise databases into cloud databases/storage in realtime. Can i use the Event hub for this? Is there any…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
562 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
331 questions
asked 2020-09-22T11:49:17.047+00:00
Kuldeep Chitrakar 1 Reputation point
commented 2020-09-25T19:14:42.01+00:00
MartinJaffer-MSFT 26,036 Reputation points
1 answer One of the answers was accepted by the question author.

Failed to add Microsoft.StreamAnalyticsJob in Japanese environment

I tried to add new Stream Analytics job on Azure Portal but, it returned an error 404. My Language & Region: setting was Japanese. Once I changed it to English, the error was removed and could create the resource. Because the error has…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
331 questions
asked 2020-09-16T21:20:47.503+00:00
Yusuke Tochigi 56 Reputation points
accepted 2020-09-18T07:04:22.953+00:00
Yusuke Tochigi 56 Reputation points
1 answer

Not getting proper Output of Stream Analytics job in storage account table

Hi, I am trying to capture data using event hub and the output of the stream analytics job is directed to a table in storage account where a 'record' column gets created alongwith some autogenerated timestamp columns. This record column contains only…

Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
2,722 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
331 questions
asked 2020-08-12T15:57:33.677+00:00
Francis.S 1 Reputation point
commented 2020-09-08T06:33:30.79+00:00
Sumarigo-MSFT 43,806 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

azure stream analytics query too complex??? not giving proper output and now error... what to do next....

Hi, Query I use attached. I am using an event hub to ingest messages in json format from a push api. Json msg has some arrays in it. Now I am getting an error like "We cannot connect to Event Hub partition [0] because the maximum number of…

Azure Table Storage
Azure Table Storage
An Azure service that stores structured NoSQL data in the cloud.
158 questions
Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
562 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
331 questions
asked 2020-08-23T16:45:24.557+00:00
Rocksde 106 Reputation points
accepted 2020-08-24T19:58:21.193+00:00
Rocksde 106 Reputation points
2 answers

ASA aggregates

Hi, I have a list of sensor values coming in with some details every 10 seconds. I would like to know (on each entering event=10 seconds) what was the last maximum value of the last 60 values. I can make several blocks like below to output one of the…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
331 questions
asked 2020-07-06T15:57:27.253+00:00
Garrein Bart 1 Reputation point
answered 2020-08-24T08:35:38.303+00:00
Garrein Bart 1 Reputation point
1 answer One of the answers was accepted by the question author.

Azure stream analytic input from IoT hub

I have a iot solution with iot hub and sql db . so I use stream analytics that integrated in sql db. The problem is: The Input came from iot hub's event endpoint and enriched with iot hub's message enrichment feature. In stream analytic I could get…

Azure IoT Hub
Azure IoT Hub
An Azure service that enables bidirectional communication between internet of things (IoT) devices and applications.
1,128 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
331 questions
asked 2020-08-15T05:06:18.277+00:00
Navid Ahrary 21 Reputation points
accepted 2020-08-15T06:41:14.347+00:00
Navid Ahrary 21 Reputation points
1 answer

Azure Stream Analytics on Edge logging Metrics

Hello, I'm trying to track the output metrics from the azure stream analytics on edge module using the monitoring tools built into the Azure portal. The guides I've found online have this working for the stream analytics in the cloud. Is there any…

Azure IoT Edge
Azure IoT Edge
An Azure service that is used to deploy cloud workloads to run on internet of things (IoT) edge devices via standard containers.
543 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
331 questions
asked 2020-07-20T12:58:01.04+00:00
Ryan Maggott 1 Reputation point
commented 2020-08-06T17:29:30.903+00:00
QuantumCache 20,031 Reputation points
1 answer One of the answers was accepted by the question author.

Return two outputs from Azure ML Service in Stream Analytics query

I have an Azure ML webservice that returns a string as an output. Within the string, there are two values that were returned from a model, such as a prediction and the probability associated with the prediction. Since I need both values as an output, I…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
331 questions
asked 2020-07-27T11:22:27.317+00:00
Justin Hare 21 Reputation points
accepted 2020-07-28T19:43:59.437+00:00
Justin Hare 21 Reputation points
4 answers

Azure Stream Analytics: ML Service function call in cloud job results in no output events

Hey, I've got a problem with an Azure Stream Analytics (ASA) job that should call an Azure ML Service function to score the provided input data. The query was developed und tested in Visual Studio (VS) 2019 with the "Azure Data Lake and…

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,579 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
331 questions
asked 2020-07-16T16:57:01.43+00:00
Philipp Lehmann 6 Reputation points
answered 2020-07-18T10:09:45.22+00:00
Philipp Lehmann 6 Reputation points
1 answer

Map Array in Stream Analytics

Is it possible to map an array contained in a message via the geospatial functions? { "id": "<msgid>", "location": {50.2, 30.3}, "geofences": [{"name": xxx, "polygon":…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
331 questions
asked 2020-07-02T10:28:28.27+00:00
Ingo Busse 1 Reputation point
commented 2020-07-15T18:00:26.773+00:00
HimanshuSinha-msft 19,381 Reputation points Microsoft Employee
1 answer

Clarification on how to calculate watermark for Azure Streaming Analytics

I'm working on understanding watermarks in Azure Streaming Analytics. Per MS documentation, there are two ways that watermarks can be calculated. …

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
331 questions
asked 2020-07-02T14:47:38.423+00:00
Russell Lindell 1 Reputation point
commented 2020-07-13T17:57:39.23+00:00
HimanshuSinha-msft 19,381 Reputation points Microsoft Employee
0 answers

Stream Analytics job - input - error

I'm using IoT hub as input from my stream analytics job however getting following error - There was an error processing the request. Please try again in a few moments. it was working before however after some change in message routing of IoT hub…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
331 questions
asked 2020-07-03T08:13:08.523+00:00
vijay chouhan 6 Reputation points
commented 2020-07-10T16:41:02.647+00:00
HimanshuSinha-msft 19,381 Reputation points Microsoft Employee