Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
334 questions
Struggling with geting data into table via streaming job.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(313.6, 89%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECS%3C/text%3E%3C/svg%3E)
Charles Sutton
1
Reputation point
A total newbie question here.
I have successfully set up a job to stream data directly to PowerBI. That is working correctly. However, I also need to gather some analytics to display in somewhat realtime. I created a second stream job with an output to a table. My output is failing with
RequiredColumnMissing
The logs show that it's the rowkey or the partitionkey
However, I am not sure how to get that data from my job into the table. This is a very simple data set to collect run rate performance so I just need values over time.
Any assistance is appreciated.
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 70%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
MartinJaffer-MSFT 26,036 Reputation points2020-09-04T21:43:32.537+00:00 Hello @Charles Sutton and welcome to Q&A.
Before I can help you, I would like you to help me clarify a couple points.
As I understand, your stream to PowerBI is working fine. However you are having trouble with a second stream. You mention it is outputing to a table. Where, or what kind of table is this? Is it a table in PowerBI, or Azure Table Storage in your Storage Account, or SQL or something else?
Thank you for your patience
Martin -
Charles Sutton 1 Reputation point
2020-09-08T12:59:18.51+00:00 It is Azure Table Storage. It doesn't have to be though. I just need a space to dump some data so I can run analytics on the real time data.
-
Charles Sutton 1 Reputation point
2020-09-09T13:29:41.337+00:00 I have now been able to get the output to work without kicking an error. In the streaming job the partition key and row key must match an input field. So now my test query works correctly now. However, I do not have any errors but my Azure storage table is empty. I cannot figure out where the disconnect is.
-
MartinJaffer-MSFT 26,036 Reputation points
2020-09-09T23:32:53.54+00:00 Thank you for keeping us updated.
You said "However, I do not have any errors, but my Azure storage table is empty." Does this include the logs (more on those below) or just the test query?The activity and resource logs provide a view into your jobs. The activity log is available by default, but the resource log needs to be enabled.
Guide for troubleshooting output issues -
MartinJaffer-MSFT 26,036 Reputation points
2020-09-30T15:58:09.847+00:00 If you found your own solution, could you please share it here with the community?
Thank you.
Sign in to comment