Stream Analytics jobs not working reference input Blob storage

Dmitrii D 66 Reputation points
2021-11-15T09:48:20.337+00:00

I created an input from the Event Hub in the ASA - everything works.
But when I add the source type - Reference, and add this source in the request, I get the error: "Not all inputs have data. Please make sure the input sources have data and then try again."

What could be the reasons? Thanks.

I apply the following settings:

My request:
WITH Input AS (
SELECT
adls.type2,
event.type
FROM
HotStorageInputTest event
timestamp by EventProcessedUtcTime
JOIN
adls adls ON event.type = adls.type2
)
SELECT * FROM Input;

149319-2021-11-15-114458.png

149356-2021-11-15-114051.png149371-2021-11-15-114208.png

149317-2021-11-15-113550.png

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,444 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
{count} votes

Accepted answer
  1. Sander van de Velde 29,196 Reputation points MVP
    2021-11-18T11:19:29.817+00:00

    Hello @Dmitrii D ,

    Adding reference data to Azure Stream Analytics can be a little challenging,

    I used the information you provided and was able to have it running.

    I created an IoT Hub with a simulated device using https://azure-samples.github.io/raspberry-pi-web-simulator/ with one extra value in the message:

    150625-image.png

    The IoTHub messages are arriving in the cloud (on the default endpoint with ConsumerGroup ASA). I also added the same reference file in a blob storage container (with that extra subfolder):

    150576-image.png

    Ik hooked up the inputs:

    150588-image.png

    The query is simplified but still a join:

    150590-image.png

    The ASA job was started:

    Incoming and outgoing messages are on par:

    150643-image.png

    I send the messages to an eventhub for debug purposes. I can see the arrival of the messages at the same pace as sent by the device (every two seconds):

    150606-image.png

    (I added that messageId too to confirm all messages are coming in).

    Note: The eventhub preview screen is great but a little slow on updates.

    Please try to get the same result using this setup. Can you confirm this works for you also?

    Do you need more information? Check out the documentation. There are also excellent MS Learn modules about Stream Analytics.

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful