question

MohsenAkhavan avatar image
0 Votes"
MohsenAkhavan asked MayankBargali-MSFT answered

Suggest solution for reading data from Azure Service Bus with Azure Data Factory

Hi,

I need a suggestion about the below scenario.
I receive data every second on Azure Service Bus. Now, I want Azure Data Factory to fetch this data and run the ML model on data.
As I checked there isn't a link between Azure Service Bus and Azure Data Factory.
What is the solution for this scenario?

azure-data-factoryazure-machine-learningazure-service-bus
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@MohsenAkhavan Thank you for the question. We will review and update at the earliest.

0 Votes 0 ·

1 Answer

MayankBargali-MSFT avatar image
0 Votes"
MayankBargali-MSFT answered

@MohsenAkhavan Sharing previous Q&A discussion on the same.

<SNIP>

Data Factory does not have a connector for Service bus. However there are several options available to you.

  • You can create a consumer for Data Factory to call upon.

  • You can raise a feature request in the feedback forum.

  • You could re-route your messages to be written to blob, and then leverage the Blob Event Trigger.

  • Use ADF Web Activity to retrieve a message.

By "create a consumer for Data Factory to call upon," I mean either create a Function App which batch-reads the messages, and returns them, utilizing ADF Azure Function, or , create some code to do the same with the ADF Batch Service Custom Activity. There are more variations as well.

Which one to use, depends upon your volume and cadence (frequency).

Please let me know if you desire more information.

</SNIP>

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.