question

YennamShowryPremsagar-9843 avatar image
0 Votes"
YennamShowryPremsagar-9843 asked PramodValavala-MSFT commented

Spark Structured Streaming Azure Service Bus



Could someone clarify me ,whether Azure Service Bus queues cab be accessed using this API or not? Please Suggest the relevant doc

azure-service-bus
· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Note , I would like to connect to Azure Servicee Bus Queues not EEventhub with a topic

0 Votes 0 ·
PramodValavala-MSFT avatar image PramodValavala-MSFT YennamShowryPremsagar-9843 ·

Just to make sure I understand correctly, you are trying to read from Event Hubs using the Spark Streaming API and write to a Service Bus Topic?

0 Votes 0 ·

No . I just want to read events from Azure Service Bus using structured streaming

0 Votes 0 ·

1 Answer

PramodValavala-MSFT avatar image
1 Vote"
PramodValavala-MSFT answered PramodValavala-MSFT commented

Looks like there is no readily available connector likely since Service Bus is not designed with this in mind, unlike Event Hubs. But it should be possible to write your own receiver (like this one).

Another alternative would be to immediately forward messages from Service Bus to a compatible source like Event Hubs using something simple like Azure Functions.


· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Is it possible to write structured streaming output to Azure Service Bus. If yes, please let me know how to achieve this. Thanks!

0 Votes 0 ·

anonymous user Like my answer mentions, it should be possible but has to be implemented and a connector is not readily available to just use.

0 Votes 0 ·