Spark Structured Streaming Azure Service Bus

Yennam, ShowryPremsagar 41

Could someone clarify me ,whether Azure Service Bus queues cab be accessed using this API or not? Please Suggest the relevant doc

Yennam, ShowryPremsagar 41 Reputation points

2020-10-05T10:39:31.55+00:00

Note , I would like to connect to Azure Servicee Bus Queues not EEventhub with a topic
Pramod Valavala 20,591 Reputation points Microsoft Employee

2020-10-05T14:04:33.047+00:00

Just to make sure I understand correctly, you are trying to read from Event Hubs using the Spark Streaming API and write to a Service Bus Topic?
Yennam, ShowryPremsagar 41 Reputation points

2020-10-05T14:05:48.247+00:00

No . I just want to read events from Azure Service Bus using structured streaming

Accepted answer

Pramod Valavala 20,591 Reputation points Microsoft Employee

2020-10-06T16:11:18.653+00:00

Looks like there is no readily available connector likely since Service Bus is not designed with this in mind, unlike Event Hubs. But it should be possible to write your own receiver (like this one).

Another alternative would be to immediately forward messages from Service Bus to a compatible source like Event Hubs using something simple like Azure Functions.
Please sign in to rate this answer.

1 person found this answer helpful.
Sonam Jain 1 Reputation point Microsoft Employee

2021-04-28T15:25:57.377+00:00

Is it possible to write structured streaming output to Azure Service Bus. If yes, please let me know how to achieve this. Thanks!

Pramod Valavala 20,591 Reputation points Microsoft Employee

2021-04-29T07:44:23.687+00:00

anonymous user Like my answer mentions, it should be possible but has to be implemented and a connector is not readily available to just use.
Sign in to comment

0 additional answers