Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
2,663 questions
Azure Data Factory (ADF) Webhook activity response ingestion into azure storage container.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(233.6, 77%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED%3C/text%3E%3C/svg%3E)
Dheeraj
6
Reputation points
We are using Azure Data Factory and Databricks for building data lake, we are receiving data from various sources and uses Azure Data Factory (ADF) to ingest data in azure container storage.
Recently, one of the source system is sharing data as a Webhooks and there are around number of Webhooks which we need to listen. The Webhooks sends data in JSON format.
I am trying to configure Webbook activity in the Azure Data Factory, but I am not finding any option to write the data in Container storage.
If anybody has configured Webhooks into ADF and storing the response in azure storage containers, please share your approach or configuration.
Also, please share the best practices and use cases of webhooks.
Thank you.
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 44%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Saurabh Sharma 23,671 Reputation points Microsoft Employee2021-02-26T01:37:21.147+00:00 @Dheeraj Thanks for using Microsoft Q&A !!
I have not implemented WebHook activity but as per my knowledge WebHook activity only supports POST in ADF and you can send payload in the request body. Is it an Azure WebHook ? Can you please elaborate how data is being received via WebHooks in your case ?
If your endpoints are REST based then you can probably use Copy Data activity with REST as a source to get the required data in ADF and then send it to respective Azure storage.
Thanks
Saurabh -
Dheeraj 6 Reputation points
2021-03-02T14:28:26.69+00:00 Hello @Saurabh Sharma ,
Thank you for your response and sorry for the delay.
We are now able to get events from Webhook using Azure Function by writing the code in python.
The job of the function is to read Webhook events and save data into azure storage. We are using an HTTP trigger template to get the job done and able to receive the events from the Webhook, but when I try to write to azure storage it is giving me below error.
System.InvalidOperationException: Storage account connection string 'AzureWebJobs<AzureStorageAccountName>' does not exist. Make sure that it is a defined App Setting.
Can you please help here how to push data into azure storage from Azure Function.
-
Saurabh Sharma 23,671 Reputation points Microsoft Employee
2021-03-10T00:01:00.767+00:00 @Dheeraj sorry for the delay but have you defined AzureWebJobs settings ?
-
Saurabh Sharma 23,671 Reputation points Microsoft Employee
2021-03-12T16:50:01.497+00:00 @Dheeraj Following up if you are still facing this issue.
Sign in to comment