ADF web activity

arkiboys 9,596 Reputation points
2022-04-14T06:24:05.003+00:00

Hello,
Now that I have completed the ADF pipeline, at the end of it I would like to use a web activity so that it informs external apps that the ADF has completed loading the files successfully.
Question:
Can you please let me know what needs to be done from the external app?
do they need to provide a url or something like that and the web activity to call that url and pass a parameter to say if it failed or succeeded?
Any simple example to see how web activity notifies other apps for this requirement?
Thank you

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,515 questions
0 comments No comments
{count} votes

Accepted answer
  1. KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee
    2022-04-15T18:04:20.237+00:00

    Hello @arkiboys ,

    Thanks for the question and using MS Q&A platform.

    At this point we are not sure what your external app is. But in general, the implementation totally depends on the capabilities of your external application, if your app exposes an endpoint (nothing but an endpoint URL through which you can pass the parameters) then you will have to pass the respective fileds to the endpoint using ADF web activity. In case if your external app can read data from blob, then you can write a blob with few details about the competition of the pipeline like pipeline name, pipeline runID, status, etc. In a similar way if your pipeline can read from SQL then you can write the pipeline completion details to SQL and then your external app can read it. If you have custom code that can pass the message to your external app, then you may also use a Custom activity or an Azure Function Activity inside your ADF pipeline.

    do they need to provide a url or something like that and the web activity to call that url and pass a parameter to say if it failed or succeeded?

    Yes, you are correct, an endpoint URL is needed to pass the message/content to your external app.

    As your external app is generic at this point, you may consider any of the above discussed scenarios as per your requirement.

    Hope this will help. Please let us know if any further queries.


    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

0 additional answers

Sort by: Most helpful