question

MirzaAzadBeg-2234 avatar image
0 Votes"
MirzaAzadBeg-2234 asked MarkA-6676 answered

How do we run Azure Data Factory PIPELINE from Azure Databricks notebook using Python or Scala

Hi Team,
Good Morning..

I have a requirement to call Azure Data Factory's published pipeline from Azure Databricks notebook using Python or Scala code, I was trying the same but could not find the way that how to call it from Azure Databricks(ADB) notebook?
So can you please help me how to achieve this requirement.

Thank you.


Regards,
Mirza Azad Beg

azure-databricks
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

PRADEEPCHEEKATLA-MSFT avatar image
0 Votes"
PRADEEPCHEEKATLA-MSFT answered

Hello anonymous user,

Welcome to the Microsoft Q&A platform.

Unfortunately, you cannot run ADF pipelines from Azure Databricks notebook using Python or Scala language.

The other way is possible, running Azure Databricks notebooks using ADF pipeline using Notebook/Python/Jar activities.

I would suggest you to provide feedback on the same:

https://feedback.azure.com/forums/270578-data-factory

https://feedback.azure.com/forums/909463-azure-databricks

All of the feedback you share in these forums will be monitored and reviewed by the Microsoft engineering teams responsible for building Azure.

Hope this helps. Do let us know if you any further queries.


Please "Accept the answer" if the information helped you. This will help us and others in the community as well.

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

MarkA-6676 avatar image
0 Votes"
MarkA-6676 answered
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.