Azure Data Factory performance parameters

Question

Hi.

I am writing my master thesis and some blocker has appear.

I would like to execute my ADF pipelines with similar parameters (cores, RAM memory etc) as in the local computer.

Is there a possibility to configure pipelines execution like that?

Answer 1

Hello @Piotr Kotowski ,

Thanks for the question and using MS Q&A platform.

If I understand the ask correctly, you want to know if we can parameterize the compute infrastructure details of Azure IR in ADF while executing piplines. Please correct if my understanding is incorrect.

I don't think it is possible execute the pipelines by parameterizing the compute infrastructure of your Azure IR. But you can use SHIR installed on your local machine which will use your local machine compute infrastructure instead.

But if you have any specific feedback regarding the product improvements, I would recommend logging a feature request in IDEAS forum here - https://feedback.azure.com/d365community/forum/1219ec2d-6c26-ec11-b6e6-000d3a4f032c.

All the feedback shared in this forum are actively monitored and reviewed by respective product owners.

Hope this will help.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators