question

PiotrKotowski-4174 avatar image
0 Votes"
PiotrKotowski-4174 asked KranthiPakala-MSFT commented

Azure Data Factory performance parameters

Hi.

I am writing my master thesis and some blocker has appear.

I would like to execute my ADF pipelines with similar parameters (cores, RAM memory etc) as in the local computer.

Is there a possibility to configure pipelines execution like that?

azure-data-factory
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @PiotrKotowski-4174,

Just checking in to see if the below answer helped. If it answers your query, do click Accept Answer and Up-Vote for the same. And, if you have any further query do let us know.

0 Votes 0 ·

1 Answer

KranthiPakala-MSFT avatar image
0 Votes"
KranthiPakala-MSFT answered

Hello @PiotrKotowski-4174,

Thanks for the question and using MS Q&A platform.

If I understand the ask correctly, you want to know if we can parameterize the compute infrastructure details of Azure IR in ADF while executing piplines. Please correct if my understanding is incorrect.

I don't think it is possible execute the pipelines by parameterizing the compute infrastructure of your Azure IR. But you can use SHIR installed on your local machine which will use your local machine compute infrastructure instead.

But if you have any specific feedback regarding the product improvements, I would recommend logging a feature request in IDEAS forum here - https://feedback.azure.com/d365community/forum/1219ec2d-6c26-ec11-b6e6-000d3a4f032c.

All the feedback shared in this forum are actively monitored and reviewed by respective product owners.


Hope this will help.


  • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification

  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators


5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.