question

IR-1518 avatar image
0 Votes"
IR-1518 asked ShaikMaheer-MSFT commented

Data Factory Dataflows - Integration runtime parameterization

Hi,

Is it possible to assign/modify the Integration runtime of multiple dataflows in one go?.

we have 50 pipelines with multiple dataflows in each pipeline using different IRs(azure), how can we assign specific IRs to group of dataflows dynamically.

This is required mainly to change the IR based on cluster size & data volume.

is there a command to execute the pipeline by passing the IR for each specific dataflow within the pipeline?

Thanks

azure-data-factory
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @IR-1518 ,

Following up to see if below provided answer helps you? If yes, Please consider to click on Accept Answer. Accepted answers helps community as well. Thank you.

0 Votes 0 ·

1 Answer

MarkKromer-MSFT avatar image
0 Votes"
MarkKromer-MSFT answered ShaikMaheer-MSFT commented

While you cannot dynamically change the IR assigned to the data flow activity in the ADF UI today, you can parameterize the core counts and compute type in the data flow pipeline activity directly. Just set the Azure IR to the default auto-resolve IR and you'll see this dynamic option.

· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Thanks for the response.

we are looking for this option for user created Azure IR( Region specific). Any other possible way to replace the assigned IR for the dataflows?.

Thanks
Indra

0 Votes 0 ·

Hi @IR-1518 ,

Thank you for follow-up query.

As mentioned by @MarkKromer-MSFT, Unfortunately at this moment dynamically changing IR assigned to data flow activity is not possible. Please check below screenshot for same.

130287-image.png

Hope this will help. Please let us know if any further queries. Thank you.


  • Please don't forget to click on Accept Answer button 130100-acceptansw.jpg whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification

  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators


0 Votes 0 ·
image.png (196.0 KiB)
acceptansw.jpg (2.5 KiB)