ADF Copy Data Activity using Dynamics Connector - Slow Performance

Katherine Brock 1 Reputation point
2021-03-28T16:48:39.957+00:00

I am using the ADF Connector for Dynamics. I have created a Linked Service and Dataset and using that in a copy data activity in my pipeline. It took 6.5 minutes to process <200MB of data (throughout ~500KB/s). This is not sustainable for our production pipelines. I am using the default Azure IR. Any suggestions for performance improvement would be greatly appreciated.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,640 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee
    2021-03-29T23:10:49.707+00:00

    Hi @Katherine Brock ,

    Welcome to Microsoft Q&A forum and thanks for reaching out. If you use an Azure Integration Runtime that is in a not optimal region resulting in slow read/write, it is suggested to configure an Azure IR in another region closest to your data source. Could you please try IR in different region and see if that helps.

    Also please refer to guidance mentioned in this document to boost copy activity performance running on Azure IR : Troubleshoot copy activity on Azure IR

    Do let us know if this helps.

    ----------

    Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.