How to choose Integration Runtime to load data from ADLSGEN2 to sql server (in Azure VM) and vice versa.
How to decide on number of nodes where IR should be installed?
How to choose Integration Runtime to load data from ADLSGEN2 to sql server (in Azure VM) and vice versa.
How to decide on number of nodes where IR should be installed?
Hi Srinivas,
Welcome to the community.
You can determine which type of IR via this guide:
Sizing is not easy to come up with and I couldn't find any white paper that could help you out. (Note that I do not work for Microsoft so I do have access to only the same resources that you have.
I would personally recommend you perform performance tests with various configurations to better find what would represent an equilibrium between expense and performance for your organization.
Here's a "guide":
https://docs.microsoft.com/en-us/azure/data-factory/concepts-data-flow-performance
@PierreLucGiguere-5297 : Thanks for details. Checked these articles and couldn't use Azure IR to copy /move data from storage account to SQL Server which is hosted in Azure VM.
Does Self- hosted IR is only option for such scenario?
Hi Srinivas,
You can do it via both Self-Hosted and Azure IR.
Since I do not have a clear vision over your infrastructure; I can't really give you all of the big steps I would take but I would definitely go through the following 2 articles to elaborate my test plan:
https://docs.microsoft.com/en-us/azure/data-factory/connector-sql-server
https://docs.microsoft.com/en-us/azure/data-factory/tutorial-hybrid-copy-powershell
@PierreLucGiguere-5297 : So can we summarize like this?
If my SQL Server is in public network hosted in Azure VM then I can use Azure IR for data movement.
If SQL Server is in private network hosted in Azure VM then need to use Self-Hosted IR for data movement?
Please suggest.
28 people are following this question.