question

SunilBailwal-2791 avatar image
0 Votes"
SunilBailwal-2791 asked KranthiPakala-MSFT edited

Use of ADF Linked service in Azure Syanpse

I am having one self hosted runtime installed on our premises, which is used in Azure Data Factory with a Atlas Mongo db linked service. Now I want to use the same Linked Service in Azure synapse Pipeline.

For this reason I have to again installed a self-hosted runtime in another machine in the on-premises network(I do not want to do it)

There is another concept of Manage End Points, here I can create a New managed private endpoint but unfortunately endpoint for Atlas mongo db service is not available.

There is another option Private Link service is available but i do not its use. Also I do not know whether I can reuse my exiting ADF connection to Azure Synapse Connection.

Please let me know if I am going in the right direction.

azure-data-factoryazure-synapse-analytics
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @SunilBailwal-2791,

We still have not heard back from you. Just wanted to check if any of the below suggestions were helpful? If it answers your query, please do click Accept Answer and/or Up-Vote, as it might be beneficial to other community members reading this thread. And, if you have any further query do let us know.

0 Votes 0 ·
NandanHegde-7720 avatar image
0 Votes"
NandanHegde-7720 answered KranthiPakala-MSFT edited

Hey,
Based on my understanding, you cannot share IRs between synapse workspace and ADF.
So installing 1 per ADF and synapse was the right thing to do for transferring data.
May I ask the reason for creating an ADF and a synapse workspace separate? You can leverage ADF itself for all activities.

· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

ADF pipelines was created earlier. So I am having requirement to do the things inside synapse only.

0 Votes 0 ·

Hello @SunilBailwal-2791,

At this time you can migrate ADF pipelines/artifacts to Synapse workspace by exporting the support JSON files of your ADF pipelines/artifacts and using Azure PowerShell cmdlets for Azure Synapse Analytics to create the same artifacts in Synapse workspace.

Here is a thread where a detailed step-by step implementations was provided: Azure Data Factory V2 Arm template to Synpase Data Integration without Git.

Regarding Manaded Endpoints in Synapse - > Managed private endpoints are available only after integration runtime is enabled with Managed Virtual network. In order to enable IR Managed Vnet, the workspace should have been enabled for virtual network, if not please create a new workspace with virtual network option enabled as the existing workspace cannot be changed to enable Virtual network. This has to happen while creating it .

Hope this info helps. Do let us know if you have further query


Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.

0 Votes 0 ·
KranthiPakala-MSFT avatar image
0 Votes"
KranthiPakala-MSFT answered

Hello @SunilBailwal-2791,

Thanks for the question and using MS Q&A platform.

My understanding is that you have an Atlas Mongo db linked service with SHIR in your ADF instance and you would like to know if there is a way to reuse the same Linked Service in your Synapse Pipeline. Please correct if my understanding is incorrect.

The answer is no as you cannot reshare the SHIR as called out by @NandanHegde-7720. As of today, SHIR can only be shared across data factories but not between ADF and Synapse pipelines. For more info, please refer to this doc: Data integration in Azure Synapse Analytics versus Azure Data Factory

Possible workaround: You will have to install a seperate IR for your Synapse instance and create a SHIR with same name as that of ADF SHIR and then export the linked service json template and use it to deploy it to your Synapse instance as described in this thread (After deploying the JSON files to Azure Synapse Analytics workspace, make sure to verify/modify the linked services configuration accordingly) - Azure Data Factory V2 Arm template to Synpase Data Integration without Git

Hope this will help. Please let us know if any further queries.


  • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification

  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators


5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.