question

surya1509 avatar image
0 Votes"
surya1509 asked KranthiPakala-MSFT answered

pipeline fails because of file lock out

Hi , We have Azure Synapse Link for Dataverse to get realtime changes from CRM dynamics 365, all the data from dataverse is linked to Azure Synapse Analytics and/or Azure Data Lake Storage Gen2. We have a data factory pipeline which is sourcing the data from synapse dataverse database ( which is accessing the files from data lake on the background), when data factory pipeline is accessing some of the objects/tables from synapse dataverse , the pipeline is failing because of the lock timeout issues , as realtime replication is happening from crm dynamics 355 to synapse link dataverse objects .

Is there a way we can stop the adf pipeline from failing whenever the corresponding dataverse files are locked by crm dynamics 365 ?

azure-data-factoryazure-synapse-analytics
· 1
5 |1600 characters needed characters left characters exceeded
Toggle Comment visibility. Current Visibility: Visible to all users

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

KranthiPakala-MSFT avatar image KranthiPakala-MSFT ·

Hello @surya1509,

Thanks for the question and using MS Q&A platform.

We are reaching out to internal team to get more information on how to handle such scenario when Synapse link for Dataverse is updating the target tables/files. Will keep you posted as soon as we have update from the team.

Thank you

0 Votes 0 ·

1 Answer

KranthiPakala-MSFT avatar image
0 Votes"
KranthiPakala-MSFT answered

Hello @surya1509,
As per the confirmation from product team, this is a known issue from the product side and product is actively working on a feature wherein we will provide read-only snapshots, every hour to create a read isolation and prevent locks issue.

I would recommend you to please subscribe to Azure updates page for latest info regarding Azure product releases.

Thank you


· 1
5 |1600 characters needed characters left characters exceeded
Toggle Comment visibility. Current Visibility: Visible to all users

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

surya1509 avatar image surya1509 ·

Thanks Kranthi

0 Votes 0 ·