ADF Copy Data Activity - Sudden Intermittent ADLS Connectivity Issue

Jared Buschkopf 211 Reputation points
2020-12-03T16:41:19.897+00:00

Starting yesterday we're suddenly seeing these intermittent failures with Copy Data activities that copy data to Azure Data Lake Storage Gen1. It has happened both on 12/2/2020 and 12/3/2020 shortly after midnight (Central).

Error code 2200
Failure type User configuration issue
Details

Failure happened on 'Sink' side. ErrorCode=FailedToGetAccessTokenByMsi,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Failed to get access token by using MSI authenticator. The error message is: One or more errors occurred..,Source=Microsoft.DataTransfer.ClientLibrary,''Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Request MI token failed: An error occurred while sending the request.The remote name could not be resolved: 'eu.frontend.clouddatahub.net',Source=Microsoft.DataTransfer.MsiStoreServiceClient,'

This winds up leaving us without any data file at all in the location that the Copy Data activity writes to and is causing further issues in downstream systems. Obviously our processes could be improved to be more robust and we've already started on this, but I have to wonder:

  1. Has anyone else experienced this?
  2. Is this really the correct/intended behavior when the copy data activity fails in this way? Shouldn't I still have the previous version of the file?
  3. Why is the Azure environment suddenly failing intermittently in this way? Nothing on our end changed with this connection from our data factory to our ADLS Gen1 and the next time we try the copy it succeeds. As you can see from the error as well it appears to be some type of connectivity issue. I have seen other similar errors in my searching that appear to be related to incorrect configuration with self hosted integration runtimes and/or the managed data factory identity and its access to the data lake storage but that does not apply in this case. This is an Azure integration runtime, the setup of the linked service and managed data factory identity has not changed, and it doesn't happen all the time.
Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,338 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,487 questions

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest