Azure Synapse Analytics Pipeline Failure in For Each

pm-syn-lover 36 Reputation points
2021-06-14T18:42:27.933+00:00

Running a for each loop across multiple files, and during the pipeline run, I received this error for processing one of the files through a data flow activity(see screenshot below).
with error code 5000 and message: Job failed during run time with state = [dead].

The activity failed after 53 minutes of attempting to process. Despite the failure, the activity did transform the file properly. Any insight as to why there was an error? Is this an issue?

:105456-pipelineerror.jpg

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,314 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,250 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,337 questions
{count} vote

2 answers

Sort by: Most helpful
  1. Loonen, Frenk 6 Reputation points
    2021-07-09T14:49:05.557+00:00

    Me too. Very randomly. Pipeline with a for each that runs a data flow with a Synapse source which is the culprit. My for each usually kicks off 41 data flows of which on average around 10 have the issue. Just did a debug session in which only one data flow gets ran in the for each, and now also just this one has the issue.

    1 person found this answer helpful.

  2. Christopher Teljstedt 21 Reputation points
    2021-07-04T08:24:58.587+00:00

    I get the same problem too lately.

    0 comments No comments