Synapse - "errorCode": "2011","message": "Time out to retry."

Bagga 16

I have pipeline with 2 activities and the second one is a notebook activity. The notebook receives and input string parameter from previous task, parses it and save the data into Spark DB. I am receiving attached error and i am not able to find much information on this.

Samara Soucy - MSFT 5,051 Reputation points

2021-06-01T14:54:43.913+00:00

In the Monitoring tab > Apache Spark Applications you should find the full logs from the failed notebook job.

Please let me know if you are able to find the issue from the Spark logs, or if you need help diagnosing the Spark error, please post the log info here. It could also helpful to see the notebook code, stripped of any proprietary info so I can try to reproduce the error.
Bagga 16 Reputation points

2021-06-03T06:47:32.057+00:00

//Declaring Parameters Variable (FileList is input from GetMetadata activity) @activity('GetFileList').output.childItems//
//Attached the input param//101500-input-param.txt101541-livylog.txt

var FileList : String

var ds = spark.createDataset(Seq(FileList))
var ds1 = spark.read.json(ds)
var df = ds1.withColumn("name",$"parameters.FileList.value.name")
val df1 = df.select(col("name"),explode(col("name")).as("FileName")).drop("name")
df1.write.mode("overwrite").saveAsTable("fileloadlist")102015-livylog.txt 101965-input-param.txt
Samara Soucy - MSFT 5,051 Reputation points

2021-06-08T00:14:18.63+00:00

Thank you for the script. Were you able to get any additional error info from the Spark section of the Monitoring tab?

1 answer

Bagga 16 Reputation points

2021-06-08T04:29:12.433+00:00

The logs did not give any additional information. But i was able to resolve the issue by moving the synapse notebook to databricks. The pipeline gave the exact error information after doing this. After fixing the code issue i moved the notebook back to synapse and it worked.

Thank you for the support.
Please sign in to rate this answer.

1 person found this answer helpful.
PRADEEPCHEEKATLA-MSFT 76,586 Reputation points Microsoft Employee

2021-06-15T11:26:03.487+00:00

Hi @Bagga ,

Glad to know that your issue has resolved. And thanks for sharing the solution, which might be beneficial to other community members reading this thread.

----
Please do click on"Accept the answer". This will help us and others in the community as well.
Sign in to comment