question

GauravKapadia-3249 avatar image
0 Votes"
GauravKapadia-3249 asked GauravKapadia-3249 commented

ADF Copy Activity with Excel Dataset as a Source Fails Randomly due to File Size Error


We have a copy data activity in one of our data ingestion flows, which uses Excel as the Source and Azure Synapse DW as the destination. This load runs multiple times during the day and we've noticed it failing sometimes with either of the following errors -
1.
133826-image.png

  1. 133853-image.png

The successful runs usually last anywhere between 5 min to 40 min, while the failures run for at least an hour before giving the error..The file is roughly 35.5 MB in size and the occurrence and the type of the error is very random. The execution utilizes the AutoResolve IR and we've observed the other parallel loads are not a reason for this. Many times, reprocessing the file right after the load's failed, gets completed with no issues. Are we missing something somewhere or are there any upper limits to the file size that can be handled by the Excel Dataset in the ADF?


azure-data-factoryazure-synapse-analytics
image.png (20.9 KiB)
image.png (13.8 KiB)
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @GauravKapadia-3249,

Thanks for using Microsoft Q&A !!
As per this thread this error occurs when the excel file is big however it looks like you are getting intermittently, so I suggest you to open a support ticket so that someone could look into your environment. In case you have any limitations creating a support ticket please let me know and I will help providing a one-time free support ticket.

Please let me know if you have any questions.

Thanks
Saurabh


0 Votes 0 ·

0 Answers