question

CharbelDaiaMartins-0878 avatar image
0 Votes"
CharbelDaiaMartins-0878 asked HimanshuSinha-MSFT commented

Data Flow - DFExecutorUserError failed while writing rows


Hi,
I'm trying to write a .csv file from a DataLake (DataLake1) of my subscription to another data Lake (DataLake2) in another subscription, I created a dataset with a Linked Service configured, I created a new pipeline and inside it I have a dataflow source (DataLake1 ) and the sink (DataLake2), it manages to create the directory starts recording the file and generates the following error message:

{"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: Task failed while writing rows.","Details":"Task failed while writing rows."}
93900-dataflow1.png93920-dataflow2.png93927-dataflow3.png


Thanks
Charbel

azure-data-factory
dataflow1.png (65.5 KiB)
dataflow2.png (79.9 KiB)
dataflow3.png (16.6 KiB)
· 4
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @CharbelDaiaMartins-0878 ,

The error message is not very helpful . As per your post its looks like there are two different subscription is in play .Can you please see if you are able to write the CSV in a different data Lake in the same subscription ( as tyeh source ) or you are hitting the same error .

Please do let me know how it goes .
Thanks
Himanshu

0 Votes 0 ·

Hi, Himanshu

Using the pipeline only with the copy/data component I can write from DataLake1 to DataLake2 without problems, but when I use the dataflow I have the problem described above.
Is There some difference in behavior between using copy/data for a dataflow with source/sink?

Thanks
Charbel

0 Votes 0 ·

Hello @CharbelDaiaMartins-0878,
Thanks for the patience , unfortunately we are not getting the kind of response from the team here . if you have a support plan you may file a support ticket, else could you please send an email to azcommunity@microsoft.com with the below details, so that we can create a one-time-free support ticket for you to work closely on this matter.
Subscription ID:
Subject : Attn Himanshu
Please let me know once you have done the same.

Thanks
Himanshu

0 Votes 0 ·
Show more comments

0 Answers