question

AnaRitaBorregoTIMESTAMP-4239 avatar image
0 Votes"
AnaRitaBorregoTIMESTAMP-4239 asked SaurabhSharma-msft commented

ADF Copy data with option merge files writes value column in hexadecimal

Hi,

I'm using a copy activity in adf to copy avro files from a staging folder (several "part-" files since it is written by spark) to a final folder where I want only one file in csv (delimited text) format.
I'm using the option "Copy behaviour - Merge files" in the sink part and for this part everything works fine.

My problem is that, somehow, one column that is supposed to have decimal values, in the csv file appears in hexadecimal....
I cannot have this behaviour because I'm not the one that will be using this data, so is not usefull at all to again access the information just to convert it and write it again....

Can someone explain to me what can be possibily happening?

azure-data-factory
· 5
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @anaritaborregotimestamp-4239,

Thanks for using Microsoft Q&A !!
What's the type (Float, Double etc.) of the respected field in avro schema file (.avsc) which being used while generating the avro file ?

Thanks
Saurabh

0 Votes 0 ·

Hi,
Is a DecimalType but I don't understand why is this important. I'm performing a copy activity, I understand that if some value has some character that is not well interpreted, it is a problem and sometimes this type of activity fail.
But in this case everything works fine, how is this possible that the copy activity actually manipulate and alter the data/dataset that is just copying?

Thanks

0 Votes 0 ·
SaurabhSharma-msft avatar image SaurabhSharma-msft AnaRitaBorregoTIMESTAMP-4239 ·

@anaritaborregotimestamp-4239 This is a strange behavior. Can you please share your Run Id so that I can try checking internally. I will let you know in case I need anything else.

Thanks
Saurabh

0 Votes 0 ·
Show more comments

0 Answers