question

AntonyEllis-3010 avatar image
0 Votes"
AntonyEllis-3010 asked SathyamoorthyVijayakumar-MSFT commented

Azure data factory sink to pipe delimited text not working?

Hi There

Stumped here per images below I specify that I want the Sink to be column delimited by a | and yet the export file is comma delimited what am I doing wrong here?

133089-1.png
s


133067-2.png



I even tried creating an entirely new dataset incase some weird caching going on along with playing with the escape options but to no avail. Essentially just have a Copy Activity from an Azure SQL DB going into a Delimiited File (Blob Storage) account but the fields do not contain the Pipe?

Thanks

azure-data-factory
1.png (29.8 KiB)
2.png (6.3 KiB)
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @AntonyEllis-3010,
Just checking in to see if the below answer provided by @HimanshuSinha-MSFT helped. If this answers your query, do click Accept Answer and Up-Vote for the same. And, if you have any further query do let us know.

0 Votes 0 ·

1 Answer

HimanshuSinha-MSFT avatar image
0 Votes"
HimanshuSinha-MSFT answered SathyamoorthyVijayakumar-MSFT commented

Hello @AntonyEllis-3010 ,
Thanks for the ask and using Microsoft Q&A platform .
I did tried to repro and this is my JSON , very identical to yours .

},
"columnDelimiter": "|",
"escapeChar": "",
"firstRowAsHeader": true,
"quoteChar": ""
},
"schema": [
{
"name": "Prop_0",
"type": "String"
},
{
"name": "Prop_1",
"type": "String"
}
]

I must accept that we are not able to repto the issue . I see that you are using a dynamic file name . Can you please remove that and try again . The ADF pipelien will create a files name with the tablename.txt on the sink side .

133785-image.png


Please do let me know how it goes .
Thanks
Himanshu


  • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification

  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators


image.png (8.4 KiB)
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @AntonyEllis-3010,
Following up to see if the above suggestion was helpful. And, if you have any further query do let us know.

0 Votes 0 ·