Azure data factory sink to pipe delimited text not working?

Antony Ellis 11 Reputation points
2021-09-17T11:57:02.01+00:00

Hi There

Stumped here per images below I specify that I want the Sink to be column delimited by a | and yet the export file is comma delimited what am I doing wrong here?

133089-1.png
s

133067-2.png

I even tried creating an entirely new dataset incase some weird caching going on along with playing with the escape options but to no avail. Essentially just have a Copy Activity from an Azure SQL DB going into a Delimiited File (Blob Storage) account but the fields do not contain the Pipe?

Thanks

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,645 questions
{count} votes

1 answer

Sort by: Most helpful
  1. HimanshuSinha-msft 19,381 Reputation points Microsoft Employee
    2021-09-20T23:40:36.82+00:00

    Hello @Antony Ellis ,
    Thanks for the ask and using Microsoft Q&A platform .
    I did tried to repro and this is my JSON , very identical to yours .

    },
    "columnDelimiter": "|",
    "escapeChar": "",
    "firstRowAsHeader": true,
    "quoteChar": ""
    },
    "schema": [
    {
    "name": "Prop_0",
    "type": "String"
    },
    {
    "name": "Prop_1",
    "type": "String"
    }
    ]

    I must accept that we are not able to repto the issue . I see that you are using a dynamic file name . Can you please remove that and try again . The ADF pipelien will create a files name with the tablename.txt on the sink side .

    133785-image.png

    Please do let me know how it goes .
    Thanks
    Himanshu

    -------------------------------------------------------------------------------------------------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators