Issue with output file format in Azure Data Flow (Delimited text dataset returning parquet files)

Adrian Searles 0 Reputation points
2024-04-04T19:17:24.58+00:00

I have a Data flow, where I take two sources from a sql database and sink them to a delimited text after some transformation. I am using inline sink types. This data flow works well.

After I have another data flow which takes the resulting file and after some transformation sinks to another delimited text. this one is a dataset that I have set up. For some reason the resulting file is in a parquet format. I know because I created a parquet dataset to preview the data and that worked. Am I doing something wrong?

Thanks,

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,606 questions

2 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. Adrian Searles 0 Reputation points
    2024-04-04T19:21:31.66+00:00

    somebody advised me to delete the Sink and create it again. I did and the problem was solved. I am getting a csv with correct content. What caused the issue is unclear to me.

    So tip. In these cases first delete and recreate the Sink.

    Thnx for your help.

  2. Harishga 3,580 Reputation points Microsoft Vendor
    2024-04-04T22:24:27.8133333+00:00

    Hi @Adrian Searles
    I'm glad that you were able to resolve your issue and thank you for posting your solution so that others experiencing the same thing can easily reference this! Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others ", I'll repost your solution in case you'd like to accept the answer .

    Issue:
    I have a Data flow, where I take two sources from a sql database and sink them to a delimited text after some transformation. I am using inline sink types. This data flow works well.After I have another data flow which takes the resulting file and after some transformation sinks to another delimited text. this one is a dataset that I have set up. For some reason the resulting file is in a parquet format. I know because I created a parquet dataset to preview the data and that worked. Am I doing something wrong?

    Solution:
    somebody advised me to delete the Sink and create it again. I did and the problem was solved. I am getting a csv with correct content. What caused the issue is unclear to me.

    So tip. In these cases first delete and recreate the Sink.

    If I missed anything please let me know and I'd be happy to add it to my answer, or feel free to comment below with any additional information.I hope this helps!

    If you have any other questions, please let me know. Thank you again for your time and patience throughout this issue.

    Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

    0 comments