data flow - Delta dataset sink - Delete if - parquet file

arkiboys 9,556 Reputation points
2021-10-04T20:31:41.28+00:00

Hello,
I am experimenting the Delta dataset in parquet file in the sink activity...
I have the upsert if working for the .parquet files by selecting the upsert if setting to true()
For example when the source is updated ,then the parquet sink is updated accordingly. But if a row is deleted in source it is still shown in sink parquet file even when check the Allow Delete .Any suggestions?
Thank you

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,346 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. HimanshuSinha-msft 19,376 Reputation points Microsoft Employee
    2021-10-05T23:35:46.347+00:00

    Hello @arkiboys ,
    Thanks for the ask and using Microsoft Q&A platform .

    https://learn.microsoft.com/en-us/answers/questions/576924/delete-row-in-parquet-sink-delta.html?childToView=578728#answer-578728

    Please do let me know how it goes .
    Thanks
    Himanshu

    -------------------------------------------------------------------------------------------------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators