question

arkiboys avatar image
0 Votes"
arkiboys asked arkiboys commented

data flow - Delta dataset sink - Delete if - parquet file

Hello,
I am experimenting the Delta dataset in parquet file in the sink activity...
I have the upsert if working for the .parquet files by selecting the upsert if setting to true()
For example when the source is updated ,then the parquet sink is updated accordingly. But if a row is deleted in source it is still shown in sink parquet file even when check the Allow Delete .Any suggestions?
Thank you

azure-synapse-analytics
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

HimanshuSinha-MSFT avatar image
0 Votes"
HimanshuSinha-MSFT answered arkiboys commented

Hello @arkiboys ,
Thanks for the ask and using Microsoft Q&A platform .

https://docs.microsoft.com/en-us/answers/questions/576924/delete-row-in-parquet-sink-delta.html?childToView=578728#answer-578728

Please do let me know how it goes .
Thanks
Himanshu


  • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification

  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi,
Using Delta in Sink allows to use upsert.
The question now I am looking to solve is how to get the "Delete if" to work

Thank you

0 Votes 0 ·