question

MohsenAkhavan avatar image
0 Votes"
MohsenAkhavan asked HimanshuSinha-MSFT commented

Copy last data from two PostgreSQL Db by Azure Data Factory

I have a Postgresql database on VM and also, I have an Azure Database for PostgreSQL. I want to know is there any way to use the Azure Data factory for copying the last data?
For example, Daily run a pipeline and copy the last data then added to a table from VM to Azure.
I test copy data, but every time the task run, the pipeline copy all table data and add it to the destination table.

azure-data-factoryazure-database-postgresql
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @MohsenAkhavan ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond back with the more details and we will try to help .
Thanks
Himanshu

0 Votes 0 ·

1 Answer

HimanshuSinha-MSFT avatar image
1 Vote"
HimanshuSinha-MSFT answered

Hello @MohsenAkhavan ,
Thanks for the ask and using the Microsoft Q&A platform .
If I understand the ask , I think you want to only move the delta data and not all the data . if thats the case you will have to use the watermark logic .
Please do read about the same here .

Please do let me know how it goes .
Thanks
Himanshu
Please do consider clicking on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members


5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.