We have requirement to copy new and modified files incrementally from a ADLS folder and also select specific files based on starting with specific file name into ADLS Gen2.
There are 2 different file names are there
BackendREQ_
BackendRESP_
Here we need to copy only BackendRESP_ files with incremental approach which are newly created and last modified.
Can someone please help us in writing Data Factory ingestion pipeline, here source and sink both are ADLS Gen2 and file format is JSON.
Thank you in anticipation!!
Regards,
Mahammad Khan



