I am trying to pass all records of csv from data lake to on-premises database of SQL using Azure data factory. I know how to pass data one by one using LookUp and Copy activity but I don't know how to pass all records of csv.
Before insertion into database I want to validate all records are correct, not corrupted basically as per our logic so I was thinking to pass all records and validate. If all records are correct then dump into multiple tables of a database otherwise reject the CSV.
Can you please share your inputs if anyone have any idea