I am wanting to do a quality check on my data to ensure that today's file does not look like the previous day's file. In data factory, you can easily accomplish this with a Get Metada activity and specifying your argument as contentMD5. This functionality is not provided in Azure Synapse. I've tried querying the database to check for duplicate data, but the runtime is extremely long, as I have to go through this process for each file (over 100 files). Is there any workaround that you know of? Or is there a timeline for when the contentMD5 functionality will be available in Synapse? Appreciate the help.
