event based trigger in synapse start only for files smaller than 1mb

Question

I need to configure in my pipeline on Synapse, a trigger (event-based) that runs the pipeline only when the container recieves files bigger than 1Mb. This pipeline moves the data from one container to another one.
The trigger is running every day but at the saturdays and sundays we receive some small files (around 20mb size) and we dont want that pipeline starts.
Any suggestions will be appreciated.

Answer 1

What works for me is to play around with it:
https://learn.microsoft.com/en-us/azure/data-factory/control-flow-get-metadata-activity
see what it needs as configuration, what it returns - use debug option to run the pipeline and then check the activity output.
Some more info here
https://stackoverflow.com/questions/65152580/azure-data-factory-v2-check-file-size-for-copy-activity

Idea would be to have this check as the first step in the pipeline, it cannot, as far as I know, be a part of the trigger.

Answer 2

You can add a "Get Metadata" activity in the beginning of your pipeline to retrieve the file size and start the pipeline based on it.

Answer 3

Thnak you! I will do this. :)