How to trigger a pipeline in Azure Synapse based on file getting dropped into a file server? Any workarounds? File Server connected through integration runtime. Thank you for your help!
How to trigger a pipeline in Azure Synapse based on file getting dropped into a file server? Any workarounds? File Server connected through integration runtime. Thank you for your help!
Hello @msftsyn7270,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond back with the more details and we will try to help .
Thanks
Himanshu
Hello @msftsyn7270,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond back with the more details and we will try to help .
Thanks
Himanshu
Hello @msftsyn7270 ,
Thanks for the ask and using the Microsoft Q&A platform .
Can you please elaborate as what do you mean by the file server ?
Anyways since the Event trigger only supports "Azure Data Lake Storage Gen2 and General-purpose version 2 storage accounts" , you will have to look for some custom solution .
One way can be to use tumbling window trigger and then we add a pipeline with the getmetadata activity and check for any new files arrived in the last X minutes .
Updated on 8/11
We currently have the trigger set to a specific time but would like to do an event-based trigger based on when files land into the specific folder on the file server
@NandanHegde-7720 rightly called out that the event based trigger is not supported for file server . I have a suggestion which i think you can think about , copy the file from this file share to a BLOB . By doing that you will be able to use event based trigger on that .
Please do let me know how it goes .
Thanks
Himanshu
Please do consider clicking on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members
Thank you for your response @HimanshuSinha-MSFT . To elaborate, the file server is located on a virtual machine. We used integration runtime to connect to the file server to pick up csv files from a specific folder. We currently have the trigger set to a specific time but would like to do an event-based trigger based on when files land into the specific folder on the file server. These files will come rarely and and random times ie. once every month or every 2 weeks. Any suggestions on how we set this up?
Hey ,
Based on my knowledge, unfortunately there is no way to have an event trigger on file server or file share.
Below links explain the same:
10 people are following this question.