question

27279010 avatar image
0 Votes"
27279010 asked 27279010 commented

Logic App Blob trigger to SFTP-SSH Connector - create multiple files efficiently

Hi,

I've built a PoC logic app which is triggered by a Blob storage add trigger.

Once triggered the logic app reads the blob, does some conversion and uses the create file connector action on SFTP-SSH connector to create the same file on an SFTP server. All good.

I will have multiple files to upload each time from Blob, the logic app takes 5-7 seconds to run.

I'd like to bulk create files on the SFTP server (the blob connector can return up to 100 blobs), at least reuse the SFTP connection.

I haven't tried it yet, but is my best option looping round and calling the SFTP connector's create file action for each blob ? I'm concerned about the overhead of the SFTP connection.

Many thanks

Matt

105503-image.png


azure-logic-apps
image.png (25.0 KiB)
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

MayankBargali-MSFT avatar image
0 Votes"
MayankBargali-MSFT answered 27279010 commented

@27279010 There are no action in SFTP-SSH connectors that can create multiple files on your SFTP server on the signal call/action.
You need to loop in and create the the file using Create File action. To speed up the creation of files when you use for loop you can enable the "Concurrency Control" and specify the Degree of parallelism so multiple file can be created at the same time. In logic app you only define the API connection and internally whenever there are action called/trigger it will creates the request and use the API connection that you have define with the authentication.

· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Thanks, that's how I've done it. I do need to look at concurrency but that's a question for another thread.

1 Vote 1 ·