Get data from API and send it in csv file in azure

DevBuster007 176 Reputation points
2021-06-23T19:29:06.99+00:00

An external API will call our API end point and push payment info every few minutes. We only need id# and need to write it in CSV file.
Store data in csv file for 1 hour. Once an hour is complete send the file to sftp server.
Then again create a new file start writing the data. We need to perform this operation 24*7.

Which azure resource should be appropriate to use here. Any help is greatly appreciated.

I can use Azure function and build an API to get the data and store in Cosmos DB.
Then another Azure function which will run every hour, get the data, place in file and push to sftp server.

Please suggest if there is any better alternative?

Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
4,301 questions
Azure Logic Apps
Azure Logic Apps
An Azure service that automates the access and use of data across clouds without writing code.
2,857 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Mike Urnun 9,676 Reputation points Microsoft Employee
    2021-06-28T04:04:54.433+00:00

    Hey @DevBuster007 - Welcome to MS QnA!

    The following:

    I can use Azure function and build an API to get the data and store in Cosmos DB.
    Then another Azure function which will run every hour, get the data, place in file and push to sftp server.

    will definitely work, and you'd build the solution & manage DevOps like any codebase, not to mention any billing difference there maybe. I would suggest Logic Apps though because you can build your solution very quickly using the design-first approach & leverage the connectors ecosystem for CosmosDB & SFTP, etc. If you have any specific queries around implementation, let me know and I'd be happy to weigh in and help.