question

Jay-8106 avatar image
0 Votes"
Jay-8106 asked SaurabhSharma-msft commented

How to see Azure Costs by Pipeline

H,

I have a pipeline in Azure which every 5mins checks an external ftp server to see if a file is available, if file exists it moves the file to an on-prem drive.

I just looked at Data Factory Cost and when this job went live the ADF cost has jump from a few pounds to £130 a month so this simple ftp moving job could be costing £1,500 a year.

Have I missed something here, why is it so expensive?

azure-data-factory
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

SaurabhSharma-msft avatar image
0 Votes"
SaurabhSharma-msft answered SaurabhSharma-msft commented

Hi @jay-8106,

Thanks for using Microsoft Q&A !!
Azure Data pricing pipeline is based on the following factors -

  • Pipeline Orchestration/Execution

  • Data flow execution if any

  • Number Data factory operations
    You need to check the Pipeline run consumption details like Activity Runs, Activity Execution hours etc. on "Pipeline Runs" page on ADF Monitor against the above mentioned pipeline-
    135629-image.png
    And then you can fed Azure Pricing Calculator with the required details to get an estimated cost of the pipeline runs to understand if it resembles your actual billing. In case you see any discrepancies or want to know more about billing, then you probably need to check open an Azure Support ticket so that an engineer could look into your environment.

For ADF Pricing details please refer to Data Pipeline pricing

Thanks
Saurabh


image.png (97.2 KiB)
· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Thanks @SaurabhSharma-msft ,Can we use Azure functions or API to capture this details and calculate all the costing

on the fly, so that let's say we can have integrated view in PowerBI dashboard or any other reporting tool for that
matter.

1 Vote 1 ·

Hi @samy-7940,
I do not think of any API which could provide all these consumption details. You could try Pipelines Runs - Get get the pipeline run time to get (`durationInMs`).
136091-image.png
But not sure if any REST API available at pricing end which could do the calculations but you could look at Azure Retail Prices overview for more.

Thanks
Saurabh

0 Votes 0 ·
image.png (8.8 KiB)

Hi @samy-7940,
Please let us know if you find above reply useful. If yes, please accept above as answer. This will help other community members facing similar query to refer to this solution.

Thanks
Saurabh

0 Votes 0 ·