question

BiswajeetKumar-6788 avatar image
0 Votes"
BiswajeetKumar-6788 asked SumanthMarigowda-MSFT commented

AZCopy throughput speed variable

Hi,

Whats decide the AzCopy throughput speed.

Lets say I have 8 GB of data to transfer from my machine to azure file share. Now in the beginning the throughput was ~50mb/s almost 70% copied and at the end it was ~200mb/s. I have nothing else running of my machine. why the difference ?

Thanks

azure-storage-accounts
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

SumanthMarigowda-MSFT avatar image
0 Votes"
SumanthMarigowda-MSFT answered SumanthMarigowda-MSFT commented

@BiswajeetKumar-6788 Many things can contribute to this. Small files can decrease transfer speeds, network congestion can reduce transfer speeds, disk access congestion can reduce transfer speeds, etc.
Storage accounts don't have a provisioned bandwidth in terms of MBPs, but instead in IOPS (I/O operations per second), small files can use multiple of them and not put a large amount of data, consumes IOPS.

Performance of AzCopy with Azure Storage
Runs a performance benchmark by uploading or downloading test data to or from a specified destination. For uploads, the test data is automatically generated. azcopy benchmark

122461-image.png

Hope this helps!
Kindly let us know if the above helps or you need further assistance on this issue.


Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.



image.png (83.4 KiB)
· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi thanks for the reply,

I know that file size and network congestion is not in our hand, it what it is. But how can we check that there is disk access congestion that is reducing the speed?

Thanks

0 Votes 0 ·

@BiswajeetKumar-6788 We would recommend creating a similar scenario under azcopy bench-- That scans over why AzCopy might be slowed down and identifies the bottleneck.

Runs a performance benchmark by uploading or downloading test data to or from a specified destination. For uploads, the test data is automatically generated. : https://docs.microsoft.com/en-us/azure/storage/common/storage-ref-azcopy-bench

0 Votes 0 ·