question

KenKasaia-6850 avatar image
0 Votes"
KenKasaia-6850 asked PRADEEPCHEEKATLA-MSFT edited

Azure Databricks autoscale disk setting

I have a question about Databricks in Azure.

The "Autoscaling local storage" link below states that the virtual machine's Disk size can grow up to 5TB.
https://docs.microsoft.com/en-us/azure/databricks/clusters/configure#---autoscaling-local-storage

When we tried it, it didn't autoscale and stayed at 250GB.
Would you please tell me if you know how to configure it?

Thanks

azure-databricks
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @KenKasaia-6850,

Welcome to the Microsoft Q&A platform.

Looks like you have already opened a support ticket on the same.

Our support engineers are currently identifying the issue and get back to you soon.

Once the issue is sorted out with the support, please do share the resolution, which might be beneficial to other community members reading this thread.

0 Votes 0 ·

1 Answer

KenKasaia-6850 avatar image
1 Vote"
KenKasaia-6850 answered PRADEEPCHEEKATLA-MSFT edited

Share the answer.

Autoscaling works only on local disks.

This means that Autoscaling is working with "local_disk0" disk usage.
Therefore, even if you operate a file on another Disk area and tighten the area, automatic scaling will not work.

Thank you

· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @KenKasaia-6850,

Thanks for sharing the solution, you can accept it as answer( by clicking on the 113724-image.png). This can be beneficial to other community members. Thank you.


1 Vote 1 ·