How to use Azure files for model endpoints created in AML hosted on AKS?

Dr. Tobias Spranger 1 Reputation point
2022-06-27T11:30:47.103+00:00

Hello,
we have a complex data processing pipeline, including multiple different Models.
One of those models is a GPU-Model, which will be hosted as an API via AML.
Therefore, we are also using an AKS for the hosting/compute. This is working fine.
However, the model itself is supposed to use data generated by prior steps.
Downloading the data from a storage account into the container, is not a good solution.
We would like to "mount" the storage account directly and use the data therein (similar to databricks).

I also know, that for persistent volumes in AKS, you can use Azure Files.
However, normally you set this is up in the AKS and in the deployment-yaml.
With AML I did not find a way, to modify the deployments to use persistent volumes.
Is there really no way? Or did I just not find the documentation for that?

Azure Files
Azure Files
An Azure service that offers file shares in the cloud.
1,141 questions
Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,508 questions
0 comments No comments
{count} votes

2 answers

Sort by: Most helpful
  1. PriteeBhuyan-MSFT 16 Reputation points Microsoft Employee
    2022-06-28T03:25:38.337+00:00

    Hello @Dr. Tobias Spranger ,

    Thank you for posting query in Microsoft Q&A Platform. Is this for inference?

    Below content might be helpful.
    https://www.youtube.com/watch?v=SmVHNpKVs3Y
    Are you looking for something like below?

    215671-ml-aks-azurefiles.png
    https://www.youtube.com/watch?v=D0qsjJYj5Ow

    Azure Machine Learning team has a dedicated ARM template within Azure QuickStart templates that deploys secure configurations.
    https://microsoft.github.io/azureml-ops-accelerator/3-Deploy/ARMTemplates/

    Regards,
    Pritee

    1 person found this answer helpful.

  2. Dr. Tobias Spranger 1 Reputation point
    2022-06-29T08:21:12.187+00:00

    Thanks for the replies.
    I was initially looking for a way to use azure files with AML. And actually I found something in the depth of the documentation: https://learn.microsoft.com/en-us/azure/machine-learning/reference-kubernetes (at the bottom “AzureML jobs connect with custom data storage”).

    However, we re-evaluated our design and concluded, that the connection to the blob storage is actually enough and preferred to Azure Files. Therefore, your hints and links are helpful to create the more secure setup with the Storage Account, than just using the account key.

    Kind regards,
    Tobias