Maklum balas Edit

Prebuilt Docker images for inference

  • Artikel
  • 2 minit untuk dibaca

Prebuilt Docker container images for inference are used when deploying a model with Azure Machine Learning. The images are prebuilt with popular machine learning frameworks and Python packages. You can also extend the packages to add other packages by using one of the following methods:

Why should I use prebuilt images?

  • Reduces model deployment latency.
  • Improves model deployment success rate.
  • Avoid unnecessary image build during model deployment.
  • Only have required dependencies and access right in the image/container. 

List of prebuilt Docker images for inference

  • All the docker images run as non-root user.
  • We recommend using latest tag for docker images. Prebuilt docker images for inference are published to Microsoft container registry (MCR), to query list of tags available, follow instructions on their GitHub repository.

TensorFlow

Framework version CPU/GPU Pre-installed packages MCR Path Curated environment
1.15 CPU pandas==0.25.1
numpy=1.20.1		 mcr.microsoft.com/azureml/tensorflow-1.15-ubuntu18.04-py37-cpu-inference:latest AzureML-tensorflow-1.15-ubuntu18.04-py37-cpu-inference
2.4 CPU numpy>=1.16.0
pandas~=1.1.x		 mcr.microsoft.com/azureml/tensorflow-2.4-ubuntu18.04-py37-cpu-inference:latest AzureML-tensorflow-2.4-ubuntu18.04-py37-cpu-inference
2.4 GPU numpy >= 1.16.0
pandas~=1.1.x
CUDA==11.0.3
CuDNN==8.0.5.39		 mcr.microsoft.com/azureml/tensorflow-2.4-ubuntu18.04-py37-cuda11.0.3-gpu-inference:latest AzureML-tensorflow-2.4-ubuntu18.04-py37-cuda11.0.3-gpu-inference

PyTorch

Framework version CPU/GPU Pre-installed packages MCR Path Curated environment
1.6 CPU numpy==1.20.1
pandas==0.25.1		 mcr.microsoft.com/azureml/pytorch-1.6-ubuntu18.04-py37-cpu-inference:latest AzureML-pytorch-1.6-ubuntu18.04-py37-cpu-inference
1.7 CPU numpy>=1.16.0
pandas~=1.1.x		 mcr.microsoft.com/azureml/pytorch-1.7-ubuntu18.04-py37-cpu-inference:latest AzureML-pytorch-1.7-ubuntu18.04-py37-cpu-inference

SciKit-Learn

Framework version CPU/GPU Pre-installed packages MCR Path Curated environment
0.24.1 CPU scikit-learn==0.24.1
numpy>=1.16.0
pandas~=1.1.x		 mcr.microsoft.com/azureml/sklearn-0.24.1-ubuntu18.04-py37-cpu-inference:latest AzureML-sklearn-0.24.1-ubuntu18.04-py37-cpu-inference

ONNX Runtime

Framework version CPU/GPU Pre-installed packages MCR Path Curated environment
1.6 CPU numpy>=1.16.0
pandas~=1.1.x		 mcr.microsoft.com/azureml/onnxruntime-1.6-ubuntu18.04-py37-cpu-inference:latest AzureML-onnxruntime-1.6-ubuntu18.04-py37-cpu-inference

XGBoost

Framework version CPU/GPU Pre-installed packages MCR Path Curated environment
0.9 CPU scikit-learn==0.23.2
numpy==1.20.1
pandas==0.25.1		 mcr.microsoft.com/azureml/xgboost-0.9-ubuntu18.04-py37-cpu-inference:latest AzureML-xgboost-0.9-ubuntu18.04-py37-cpu-inference

No framework

Framework version CPU/GPU Pre-installed packages MCR Path Curated environment
NA CPU NA mcr.microsoft.com/azureml/minimal-ubuntu18.04-py37-cpu-inference:latest AzureML-minimal-ubuntu18.04-py37-cpu-inference

Next steps