aks Module

Contains functionality for deploying machine learning models as web service endpoints on Azure Kubernetes Service.

Azure Kubernetes Service (AKS) is recommended for scenarios where you need full container orchestration, including service discovery across multiple containers, automatic scaling, and coordinated application upgrades.

For more information, see Deploy a model to Azure Kubernetes Service.

Classes

AksEndpoint

Represents a collection of web service versions behind the same endpoint running on Azure Kubernetes Service.

Whereas a AksWebservice deploys a single service with a single scoring endpoint, the AksEndpoint class enables you to deploy multiple web service versions behind the same scoring endpoint. Each web service version can be configured to serve a percentage of the traffic so you can deploy models in a controlled fashion, for example, for A/B testing. The AksEndpoint allows deployment from a model object similar to AksWebservice.

AksEndpointDeploymentConfiguration

Represents deployment configuration information for a service deployed on Azure Kubernetes Service.

Create an AksEndpointDeploymentConfiguration object using the deploy_configuration method of the AksEndpoint class.

AksServiceAccessToken

Describes the access token that can be specified in the Authorization header of scoring requests to Webservice.

AksServiceDeploymentConfiguration

Represents a deployment configuration information for a service deployed on Azure Kubernetes Service.

Create an AksServiceDeploymentConfiguration object using the deploy_configuration method of the AksWebservice class.

AksWebservice

Represents a machine learning model deployed as a web service endpoint on Azure Kubernetes Service.

A deployed service is created from a model, script, and associated files. The resulting web service is a load-balanced, HTTP endpoint with a REST API. You can send data to this API and receive the prediction returned by the model.

AksWebservice deploys a single service to one endpoint. To deploy multiple services to one endpoint, use the AksEndpoint class.

For more information, see Deploy a model to an Azure Kubernetes Service cluster.

AutoScaler

Defines details for autoscaling configuration of a AksWebservice.

AutoScaler configuration values are specified using the deploy_configuration or update methods of the AksWebservice class.

ContainerResourceRequirements

Defines the resource requirements for a container used by the Webservice.

ContainerResourceRequirement values are specified when deploying or updating a Webervice. For example, use the deploy_configuration or update methods of the AksWebservice class, or the create_version, deploy_configuration, or update_version methods of AksEndpoint class.

DataCollection

Defines data collection configuration for an AksWebservice.

LivenessProbeRequirements

Defines liveness probe time requirements for deployments of the Webservice.

LivenessProbeRequirements configuration values values are specified when deploying or updating a Webervice. For example, use the deploy_configuration or update methods of the AksWebservice class, or the create_version, deploy_configuration, or update_version methods of the AksEndpoint class.