AccelInferenceConfig Class

Model deployment config specific to accel model deployments.

Will either:

  1. Deploy a converted model if it's passed one.

  2. Deploy a previously converted model version of the model passed, if one exists.

  3. Convert the passed model and deploy the converted model.

Inheritance
builtins.object
AccelInferenceConfig

Constructor

AccelInferenceConfig(description=None, input_tensor=None, output_tensor=None)

Methods

build_create_payload

Build the creation payload for the Container image. For accelerated inference, the model id will be the base model, and may be converted or used to select a previously converted model.

build_profile_payload

Build the profiling payload for the Model package.

validate_configuration

Check that the specified configuration values are valid.

Will raise a WebserviceException if validation fails.

build_create_payload

Build the creation payload for the Container image. For accelerated inference, the model id will be the base model, and may be converted or used to select a previously converted model.

build_create_payload(workspace, image_name, model_ids)

Parameters

workspace
Workspace

The workspace object to create the image in

image_name
str

The name of the image

model_ids
<xref:<xref:azureml.accel.list>[str]<xref:>>

A list containing a single model id to determine which

Returns

Container image creation payload

Return type

build_profile_payload

Build the profiling payload for the Model package.

build_profile_payload(profile_name, input_data)

Parameters

profile_name
str

The name of the profile

input_data
str

The input data for profiling

Returns

Model profile payload

Return type

validate_configuration

Check that the specified configuration values are valid.

Will raise a WebserviceException if validation fails.

validate_configuration()