How deploy a model registered in AzureML into an IotEdge using SDK v2?

G Cocci 211 Reputation points Microsoft Employee
2023-10-20T10:20:30.85+00:00

I need to deploy a model I have registered within Azure ML to an IotEdge, being able to specify the environment and the score.py file. I was able to find an example that uses SDK v1 (https://github.com/microsoft/deploy-MLmodels-on-iotedge) but none that uses v2.

Can anyone help me out?

Thanks!

Giorgio

Azure IoT Edge
Azure IoT Edge
An Azure service that is used to deploy cloud workloads to run on internet of things (IoT) edge devices via standard containers.
543 questions
Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,577 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. LeelaRajeshSayana-MSFT 13,471 Reputation points
    2023-10-20T21:11:44.6233333+00:00

    Hi @G Cocci Greetings! I am checking to see if you have looked into the document Model deployment on IoT Edge devices The document does not provide detailed steps but it suggests to convert the ML model to work with a particular IoT Edge runtime. Model conversion usually includes optimizations like faster inference and smaller model footprint. The process differs for each ML framework and runtime. ONNX and MMdnn are some available open-source interoperability frameworks.

    Once the model conversion is done, you can use IoT Edge runtime to deploy the ML models as containers on IoT Edge. Let me know if this helps.