question

Rajavarman-1032 avatar image
0 Votes"
Rajavarman-1032 asked YutongTie-MSFT commented

Generic framework for Azure machine Learning AutoML - Hyper parameter, featurization techniques

Currently we have implemented multiple Insurance use cases(Claims, Policy) using AutoML in Azure Machine Learning and created real-time endpoints.
We have a standard re-usable python scripts available where with few configuration changes, we are reusing this script for multiple use cases and quickly develop endpoints,

Currently, we need to apply our Insurance domain knowledge and enrich the training data set.
To do this, We understand there are features like Hyper parameter tuning, featurization, encoding techniques, etc. We understand that there are python libraries for that, but is there a generic framework/coding available so that we can make use of this and implement across multiple use cases to increase the model accuracy. This is mainly to reduce the dependency on data scientist and reduce the azure ml implementation time

azure-machine-learning
· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi,
I am not able to access the Github link you provided. Can you please check?

0 Votes 0 ·

1 Answer

ramr-msft avatar image
0 Votes"
ramr-msft answered YutongTie-MSFT commented

@Rajavarman-1032 Thanks for the question. Previously, it was a black-box preprocessing, with user’s preprocess=True/False setting.
New change includes deprecation of preprocess and introduction of new field featurization, where featurization = ‘auto’ (for automatic featurization, comparable to preprocess=True) / ‘off’ (to turn off featurization, comparable to preprocess=False) / FeaturizationConfig (object to pass in customized configuration on featurization setting).
For more information on custom featurization as well as how to construct FeaturizationConfig is in this documentation: https://docs.microsoft.com/en-us/azure/machine-learning/how-to-configure-auto-train#customize-feature-engineering
We also have a notebook available with example in our git repo: https://github.com/Azure/MachineLearningNotebooks/blob/master/how-to-use-azureml/automated-machine-learning/regression-hardware-performance-explanation-and-featurization/auto-ml-regression-hardware-performance-explanation-and-featurization.ipynb

· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @Rajavarman-1032

Could you please check if the repo Ram shared is helpful or not? The new link is here: https://github.com/Azure/MachineLearningNotebooks/tree/master/how-to-use-azureml/automated-machine-learning/regression-explanation-featurization

We are glad to help if you need further help. Please kindly accept the answer if you feel helpful. Thanks!

Regards,
Yutong

0 Votes 0 ·