Merge Count Transform
Creates a set of features based on a counts table
Category: Learning with Counts
Applies to: Machine Learning Studio
This content pertains only to Studio. Similar drag and drop modules have been added to the visual interface in Machine Learning service. Learn more in this article comparing the two versions.
This article describes how to use the Merge Count Transform module in Azure Machine Learning Studio, to combine two sets of count-based features. By merging two sets of related counts and features, you can potentially improve the coverage and distribution of the features.
Learning from counts is particularly useful in large data sets with high-cardinality features. The ability to combine multiple datasets into count-based feature sets without having to reprocess the datasets makes it easier to gather statistics on very large datasets and apply them to new datasets. For example, count tables can be used to collect information over terabytes of data. You can re-use those statistics to improve the accuracy of predictive models on small data sets.
To merge two sets of count-based features, the features must have been created using tables that have the same schema: that is, both sets must use the same columns, and have the same names and data types.
How to configure Merge Count Transform
To use Merge Count Transform, you must have created at least one count-based transformation, and that transformation must be present in your workspace. If you saved a count-based transformation from a different experiment, look in the Transforms group. If you created the transformation in the current experiment, connect the outputs of the following modules:
Build Counting Transform. Creates a new count-based transformation from source data.
Modify Count Table Parameters. Takes an existing count transformation as an input and outputs an updated transformation.
Import Count Table. This module supports backward compatibility with older experiments that used count-based learning. If you used Import Count Table to analyze the distribution of values in a dataset, and then converted the values to features using the Count Featurizer (deprecated) module, use Import Count Table to convert the results to a transformation.
Add the Merge Count Transform module to the experiment, and connect a transformation to each input.
The second transformation is an optional input – you can connect the same transformation twice, or connect nothing on the second input port.
If you do not want the second dataset to be weighted equally with the first, specify a value for Decay factor. The value that you type indicates how the set of features from the second transformation should be weighted.
For example, the default value of 1 weights both sets of features equally. A value of .5 means that the features in the second set would have half the weight of those in the first set.
Optionally, add an instance of the Apply Transformation module, and apply the transformation to a dataset.
For examples of how this module is used, see the Azure AI Gallery:
Learning with Counts: Binary Classification: Demonstrates how to use the learning with counts modules to generate features from columns of categorical values for a binary classification model.
Learning with Counts: Multiclass classification with NYC taxi data: Demonstrates how to use the learning with counts modules for performing multiclass classification on the publicly available NYC taxi dataset. The sample uses a multiclass logistic regression learner to model this problem.
Learning with Counts: Binary classification with NYC taxi data: Demonstrates how to use the learning with counts modules for performing binary classification on the publicly available NYC taxi dataset. The sample uses a two-class logistic regression learner to model the problem.
|Previous counting transform||ITransform interface||The counting transform to edit|
|New counting transform||ITransform interface||The counting transform to add (optional)|
|Decay factor||Float||Required||1.0f||The decay factor to be multiplied to the counting transform at the right input port|
|Merged counting transform||ITransform interface||The merged transform|
|Error 0003||Exception occurs if one or more of inputs are null or empty.|
|Error 0086||Exception occurs when a counting transform is invalid.|