Merge Count Transform

Creates a set of features based on a counts table

Category: Learning with Counts

Note

Applies to: Machine Learning Studio

This content pertains only to Studio. Similar drag and drop modules have been added to the visual interface in Machine Learning service. Learn more in this article comparing the two versions.

Module overview

This article describes how to use the Merge Count Transform module in Azure Machine Learning Studio, to combine two sets of count-based features. By merging two sets of related counts and features, you can potentially improve the coverage and distribution of the features.

Learning from counts is particularly useful in large data sets with high-cardinality features. The ability to combine multiple datasets into count-based feature sets without having to reprocess the datasets makes it easier to gather statistics on very large datasets and apply them to new datasets. For example, count tables can be used to collect information over terabytes of data. You can re-use those statistics to improve the accuracy of predictive models on small data sets.

To merge two sets of count-based features, the features must have been created using tables that have the same schema: that is, both sets must use the same columns, and have the same names and data types.

How to configure Merge Count Transform

  1. To use Merge Count Transform, you must have created at least one count-based transformation, and that transformation must be present in your workspace. If you saved a count-based transformation from a different experiment, look in the Transforms group. If you created the transformation in the current experiment, connect the outputs of the following modules:

  2. Add the Merge Count Transform module to the experiment, and connect a transformation to each input.

    Tip

    The second transformation is an optional input – you can connect the same transformation twice, or connect nothing on the second input port.

  3. If you do not want the second dataset to be weighted equally with the first, specify a value for Decay factor. The value that you type indicates how the set of features from the second transformation should be weighted.

    For example, the default value of 1 weights both sets of features equally. A value of .5 means that the features in the second set would have half the weight of those in the first set.

  4. Optionally, add an instance of the Apply Transformation module, and apply the transformation to a dataset.

Examples

For examples of how this module is used, see the Azure AI Gallery:

Expected inputs

Name Type Description
Previous counting transform ITransform interface The counting transform to edit
New counting transform ITransform interface The counting transform to add (optional)

Module parameters

Name Type Range Optional Description Default
Decay factor Float Required 1.0f The decay factor to be multiplied to the counting transform at the right input port

Outputs

Name Type Description
Merged counting transform ITransform interface The merged transform

Exceptions

Exception Description
Error 0003 Exception occurs if one or more of inputs are null or empty.
Error 0086 Exception occurs when a counting transform is invalid.

See also

Learning with Counts
Build Count Table (deprecated)