Import your training data into Azure Machine Learning Studio from various data sources

To use your own data in Machine Learning Studio to develop and train a predictive analytics solution, you can:

  • upload data from a local file ahead of time from your hard drive to create a dataset module in your workspace
  • access data from one of several online data sources while your experiment is running using the Import Data module
  • use data from another Azure Machine learning experiment saved as a dataset
  • use data from an on-premises SQL Server database

Each of these options is described in one of the topics on the menu below. These topics show you how to import data from these various data sources to use in Machine Learning Studio.

Note

There are a number of sample datasets available in Machine Learning Studio that you can use for training data. For information on these, see Use the sample datasets in Azure Machine Learning Studio).

This introductory topic also discusses how to get data ready for use in Machine Learning Studio and describes which data formats and data types are supported.

Note

Try Azure Machine Learning for free

No credit card or Azure subscription required. Get started now.

Get data ready for use in Azure Machine Learning Studio

Machine Learning Studio is designed to work with rectangular or tabular data, such as text data that's delimited or structured data from a database, though in some circumstances non-rectangular data may be used.

It's best if your data is relatively clean. That is, you'll want to take care of issues such as unquoted strings before you upload the data into your experiment.

However, there are modules available in Machine Learning Studio that enable some manipulation of data within your experiment. Depending on the machine learning algorithms you'll be using, you may need to decide how you'll handle data structural issues such as missing values and sparse data, and there are modules that can help with that. Look in the Data Transformation section of the module palette for modules that perform these functions.

At any point in your experiment you can view or download the data that's produced by a module by clicking the output port. Depending on the module, there may be different download options available, or you may be able to visualize the data within your web browser in Machine Learning Studio.

Data formats and data types supported

You can import a number of data types into your experiment, depending on what mechanism you use to import data and where it's coming from:

  • Plain text (.txt)
  • Comma-separated values (CSV) with a header (.csv) or without (.nh.csv)
  • Tab-separated values (TSV) with a header (.tsv) or without (.nh.tsv)
  • Excel file
  • Azure table
  • Hive table
  • SQL database table
  • OData values
  • SVMLight data (.svmlight) (see the SVMLight definition for format information)
  • Attribute Relation File Format (ARFF) data (.arff) (see the ARFF definition for format information)
  • Zip file (.zip)
  • R object or workspace file (.RData)

If you import data in a format such as ARFF that includes metadata, Machine Learning Studio uses this metadata to define the heading and data type of each column.

If you import data such as TSV or CSV format that doesn't include this metadata, Machine Learning Studio infers the data type for each column by sampling the data. If the data also doesn't have column headings, Machine Learning Studio provides default names.

You can explicitly specify or change the headings and data types for columns using the Edit Metadata.

The following data types are recognized by Machine Learning Studio:

  • String
  • Integer
  • Double
  • Boolean
  • DateTime
  • TimeSpan

Machine Learning Studio uses an internal data type called Data Table to pass data between modules. You can explicitly convert your data into Data Table format using the Convert to Dataset module.

Any module that accepts formats other than Data Table will convert the data to Data Table silently before passing it to the next module.

If necessary, you can convert Data Table format back into CSV, TSV, ARFF, or SVMLight format using other conversion modules. Look in the Data Format Conversions section of the module palette for modules that perform these functions.