What is one-click ingestion?

One-click ingestion makes the data ingestion process easy, fast, and intuitive. One-click ingestion helps you ramp-up quickly to start ingesting data, creating database tables, mapping structures. Select data from different kinds of sources in different data formats, either as a one-time or continuous ingestion process.

The following features make one-click ingestion so useful:

  • Intuitive experience guided by the ingestion wizard
  • Ingest data in a matter of minutes
  • Ingest data from different kinds of sources: local file, blobs, and containers (up to 10,000 blobs)
  • Ingest data in a variety of formats
  • Ingest data into new or existing tables
  • Table mapping and schema is suggested to you and easy to change
  • Continue ingestion easily and quickly from a container with Event Grid

One-click ingestion is particularly useful when ingesting data for the first time, or when your data's schema is unfamiliar to you.

Prerequisites

Access the one-click wizard

The one-click ingestion wizard guides you through the one-click ingestion process.

  • To access the one-click ingestion wizard from the Welcome to Azure Data Explorer home screen in your cluster, complete the first two steps (cluster creation and database creation) and then select Ingest new data.

    Ingest new data from welcome to Azure Data Explorer

  • To access the wizard from the Azure Data Explorer web UI, right-click the database or table row in the left menu of the Azure Data Explorer web UI and select Ingest new data (preview).

    Select one-click ingestion in the web UI

  • To access the wizard from the Azure portal, select Query from the left menu, right click on the database or table, and select Ingest new data (preview).

    Access the one click ingestion wizard from Azure portal

One-click ingestion wizard

Note

This section describes the wizard in general. The options you select depend on what data format you are ingesting, what kind of data source you are ingesting from, and whether you are ingesting into a new or existing table.

For sample scenarios, see:

The wizard guides you through the following options:

Schema mapping

The service automatically generates schema and ingestion properties, which you can change. You can use an existing mapping structure or create a new one, depending on if you're ingesting to a new or existing table.

In the Schema tab, do the following actions:

  • Confirm the autogenerated compression type.
  • Choose the format of your data. Different formats will allow you to make further changes.

File formats

One-click ingestion supports ingesting a new table from source data in any of the following formats:

  • JSON
  • CSV
  • TSV
  • SCSV
  • SOHSV
  • TSVE
  • PSV

Editor window

In the Editor window, you can adjust data table columns as necessary.

Table type Available column adjustments
New New column, Delete column, Sort ascending, Sort descending
Existing New column, Sort ascending, Sort descending

Note

At any time, you can open the command editor above the Editor pane. In the command editor, you can view and copy the automatic commands generated from your inputs.

Data ingestion

Once you have completed schema mapping and column manipulations, the ingestion wizard will start the data ingestion process.

  • When ingesting data from non-container sources, the ingestion will take immediate effect.

  • If your data source is a container:

    • Azure Data Explorer's batching policy will aggregate your data.
    • After ingestion, you can download the ingestion report and review the performance of each blob that was addressed.
    • You can select Create continuous ingestion and set up continuous ingestion using Event Grid.

Initial data exploration

After ingestion, the wizard gives you options to use Quick commands for initial exploration of your data.

Next steps