Enable capturing of events streaming through Azure Event Hubs

Azure Event Hubs Capture enables you to automatically deliver the streaming data in Event Hubs to an Azure Blob storage or Azure Data Lake Store account of your choice.

You can configure Capture at the event hub creation time using the Azure portal. You can either capture the data to an Azure Blob storage container, or to an Azure Data Lake Store account.

For more information, see the Event Hubs Capture overview.

Capture data to an Azure Storage account

When you create an event hub, you can enable Capture by clicking the On button in the Create Event Hub portal screen. You then specify a Storage Account and container by clicking Azure Storage in the Capture Provider box. Because Event Hubs Capture uses service-to-service authentication with storage, you do not need to specify a storage connection string. The resource picker selects the resource URI for your storage account automatically. If you use Azure Resource Manager, you must supply this URI explicitly as a string.

The default time window is 5 minutes. The minimum value is 1, the maximum 15. The Size window has a range of 10-500 MB.

Time window for capture


You can enable or disable emitting empty files when no events occur during the Capture window.

Capture data to an Azure Data Lake Store account

To capture data to Azure Data Lake Store, you create a Data Lake Store account, and an event hub:

Create an Azure Data Lake Store account and folders


Currently, the Event Hubs Capture feature supports only Gen 1 of Azure Data Lake Store, not Gen 2.

  1. Create a Data Lake Store Gen 1 account, following the instructions in Get started with Azure Data Lake Store using the Azure portal.
  2. Follow the instructions in the Assign permissions to Event Hubs section to create a folder within the Data Lake Store account in which you want to capture the data from Event Hubs, and assign permissions to Event Hubs so that it can write data into your Data Lake Store account.

Create an event hub

  1. Note that the event hub must be in the same Azure subscription as the Azure Data Lake Store you just created. Create the event hub, clicking the On button under Capture in the Create Event Hub portal page.

  2. In the Create Event Hub portal page, select Azure Data Lake Store from the Capture Provider box.

  3. In Select Data Lake Store, specify the Data Lake Store account you created previously, and in the Data Lake Path field, enter the path to the data folder you created.

    Select Data Lake Storage account

Add or configure Capture on an existing event hub

You can configure Capture on existing event hubs that are in Event Hubs namespaces. To enable Capture on an existing event hub, or to change your Capture settings, click the namespace to load the overview screen, then click the event hub for which you want to enable or change the Capture setting. Finally, click the Capture option on the left side of the open page and then edit the settings, as shown in the following figures:

Azure Blob Storage

Configure Azure Blob Storage

Azure Data Lake Store

Configure Azure Data Lake Storage

Next steps