Data sources overview

Note

Effective November 2020:

  • Common Data Service has been renamed to Microsoft Dataverse. Learn more
  • Some terminology in Microsoft Dataverse has been updated. For example, entity is now table and field is now column. Learn more

This article will be updated soon to reflect the latest terminology.

The audience insights capability in Dynamics 365 Customer Insights connects to data from a broad set of sources. Connecting to a data source is often referred to as the process of data ingestion. After ingesting the data, you can unify and take action on it.

Add a data source

Refer to the detailed articles on how to add a data source, depending on which option you choose.

You can add a data source in three main ways:

Add data from on-premises data sources

Ingesting data from on-premises data sources in audience insights is supported based on Microsoft Power Platform dataflows. Dataflows can be enabled in Customer Insights by providing the Microsoft Dataverse environment URL when setting up the environment.

Data sources that are created after associating a Dataverse environment with Customer Insights will use Power Platform dataflows by default. Dataflows support on-premises connectivity using the data gateway. Remove and recreate data sources that existed before a Dataverse environment was associated to use the on-premises data gateways.

Data gateways from an existing Power BI or Power Apps environment will be visible and you can reuse in Customer Insights. The data sources page shows links to go to the Microsoft Power Platform environment where you can view and configure on-premises data gateways.

Review ingested data

You'll see the name of each ingested data source, its status, and the last time the data was refreshed for that source. You can sort the list of data sources by every column.

Data source added.

Tip

There are statuses for tasks and processes. Most processes depend on other upstream processes, such as data sources and data profiling refreshes. Select the status to open the Progress details pane and view the progress of the task or process. Then, select the See details link for more progress information, such as processing time, the last processing date, and any applicable errors and warnings associated with the task or process.

Loading data can take time. After a successful refresh, the ingested data can be reviewed from the Entities page. For more information, see Entities.

Refresh a data source

Data sources can be refreshed on an automatic schedule or refreshed manually on demand.

Go to Admin > System > Schedule to configure scheduled refreshes of all your ingested data sources.

To refresh a data source on demand, follow these steps:

  1. In audience insights, go to Data > Data sources.

  2. Select the vertical ellipsis next to the data source you want to refresh and select Refresh from the dropdown list.

  3. The data source is now triggered for a manual refresh. Refreshing a data source will update both the entity schema and data for all the entities specified in the data source.

  4. Select Stop refreshing if you want to cancel an existing refresh and the data source will revert to its last refresh status.

Delete a data source

  1. In audience insights, go to Data > Data sources.

  2. Select the vertical ellipsis next to the data source you want to remove and select Delete from the dropdown menu.

  3. Confirm your deletion.