How to use the Common Data Model
With the Common Data Model, you can put your data into formats that represent concepts and activities that are commonly used and well understood. That way, you can query that data, reuse it, and interoperate with other businesses and apps that use the same format. This strategy matches that of, for example, manufacturers who produce AA batteries that fit in most remote controls. The Common Data Model defines the size and shape of a Contact, for example, so that your app developers and business partners can parse that data and build your apps (or interoperate) with agility and confidence. The Common Data Model is an open-source definition of standard entities and a metadata system that enable consistency of data and its meaning across apps and business processes.
Today, the Common Data Model is used within Common Data Service, which supports Dynamics 365, PowerApps, and the data-preparation capabilities in Power BI dataflows to create schematized files in Azure Data Lake. The Common Data Model definitions are open and available to any service or application that wants to use them.
You can use the Common Data Model in multiple applications and platforms:
Bring your data together in Common Data Service: You can use Common Data Service to bring your data together in the standardized format of the Common Data Model and quickly create powerful apps. The data can then be managed in Microsoft apps and services such as Dynamics 365, PowerApps, Microsoft Flow, Power BI, or your own custom apps.
Extend Common Data Model standard entities: The Common Data Model is extensible, so you can extend existing entities or create entities that are specific to your organization. These entities can relate back to the Common Data Model standard entities so that your app can more easily leverage the full power of the platform.
Create your own repositories of data with Azure Data Lake Storage Gen2: You can build repositories of data that adhere to the schema of the Common Data Model, and you can connect to those data sources by using Microsoft data connectors. Then you can build custom, line-of-business apps that use or share your data in the Common Data Model, regardless of where the data originated or resides.
Quickly derive and distribute insights using Power BI: You can use advanced data-preparation services with Power BI dataflows to load data into Common Data Model form, including templates that map into Common Data Model standard entities. Then you can create report-generating apps that automatically pull your data from the Common Data Model into customized insights for individuals and groups in your organization.
Microsoft continues to extend the Common Data Model in concert with many partners and subject-matter experts so that more industries, such as healthcare, can benefit from the Common Data Model and the platforms that support it.
Data integration and Power Query Online
Both platforms that currently support the Common Data Model also offer data-integration experiences through Power Query Online that allow users to bring in data from a variety of sources, transform it if necessary, and then map it to standard entities in the Common Data Model or create custom entities. Power Query Online leverages the same visual, self-service data-prep experience as Power Query within Excel and Power BI Desktop, so existing users can ramp up quickly.
Common Data Service
By using Common Data Service, you can jumpstart apps using the Common Data Model with business logic, security, and integration already built in. The platform provides these benefits:
Leverage packaged business applications: Many Microsoft Dynamics solutions and third-party apps are built on top of (or at least leverage) Common Data Service. When your data is in the Common Data Model, you can take advantage of those packaged applications.
Gain access to customized solutions: Developers who understand and work with data in the Common Data Model format have created an ecosystem of extensions and complete apps. For more information, see Introduction to solutions.
Whatever your intent, the Common Data Model puts your data into a common format so that you can use, share, and analyze it more easily.
Resources for Common Data Service
- What is Common Data Service?
- Add data to an entity in Common Data Service by using Power Query
- Introduction to solutions
- Build a model-driven app
- Build a canvas app
- Create a flow that uses Common Data Service
Power BI Dataflows
You can use the dataflows feature of Power BI to ingest data into the Common Data Model form from Dynamics 365, Salesforce, Azure SQL Database, Excel, SharePoint, or another source. You create and manage dataflows in app workspaces by using the Power BI service. Once you've connected and prepared your data, you can choose to map it to a Common Data Model standard entity or load it as a custom entity in the Common Data Model form in Azure Data Lake Storage Gen2.
The dataflows functionality is in preview and subject to change and updates prior to general availability.
Similar to how spreadsheets handle recalculations for all affected formulas, dataflows manage changes for an entity or data element on your behalf, automating updates, and alleviating what used to be tedious and time-consuming logic checks for even a basic data refresh. With dataflows and a few clicks, analysts and report creators can handle tasks that once required data scientists to oversee (and many hours or days to complete).
Organizations can incorporate dataflows in these ways, among others, to suit their needs:
- Customize standard entities and create their own.
- Create dataflows programmatically with custom definition files (model.json).
- Leverage powerful Azure products such as Azure Machine Learning, Azure Databricks, and Azure Data Factory.
- Add CSV data from Azure Blob storage.
- Enjoy more storage, more frequent refreshes, incremental refresh, and computed and linked entities with Power BI Premium.
Resources for Power BI
- Self-service data prep in Power BI
- Creating and using dataflows in Power BI
- Connect to data created by Power BI dataflows in Power BI Desktop
- Developer resources for Power BI dataflows
The Common Data Model and Microsoft Azure Data Lake Storage Gen2
Azure Data Lake Storage Gen2 is designed specifically for enterprises to run large-scale analytics workloads in the cloud. A wide variety of applications and services can easily access data in this format, but each consumer must understand the meaning of the data before it can provide value. The Common Data Model simplifies this process by providing a metadata system that describes the data and standard entites to which producers can map. More information: Azure Data Lake Storage Gen2.
Resources for the Common Data Model and Azure Data Lake Storage Gen2