How to use the Common Data Model
With the Common Data Model (CDM), you can put your data into formats that represent concepts and activities that are commonly used and well understood. That way, you can query that data, reuse it, and interoperate with other businesses and apps that use the same format. This strategy matches that of, for example, manufacturers who produce AA batteries that fit in most remote controls. The CDM defines the size and shape of a Contact, for example, so that your app developers and business partners can parse that data and build your apps (or interoperate) with agility and confidence. The CDM is an open-source definition of standard entities and a metadata system that enable consistency of data and its meaning across apps and business processes.
Today, the CDM is used within Common Data Service (CDS) for Apps, which supports Dynamics 365, PowerApps, and the data-preparation capabilities in Power BI dataflows to create schematized files in Azure Data Lake. The CDM definitions are open and available to any service or application that wants to use them.
You can use the CDM in multiple applications and platforms:
Bring your data together in CDS for Apps: You can use CDS for Apps to bring your data together in the standardized format of the CDM and quickly create powerful apps. The data can then be managed in Microsoft apps and services such as Dynamics 365, PowerApps, Microsoft Flow, Power BI, or your own custom apps.
Extend CDM standard entities: The CDM is extensible, so you can extend existing entities or create entities that are specific to your organization. These entities can relate back to the CDM standard entities so that your app can more easily leverage the full power of the platform.
Create your own repositories of data with Azure Data Lake Storage Gen2 (Preview): You can build repositories of data that adhere to the schema of the CDM, and you can connect to those data sources by using Microsoft data connectors. Then you can build custom, line-of-business apps that use or share your data in the CDM, regardless of where the data originated or resides.
Quickly derive and distribute insights using Power BI: You can use advanced data-preparation services with Power BI dataflows to load data into CDM form, including templates that map into CDM standard entities. Then you can create report-generating apps that automatically pull your data from the CDM into customized insights for individuals and groups in your organization.
Microsoft continues to extend the CDM in concert with many partners and subject-matter experts so that more industries, such as healthcare, can benefit from the CDM and the platforms that support it.
Data integration and Power Query Online
Both platforms that currently support the CDM also offer data-integration experiences through Power Query Online that allow users to bring in data from a variety of sources, transform it if necessary, and then map it to standard entities in the CDM or create custom entities. Power Query Online leverages the same visual, self-service data-prep experience as Power Query within Excel and Power BI Desktop, so existing users can ramp up quickly.
Common Data Service for Apps
By using CDS for Apps, you can jumpstart apps using the CDM with business logic, security, and integration already built in. The platform provides these benefits:
Leverage packaged business applications: Many Microsoft Dynamics solutions and third-party apps are built on top of (or at least leverage) CDS for Apps. When your data is in the CDM, you can take advantage of those packaged applications.
Gain access to customized solutions: Developers who understand and work with data in the CDM format have created an ecosystem of extensions and complete apps. For more information, see Introduction to solutions.
Whatever your intent, the CDM puts your data into a common format so that you can use, share, and analyze it more easily.
Resources for CDS for Apps
- What is CDS for Apps?
- Add data to an entity in CDS for Apps by using Power Query
- Introduction to solutions
- Build a model-driven app
- Build a canvas app
- Create a flow that uses CDS for Apps
Power BI Dataflows
You can use the dataflows feature of Power BI to ingest data into the CDM form from Dynamics 365, Salesforce, Azure SQL Database, Excel, SharePoint, or another source. You create and manage dataflows in app workspaces by using the Power BI service. Once you've connected and prepared your data, you can choose to map it to a CDM standard entity or load it as a custom entity in CDM form in Azure Data Lake Storage Gen2.
The dataflows functionality is in preview, and is subject to change and updates prior to general availability.
Similar to how spreadsheets handle recalculations for all affected formulas, dataflows manage changes for an entity or data element on your behalf, automating updates, and alleviating what used to be tedious and time-consuming logic checks for even a basic data refresh. With dataflows and a few clicks, analysts and report creators can handle tasks that once required data scientists to oversee (and many hours or days to complete).
Organizations can incorporate dataflows in these ways, among others, to suit their needs:
- Customize standard entities and create their own.
- Create dataflows programmatically with custom definition files (model.json).
- Leverage powerful Azure products such as Azure Machine Learning, Azure Databricks, and Azure Data Factory.
- Add CSV data from Azure Blob storage.
- Enjoy more storage, more frequent refreshes, incremental refresh, and computed and linked entities with Power BI Premium.
Resources for Power BI
- Self-service data prep in Power BI
- Creating and using dataflows in Power BI
- Connect to data created by Power BI dataflows in Power BI Desktop
- Developer resources for Power BI dataflows
The Common Data Model and Microsoft Azure Data Lake Storage Gen2 (Preview)
Azure Data Lake Storage Gen2 (Preview) is designed specifically for enterprises to run large-scale analytics workloads in the cloud. A wide variety of applications and services can easily access data in this format, but each consumer must understand the meaning of the data before it can provide value. The CDM simplifies this process by providing a metadata system that describes the data and standard entites to which producers can map. More information: CDM and Azure Data Lake Storage Gen2 (Preview).