Deployment templates for data management and analytics scenario

The data management and analytics scenario has the following core starter templates:

Repository Content Required Deployment model
Data management template Central data management services and shared data services, such as data catalog and self-hosted integration runtime Yes One per data management and analytics scenario
Data landing zone template Data landing zone shared services, such as data storage, ingestion services, and management services Yes One per data landing zone
Data integration template - batch processing Additional services required for batch data processing No One or more per data landing zone
Data integration template - stream processing Additional services required for processing data streams No One or more per data landing zone
Data product template - analytics and data science Additional services required for data analytics and AI No One or more per data landing zone

These templates contain not only Azure Resource Manager templates and their parameter files, but also CI/CD pipeline definitions for resource deployment.

The templates can change over time because of new Azure services and requirements. Secure the main branch of these repositories to ensure that it remains error-free and ready for consumption and deployment. Use a development subscription to test template configuration changes before you merge feature enhancements back into the main branch.

Cost estimates

We have provided links to the official cost calculator, where users can make changes depending on the expected amount of data and data throughput. All cost calculations specify a base cost of data management and analytics for Cloud Adoption Framework for Azure. Base cost can be defined as the cost that occurs if no data workloads run inside the respective subscriptions.

Data management landing zone costs

In a production scenario, we recommend that you rely on the Azure Firewall and private DNS zones that are hosted in the connectivity hub of Azure landing zones. In minimal viable products, you can rely on the Azure Firewall and private DNS zones that are bundled with Cloud Adoption Framework data management and analytics. Therefore, we provide the following two different cost calculations:

Keep in mind that the following services are not listed in the overview, because they are either not available in the official pricing calculator or the pricing calculator does not allow you to set the compute hours to 0:

  • Azure Purview
  • Synapse Private Link hub
  • Route table
  • Network security group

Data landing zone costs

For data landing zones, refer to the following cost calculation:

You can further reduce the cost by hosting the self-hosted integration runtime (SHIR) on-premises instead of hosting it on a virtual machine scale set.

Keep in mind that the following services are not listed in the overview, because they're either unavailable in the official pricing calculator or the pricing calculator doesn't allow you to set the compute hours to 0:

  • Azure Databricks
  • Route table
  • Network security group

Next steps

Learn about Azure policies for data management and analytics scenario.