What are SQL Database instance pools (preview)?
Instance pools are a new resource in Azure SQL Database that provides a convenient and cost-efficient way to migrate smaller SQL instances to the cloud at scale.
Instance pools allow you to pre-provision compute resources according to your total migration requirements. You can then deploy several individual managed instances up to your pre-provisioned compute level. For example, if you pre-provision 8 vCores you can deploy two 2 vCore and one 4 vCore instances, and then migrate databases into these instances. Prior to instance pools being available, smaller and less compute-intensive workloads would often have to be consolidated into a larger managed instance when migrating to the cloud. The need to migrate groups of databases to a large instance typically required careful capacity planning and resource governance, additional security considerations, and some extra data consolidation work at the instance level.
Additionally, instance pools support native VNet integration so you can deploy multiple instance pools and multiple single instances in the same subnet.
Key capabilities of instance pools
Instance pools provide the following benefits:
- Ability to host 2 vCore instances. *Only for instances in instance pools.
- Predictable and fast instance deployment time (up to 5 minutes).
- Minimal IP address allocation.
The following diagram illustrates an instance pool with multiple instances deployed within a virtual network subnet.
Instance pools enable deployment of multiple instances on the same virtual machine where the virtual machine's compute size is based on the total number of vCores allocated for the pool. This architecture allows partitioning of the virtual machine into multiple instances, which can be any supported size, including 2 vCores (2 vCore instances are only available for instances in pools).
Management operations on instances in a pool are much faster once the pool is initially deployed. These operations are faster because deployment or extension of a virtual cluster (dedicated set of virtual machines) is not part of provisioning the managed instance.
Because all instances in a pool share the same virtual machine, the total IP allocation does not depend on the number of instances deployed, which is convenient for deployment in subnets with a narrow IP range.
Each pool has a fixed IP allocation of only nine IP addresses (not including the five IP addresses in the subnet that are reserved for its own needs). For details, see subnet size requirements for single instances.
Application scenarios for instance pools
The following list provides the main use cases where instance pools should be considered:
- Migration of a group of SQL instances at the same time, where the majority is a smaller size (for example 2 or 4 vCores).
- Scenarios where predictable and short instance creation or scaling is important. For example, deployment of a new tenant in a multi-tenant SaaS application environment that requires instance-level capabilities.
- Scenarios where having a fixed cost or spending limit is important. For example, running shared dev-test or demo environments of a fixed (or infrequently changing) size, where you periodically deploy managed instances when needed.
- Scenarios where minimal IP address allocation in a VNet subnet is important. All instances in a pool are sharing a virtual machine, so the number of allocated IP addresses is lower than in the case of single instances.
Architecture of instance pools
Instance pools have similar architecture to regular managed instances (single instances). To support deployments within Azure Virtual Networks (VNets) and to provide isolation and security for customers, instance pools also rely on virtual clusters. Virtual clusters represent a dedicated set of isolated virtual machines deployed inside the customer's virtual network subnet.
The main difference between the two deployment models is that instance pools allow multiple SQL Server process deployments on the same virtual machine node, which are resource governed using Windows Job Objects, while single instances are always alone on a virtual machine node.
The following diagram shows an instance pool and two individual instances deployed in the same subnet and illustrates the main architectural details for both deployment models:
Every instance pool creates a separate virtual cluster underneath. Instances within a pool and single instances deployed in the same subnet do not share compute resources allocated to SQL Server processes and gateway components, this ensures performance predictability.
Instance pools resource limitations
There are several resource limitations regarding instance pools and instances inside pools:
- Instance pools are available only on Gen5 hardware.
- Instances within a pool have dedicated CPU and RAM, so the aggregated number of vCores across all instances must be less than or equal to the number of vCores allocated to the pool.
- All instance level limits apply to instances created within a pool.
- In addition to instance-level limits there are also two limits imposed at the instance pool level:
- Total storage size per pool (8 TB).
- Total number of databases per pool (100).
Total storage allocation and number of databases across all instances must be lower or equal to the limits exposed by instance pools.
- Instance pools support 8, 16, 24, 32, 40, 64, and 80 vCores.
- Managed instances inside pools support 2, 4, 8, 16, 24, 32, 40, 64 and 80 vCores.
- Managed instances inside pools support storage sizes between 32 GB and 8 TB, except:
- 2 vCore instances support sizes between 32 GB and 640 GB
- 4 vCore instances support sizes between 32 GB and 2 TB
The service tier property is associated with the instance pool resource so all instances in a pool must be the same service tier as the service tier of the pool. At this time, only the General Purpose service tier is available (see the following section on limitations in the current preview).
Public preview limitations
The public preview has the following limitations:
- Currently, only the General Purpose service tier is available.
- Instance pools cannot be scaled during the public preview so careful capacity planning before deployment is important.
- Azure portal support for instance pool creation and configuration is not yet available. All operations on instance pools are supported through PowerShell only. Initial instance deployment in a pre-created pool is also supported through PowerShell only. Once deployed into a pool, managed instances can be update using the Azure portal.
- Managed instances created outside of the pool cannot be moved into an existing pool and instances created inside a pool cannot be moved outside as a single instance or to another pool.
- Reserved instance pricing (license included or with Azure Hybrid Benefit) is not available.
SQL features supported
Instances created in pools support the same compatibility levels and features supported in single managed instances.
Every managed instance deployed in a pool has a separate instance of SQL Agent.
Optional features or features that require you to choose specific values (such as instance-level collation, time zone, public endpoint for data traffic, failover groups) are configured at instance level and can be different for each instance in a pool.
Although managed instances within pools do have dedicated vCore and RAM, they share local disk (for tempdb usage) and network resources. It's not likely, but it is possible to experience the noisy neighbor effect if multiple instances in the pool have high resource consumption at the same time. If you observe this behavior, consider deploying these instances to a bigger pool or as single instances.
Because instances deployed in a pool share the same virtual machine, you may want to consider disabling features that introduce higher security risks, or to firmly control access permissions to these features. For example, CLR integration, native backup and restore, database email, etc.
Instance pool support requests
Create and manage support requests for instance pools in the Azure portal.
If you are experiencing issues related to instance pool deployment (creation or deletion), make sure that you specify Instance Pools in the Problem subtype field.
If you are experiencing issues related to single instances or databases within a pool, you should create a regular support ticket for Azure SQL Database managed instances.
To create larger managed instance deployments (with or without instance pools), you may need to obtain a larger regional quota. Use the standard managed instance procedure for requesting a larger quota, but note that if you are using instance pools, the deployment logic compares total vCore consumption at the pool level against your quota to determine whether you are allowed to create new resources without further increasing your quota.
Instance pool billing
Instance pools allow scaling compute and storage independently. Customers pay for compute associated with the pool resource measured in vCores, and storage associated with every instance measured in gigabytes (the first 32 GB are free of charge for every instance).
vCore price for a pool is charged regardless of how many instances are deployed in that pool.
For the Compute price (measured in vCores), two pricing options are available:
- License included: Apply existing SQL Server licenses with Software Assurance.
- Azure Hybrid Benefit: A reduced price that includes Azure Hybrid Benefit for SQL Server. Customers can opt into this price by using their existing SQL Server licenses with Software Assurance. For eligibility and other details, see Azure Hybrid Benefit.
Setting different pricing options is not possible for individual instances in a pool. All instances in the parent pool must be either at License Included price or Azure Hybrid Benefit price. The license model for the pool can be altered after the pool is created.
If you specify a License Model for the instance that is different than in the pool, the pool price is used and the instance level value is ignored.
If you create instance pools on subscriptions eligible for dev-test benefit, you automatically receive discounted rates of up to 55 percent on Azure SQL managed instance.
For full details on instance pool pricing, refer to the instance pools section on the managed instance pricing page.
- To get started with instance pools, see SQL Database instance pools how-to guide.
- To learn how to create your first managed instance, see Quickstart guide.
- For a features and comparison list, see SQL common features.
- For more information about VNet configuration, see managed instance VNet configuration.
- For a quickstart that creates a managed instance and restores a database from a backup file, see create a managed instance.
- For a tutorial using the Azure Database Migration Service (DMS) for migration, see managed instance migration using DMS.
- For advanced monitoring of managed instance database performance with built-in troubleshooting intelligence, see Monitor Azure SQL Database using Azure SQL Analytics.
- For pricing information, see SQL Database managed instance pricing.