Test Results: BizTalk Server Key Performance Indicators

This topic summarizes BizTalk Server Key Performance Indicators (KPI) observed during the test scenarios. Specifically these tests evaluated throughput as measured by the "BizTalk:Messaging/Documents processed/Sec" performance monitor counter, and latency, as measured by the Visual studio client response time.

Summary of BizTalk Server Key Performance Indicators

For each scenario the physical machines were restricted so that number of logical processors and virtual processors was equivalent. This was done using the /maxmem and /numproc boot.ini switches. For more information about using these switches, see “Boot INI Options Reference” at http://go.microsoft.com/fwlink/?LinkId=122139.

Comparison of BizTalk Server Key Performance Indicators – Running BizTalk Server on a Hyper-V virtual machine provided approximately 95% of the throughput and latency performance of BizTalk Server on physical hardware for this test scenario. Because of the stateless nature of BizTalk Server, additional BizTalk Server virtual machines can be easily added to the environment as required to provide scale out and increase the overall performance of the system. Creating and adding additional BizTalk Server to the environment can be accomplished by using the sysprep utility to generate new images from a base image.

Note

A sysprep answer file and scripts are provided with BizTalk Server to accommodate using sysprep to create additional images from an existing image of a computer that has BizTalk Server installed. These sample scripts are designed for use with BizTalk Server installed on 32-bit and 64-bit versions of Windows Server 2008 only. For more information see the BizTalk Server online documentation.

Provisioning, consolidation, and management of virtual machines can be significantly expedited through the use of System Center Virtual Machine Manager (VMM). For more information about System Center Virtual Machine Manager, see http://go.microsoft.com/fwlink/?LinkID=111303

The results obtained in this performance lab show a marked improvement from the performance achieved when running BizTalk Server 2006 R2 on Windows Server 2003 in a Hyper-V virtual machine. Running BizTalk Server 2006 R2 on a Hyper-V virtual machine provided approximately 75% of the throughput and latency performance of BizTalk Server 2006 R2 on physical hardware versus the approximately 95% performance observed when running BizTalk Server and Windows Server 2008 SP2 on Hyper-V virtual machines. This improved performance is largely attributable to the improved performance of Windows Server 2008 SP2 when running as a guest operating system on Hyper-V. The related performance comparison from the BizTalk Server 2006 R2 Hyper-V guide is available at http://go.microsoft.com/fwlink/?LinkId=147144.

The graphic below illustrates the performance of BizTalk Server on the various test platforms:

BizTalk Key Performance Indicators

The table below illustrates the relative performance of the collected KPI’s for each configuration. Each result set is calculated as a percentage of the Baseline configuration KPI.

KPI Virtual BizTalk/Physical SQL Virtual BizTalk/Virtual SQL on separate Hosts Virtual BizTalk/Virtual SQL on Consolidated environment
\BizTalk:Messaging\Documents processed/Sec 94.3% 79.8% 67%
Latency as measured by the Visual Studio client 94.3% 79.7% 66.9%

For more information about how to optimize the performance of a BizTalk Server solution, see the BizTalk Server Performance Optimizations Guide available at http://go.microsoft.com/fwlink/?LinkId=122477.

Performance Comparison Results Summary

The 94.3% throughput and 94.3% latency achieved when running only BizTalk Server on Hyper-V suggests that virtualizing this tier of your solution using Hyper-V provides excellent performance together with the provisioning, consolidation, flexibility and ease of management that are possible when deploying solutions to a Hyper-V environment.

Throughput Comparison Sample Results

When the BizTalk Server computers used in the BizTalk Server environment were run on Hyper-V virtual machines, throughput of the BizTalk Server solution as measured by the "BizTalk:Messaging/Documents processed/Sec" performance monitor counter ranged from 67% to 94.3% of the throughput attainable when all of the computers used in the BizTalk Server environment were installed on physical hardware.

Latency Comparison Sample Results

When the BizTalk Server computers used in the BizTalk Server environment were run on Hyper-V virtual machines, latency of the BizTalk Server solution as measured by the Visual Studio client response time ranged from 66.9% to 94.3% of the latency attainable when all of the computers used in the BizTalk Server environment were installed on physical hardware.