Request queuing policy (Preview)

A workload group's request queuing policy controls queueing of requests for delayed execution, once a certain threshold of concurrent requests is exceeded.

Queuing of requests can reduce the number of throttling errors during times of peak activity. It does so by queueing incoming requests up to a predefined short time period, while polling for available capacity during that time period.

The policy may be defined only for workload groups with a request rate limit policy that limits the max concurrent requests at the scope of the workload group.

The policy object

The policy includes a single property:

• IsEnabled: A boolean indicating if the policy is enabled. The default value is false.

Control commands

Manage the workload group's request limits policy with Workload groups control commands.