while using ASR getting 429 errors with custom endpoints

Mallu Swetha (MINDTREE LIMITED) 80 Microsoft Vendor

1.While using ASR with custom endpoints getting 429 errors (many requests). If we request too many calls, it will get these 429 errors. Could you please share the document on this. Is it same for public endpoints? if it is different from custom endpoints, please share the document on this.

2.How does the scheduling of requests take place? What is the pattern that we should expect?

Thank you in advance.

romungi-MSFT 42,191 Reputation points Microsoft Employee

2024-04-02T08:53:19.4233333+00:00

@Mallu Swetha (MINDTREE LIMITED) The limit for concurrent requests is 100 for custom endpoints. You can refer the quotas and limits page for reference. As per the same page,

Suppose that your application receives response code 429, which indicates that there are too many requests. Your application receives this response even though your workload is within the limits defined by the Quotas and limits reference. The most likely explanation is that Speech service is scaling up to your demand and didn't reach the required scale yet. Therefore, the service doesn't immediately have enough resources to serve the request. In most cases, this throttled state is transient.
romungi-MSFT 42,191 Reputation points Microsoft Employee

2024-04-18T10:12:51.7033333+00:00

@Mallu Swetha (MINDTREE LIMITED) Did you get a chance to check if the quota limit was causing this error your requests? Thanks!!