AKS - Rest API calls response time is very high

Question

Hi Team,

My application has multiple environments , Dev environment AKS Cluster Rest API's are responding in milliseconds. But in case QA environment AKS Cluster Rest API Calls are responding in minutes.

There is no difference in AKS Configuration Dev vs QA. Please let me know the what could be appropriate steps that can be done to improve the response time.

Answer 1

Hello Boddu, Naga

Welcome to microsoft Q&A, Thankyou for posting your query here.

Use Kubernetes metrics 'kubectl top nodes' and 'kubectl top pods' to check if there's higher resource usage in QA which might be causing throttling or resource contention.

Check if there’s a difference in disk type or performance settings between environments.

Tools like 'traceroute' or 'ping' can help identify network delays.

Check environment-specific configurations that might differ, such as database connection settings or external APIs.

Check pod logs, event logs and any application-specific logging for errors or warnings that occur only in QA.

Conduct load testing in both environments to compare how each handles traffic.

Differences in performance under load can helps finding configuration or resource issues.

Check if the pod distribution across nodes is similar in both environments to avoid uneven load distribution

If your application depends on databases, check the performance and configuration of your database servers in QA.

Slow database responses can significantly affect application performance.

If an answer has been helpful, please consider accepting the answer to help increase visibility of this question for other members of the Microsoft Q&A community. If not, please let us know what is still needed in the comments so the question can be answered. Thank you for helping to improve Microsoft Q&A!