question

ShreyasArani-1167 avatar image
0 Votes"
ShreyasArani-1167 asked ShreyasArani-1167 commented

When starting the AKS cluster one of the node has high memory consumption

Hi we have AKS cluster with 4 nodes. And one of the node is tainted to schedule specific pods. we are starting and stopping our AKS cluster daily because of budget constraint. We observed that when we start our AKS cluster one of the node is consuming high memory say between 95% to 103% by the way we are using Standard D4s v3 (4 vcpus, 16 GiB memory) for each of the node. The reason why there is high memory utilization is because most of the pods are trying to get scheduled on that node rather than other two nodes. Note: we cannot deploy any other pods on the 4th node because it is tained. we have around 126 pods including the system pods. And we have around 9 pods in the tained node including system pods so this 9 pods will be fixed and will be scheduled on the 4th node. So the rest 117 pods which includes system pods should be scheduled on the remaining three nodes. So is there a way when we start the cluster the 117 pods can be distributed evenly among the other 3 nodes?

So that one particular node doesn't face the memory pressure.

@srbose-msft any idea on this?

azure-kubernetes-service
· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@ShreyasArani-1167 , thank you for the question. When you say

117 pods can be distributed evenly among the other 3 nodes

What is the parameter based on which you want uniform distribution? Is it pods per node or memory utilization per node or CPU utilization per node or something else that you have in mind?

0 Votes 0 ·

Hi @srbose-msft thanks for the reply. Here I am interested in the uniform distribution of pods across the 3 nodes.

0 Votes 0 ·

Hi @srbose-msft looking forward for your reply please help to resolve the issue as it is affecting the node performance.

0 Votes 0 ·

0 Answers