question

TapasKumarBarik-2241 avatar image
0 Votes"
TapasKumarBarik-2241 asked ·

Why number of node increases in Kusto cluster

if number of nodes are suddenly increase 34 to 41 , memory also shows increase 90%. CPU utilization nearly above 25% How all of sudden number node increases in kusto cluser, how to find the reasons

azure-data-explorer
· 1
10 |1000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @TapasKumarBarik-2241,

Thanks for the ask and also for using the Microsoft Q&A forum.

We are reaching out to the internal team to get more help on this, I will update you once we hear back from them.

0 Votes 0 ·

1 Answer

PRADEEPCHEEKATLA-MSFT avatar image
0 Votes"
PRADEEPCHEEKATLA-MSFT answered ·

Hello @TapasKumarBarik-2241,

If the number of nodes changes dynamically it means either Optimized autoscale or Custom autoscale was configured on the cluster.

By using horizontal scaling, you can scale the instance count automatically, based on predefined rules and schedules. To specify the autoscale settings for your cluster:

  1. In the Azure portal, go to your Azure Data Explorer cluster resource. Under Settings, select Scale out.

  2. In the Scale out window, select the autoscale method that you want: Manual scale, Optimized autoscale, or Custom autoscale.

You can find more details on the logic for scale out here - Manage cluster horizontal scaling (scale out) in Azure Data Explorer to accommodate changing demand.

Hope this helps. Do let us know if you any further queries.


Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.


· 7 ·
10 |1000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @TapasKumarBarik-2241,

Just checking in to see if the above answer helped. If this answers your query, do click Accept Answer and Up-Vote for the same. And, if you have any further query do let us know.

0 Votes 0 ·

Can we find through Kusto query reason for increase in numbers of node count ?

0 Votes 0 ·

I know auto scaling features is enabled in cluster.

My queries was , how to find out why number of nodes count increases where memory utlization more than 90% and CPU somewhere near to 25%

Are there any link/docs to find parameters for increase in node count ?

0 Votes 0 ·

Hello @TapasKumarBarik-2241,

In order to investigate further, could you please share the screenshot of the Scale out settings? If you are using Custom autoscale, please do share the rule to scale out?

For immediate assistance with cluster-scaling issues, open a support request in the Azure portal.


0 Votes 0 ·
Show more comments

Attached here the screenshot .

It is mentioned here in screenshot that node count increases from 34-41 b/t 24 Feb-02 Mar 21. Where memory utilization was more than 90% and CPU utlization below 50% .

Want to know why there was increase in node & spike in memory ?

77883-machine-state.png77902-memory-capacity.png77846-cpu-capacity.png77903-ingestion-capacity.png


0 Votes 0 ·
machine-state.png (108.0 KiB)
memory-capacity.png (510.1 KiB)
cpu-capacity.png (639.7 KiB)

Hello @TapasKumarBarik-2241,

Could you confirm the scaling type which you have selected: Optimized autoscale, or Custom autoscale?

If it is autoscale, please do share the rule configured?


0 Votes 0 ·