question

simonjaeggi avatar image
0 Votes"
simonjaeggi asked CyrAz commented

SCOM SQL Server 100% CPU Utilization after MP Import

Hi everyone
I imported the new SQL MPs into our old SCOM 2012 env last week. Since the night after the import, the CPU Utilization on our SCOM SQL Server is pretty much at 100% every day between 3/3:30 AM to 12 AM. After 12 it drops down to a normal utilization until about 3 AM when it starts again.

I first assumed it was just the discoveries running through all the objects we keep in our SCOM env. After a couple of days of waiting that can be ruled out.
The Admin responsible for SQL hosting sent me the query that is creating the load. I will attach it as a reference.

Since the query looked like some generic list to me, I thought it might be a management console or a server that got stuck on some loop.
To rule this out, the servers were rebooted. The SQL instances were restarted as well.

Now im a bit at a loss what to look at. I assume the problem originates from the new MPs. However, I don't know, how I might pin down what component of the MP is causing the problem. If I cant find anything else, I will have to delete the MPs again, which would need a approved change ticket, since it targets multiple productive systems.

Does anyone have a lead on this?

In case someone is wondering, here is a list of all the imported MPs:
71114-image.png

Additionally, I created a new override MP, which contains a override for the SQL discovery, preventing 2012, 2014 and 2016 SQL instances getting discovered by the new SQL MPs.

Thank you for any hint.
Regards
Simon

sql-server-generalmsc-operations-manager
image.png (33.1 KiB)
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Here is the query from the sql admin:
71095-new-18.txt


0 Votes 0 ·
new-18.txt (2.8 KiB)

1 Answer

CyrAz avatar image
0 Votes"
CyrAz answered CyrAz commented

Two things :
- Discoveries won't stop running after "a couple of days", they run on a regular scheduled basis to find out if anything changed in your environment
- That query doesn't look like it's related to a Discovery but more like something that could be happening "under the hood" when a State View is opened, and there is nothing that indicates it is specifically related to the SQL MP (but the opposite is true as well, nothing indicates it doesn't come from the SQL MP). Could you ask your SQL admin if he is able to find more infos that could help narrow down the issue? Or maybe you could try to correlate that to any relevant event in the operationsmanager event log in the management servers?

· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

I have asked the sql admin. He says he cant find anything else. Additionally I checked the eventlog on one of the management servers. there seem to be some problems with discovery data, however nothing that i would believe to be relevant to this issue:

Discovery data couldn't be inserted to the database. This could have happened because of one of the following reasons:

   - Discovery data is stale. The discovery data is generated by an MP recently deleted.
   - Database connectivity problems or database running out of space.
   - Discovery data received is not valid.

The following details should help to further diagnose:

DiscoveryId: 67e545d3-505c-2d7c-0d29-7097d0adb657
HealthServiceId:
Microsoft.Windows.Server.DNS.Zone.IsSigned
Regel-ID: 67e545d3-505c-2d7c-0d29-7097d0adb657

Funnily enough, I cant get the rule with "get-scomrule -id" (returns null). Other than that, the eventlog looks fine.

0 Votes 0 ·

It's a discovery so that would be Get-SCOMDiscovery -Id

However I don't believe that's related to your issue...

0 Votes 0 ·