Why is Application Insights library not collecting all logs on my java spring boot application?

Helms, Benjamin 41

I am running a spring boot application with Java 8 and log4j.

I setup application insights v3 (https://learn.microsoft.com/en-us/azure/azure-monitor/app/java-spring-boot#programmatic-configuration). I have followed all of the steps in this doc and I am getting some logs and some telemetry data sent to my Insights instance. However, the most critical logs of my application are not being captured. I have ensured that the log4j log level is set to INFO and I have set the env varable APPLICATIONINSIGHTS_INSTRUMENTATION_LOGGING_LEVEL=INFO as called out here: https://learn.microsoft.com/en-us/azure/azure-monitor/app/java-standalone-config#auto-collected-logging

Yet, my critical logs are not captured. I am seeing some of the logs, but not the ones I need most.

AnuragSingh-MSFT 20,431 Reputation points

2022-08-12T11:25:25.12+00:00

@Helms, Benjamin , thank you for posting this question on Microsoft Q&A.
For the scenario mentioned in the questions - that some logs are coming into log analytics and some not, - it could be related to sampling of data being sent to ApplicationInsight.
I would suggest setting the Sampling percentage to 100% for test, to see if all the logs are coming in. For details, see Sampling under Configuration Option

If you start seeing all the logs in ApplicationInsights, you can later override the sampling for certain attributes by using the Sampling overrides.

Please lt me know if you have any questions.
Helms, Benjamin 41 Reputation points

2022-08-12T14:13:27.36+00:00

I have already checked sampling in the insights configuration and it is set to 100%.
AnuragSingh-MSFT 20,431 Reputation points

2022-08-16T05:57:34.907+00:00

@Helms, Benjamin , thank you for the reply.

Since you are still facing this issue and based on the nature of it, a dedicated investigation of the environment/settings and troubleshooting would be the fastest way to resolve it or to find root cause. Therefore, I would suggest opening a support ticket using the link - Azure Support, so that it can be investigated 1:1.

If you are unable to open the support ticket, please let me know.
AnuragSingh-MSFT 20,431 Reputation points

2022-08-22T06:31:38.467+00:00

@Helms, Benjamin , I wanted to check if you had a chance to open the support ticket for this issue. Please let me know if you have any concerns. Thank you