Can I integrate Log Analytics with log4j2?

vikas katru 6

Use-case: Running Spark job in Databricks and monitoring logs in LogAnalytics.

Issue: In Veracode report, I am getting security vulnerabilities(CRLF) with Slf4j logger.

I am looking for other approaches, with Log4j2 I don't see any issues.

Now my question is, I want to integrate LogAnalytics with Log4j2, is that possible in my case?

bharathn-msft 5,086 Reputation points Microsoft Employee

2020-08-21T18:58:30.347+00:00
@vikas katru Thank you for reaching out

You should be able to send log data to Azure Monitor with the HTTP Data Collector API. Came across this GitHub private repo which uses HTTP Data Collector API to send Log4j logs to Azure Log Analytics , please see if that helps.

Regarding Monitoring Azure Databricks in an Azure Log Analytics Workspace , please see if the solution in this repo helps.

Hope the above information helps. Please review the information and circle back if you have any further queries. Thank you
vikas katru 6 Reputation points

2020-08-24T09:15:16.193+00:00

Thanks @bharathn-msft , I tried the same approach you mentioned for Monitoring Azure Databricks in an Azure Log Analytics.

The problem is they are using Log4j 1.x in spark-listeners-loganalytics, and I am facing some security issues in Veracode report because of Log4j 1.x.

So is there any way I can use Log4j 2.x in the same approach? like creating log-analytics.properties file that supports log4j 2.x and use log4j 2.x in spark-listeners instead of log4j 1.x
bharathn-msft 5,086 Reputation points Microsoft Employee

2020-08-26T02:35:13.943+00:00

@vikas katru Thank you for sharing additional information, I am circling back with our internal teams to understand if there is any limitation around using Log4j 2.x. Will keep you updated as I get more information.
bharathn-msft 5,086 Reputation points Microsoft Employee

2020-08-28T05:45:13.877+00:00

@vikas katru Apologies for the delayed response on this , still working through with our internal teams to get a response for your query. Will keep you updated as we get more information. Thank you.
Tomazin, Kenneth G 1 Reputation point

2021-09-14T14:20:26.137+00:00

We are also interested in using log4j 2.x. Do you have any updated status on this?

1 answer

Oleg Ananiev (MSFT) 81 Reputation points Microsoft Employee

2020-08-31T12:49:34.897+00:00

I am working to locate the relevant owners of the libraries, but for faster response, I would suggest to log a question/issue to the library repo - https://github.com/mspnp/spark-monitoring
Please sign in to rate this answer.

0 comments No comments
Sign in to comment