what's the spark UI log history for the job ran for a cluster?

what's the spark UI log history for the job ran for a cluster?

Hello @sakuraime,
Thanks for the question and using MS Q&A platform.
The Spark UI is the web interface of a running Spark application to monitor and inspect Spark job executions in a web browser.
Apache Spark provides a suite of Web UI/User (aka Application UI or webUI or Spark UI) Interfaces (Jobs, Stages, Tasks, Storage, Environment, Executors, and SQL) to monitor the status of your Spark/PySpark application, resource consumption of Spark cluster, and Spark configurations.
For more details, refer to the below articles:
Hope this helps. Do let us know if you any further queries.
Please "Accept the answer" if the information helped you. This will help us and others in the community as well.
Hello @sakuraime,
Events are stored for 60 days, which is comparable to other data retention times in Azure Databricks.
8 people are following this question.