question

RyanAbbey-0701 avatar image
0 Votes"
RyanAbbey-0701 asked PRADEEPCHEEKATLA-MSFT commented

Synapse Spark Delta - VACUUM

Is there any way to log the VACUUM stats within Synapse Spark 2.4?

Databricks has "spark.databricks.delta.vacuum.logging.enabled" which I tried but did not get any success in logging the vacuum call

azure-synapse-analytics
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

PRADEEPCHEEKATLA-MSFT avatar image
0 Votes"
PRADEEPCHEEKATLA-MSFT answered PRADEEPCHEEKATLA-MSFT commented

Hello @RyanAbbey-0701,

Thanks for the using MS Q&A platform.

Azure Databricks & Azure Synapse - VACUUM commits to the Delta transaction log contain audit information.

You can query the audit events using DESCRIBE HISTORY as shown below.

128180-image.png

For more details, refer to Audit information.

Hope this helps. Do let us know if you any further queries.


Please "Accept the answer" if the information helped you. This will help us and others in the community as well.


image.png (70.2 KiB)
· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

I know we can describe history, but it does not show the "VACUUM" operation, I want to know what a VACUUM did

0 Votes 0 ·

Any advancement on this? Are you able to get "VACUUM"s to show in the history?

0 Votes 0 ·

Hello @RyanAbbey-0701,

We had reached out to the internal team to get more details on this issue. I will be update you once I hear back from the team.

0 Votes 0 ·