question

Edwin-186011 avatar image
0 Votes"
Edwin-186011 asked PRADEEPCHEEKATLA-MSFT commented

Accessing blob storage $logs through ADF

Hi,

first I'll explain what I need to accomplish. We have a container where users can insert and update data files (CSVs) that then are read into a database using ADF and event triggers. We need add the information about who updated the file into the database.

My idea was to activate logging on our Storage Datalake v2 and use the logs to find the AD-user who updated or inserted the file. The actual logs seem to include the information I need but ADF does not see the "$logs" container in the datalake.

I found this previous and quite old question: https://social.msdn.microsoft.com/Forums/en-US/e59a9b0e-cf6b-4155-b1ba-3165ee831478/logs-container-not-accessible-in-adf?forum=AzureDataFactory where someone from Microsoft says that $logs should be accessible, however it does not appear or work for me.

Has anyone else had success with either accessing $logs through ADF or adding information about the user updating files in a storage account to a database?


azure-data-factoryazure-data-lake-storage
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

PRADEEPCHEEKATLA-MSFT avatar image
1 Vote"
PRADEEPCHEEKATLA-MSFT answered PRADEEPCHEEKATLA-MSFT commented

Hello @VehmaanperaEdwin-1860,

Welcome to the Microsoft Q&A platform.

Unfortunately, you cannot access Azure Storage analytics logs folder $logs through Azure Data Factory.

49906-adf-logs.gif

You can access the Azure Storage analytics logs folder $logs using Azure Storage Explorer.

49893-image.png

Reference: Azure Storage analytics logging

I would suggest you to provide feedback on the same:

https://feedback.azure.com/forums/270578-data-factory

https://feedback.azure.com/forums/217298-storage?query=%24logs

All of the feedback you share in these forums will be monitored and reviewed by the Microsoft engineering teams responsible for building Azure.

Hope this helps. Do let us know if you any further queries.


  • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification.



adf-logs.gif (1.4 MiB)
image.png (66.5 KiB)
· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @VehmaanperaEdwin-1860,

Just checking in to see if the above answer helped. If this answers your query, do click “Accept Answer” and Up-Vote for the same. And, if you have any further query do let us know.

0 Votes 0 ·

Hello @VehmaanperaEdwin-1860,

Following up to see if the above suggestion was helpful. And, if you have any further query do let us know.

Take care & stay safe!

0 Votes 0 ·