question

Mukesh-3612 avatar image
0 Votes"
Mukesh-3612 asked SumanthMarigowda-MSFT commented

Run index on modified data from azure blob

Hi Team,

we have created Azure search index using Azure blob storage which contains multiple json files which contains 25 lacs records. This takes nearly 4 - 5 hours to run the indexer which is not preferable from our side. Source for this json file in blob is Snowflake database which runs through the ADF pipeline and runs every day.

We want to track new changes from the blob storage on new or modified files and we need to track those only.

We tried checking the Track changes option but its not available.

Please help us to implement the azure index to run on new/modified records.

Thanks
Mukesh

azure-blob-storageazure-cognitive-search
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@Mukesh-3612 Firstly, apologies for the delay in responding here and any inconvenience this issue may have caused.
what about using logging for blobs and send to log analytics?
https://docs.microsoft.com/en-us/azure/storage/files/storage-files-monitoring?tabs=azure-portal

0 Votes 0 ·

0 Answers