Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,343 questions
Issue with max block count in Azure Data Lake Gen2
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 8%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
Anonymous
Starting from 03/02/23 I have noticed that my Stream Analytics Job has been creating more files per day than before. Looking through the files' properties I discovered that every file maxes out at 10000 blocks and then the SA Job creates another one, while before the max count was 50000 blocks.
I was not able to find any change on the max block count and according to these pages: https://learn.microsoft.com/en-us/azure/stream-analytics/blob-storage-azure-data-lake-gen2-output, https://learn.microsoft.com/en-us/azure/azure-resource-manager/management/azure-subscription-service-limits#storage-limits the limit is still 50000 blocks per file in Azure Blob Storage.
I also noticed a brief stop of the SA job that morning and a Health Event Activated error with no extra details.
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 9%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee2023-04-13T05:35:27.2233333+00:00 Hi @Anonymous , Thanks for using Microsoft Q&A forum and posting your query.
As per your description it seems strange and didn't find any announcement related to this change, hence reaching out to respective product owners to see if there are any recent changes on these block count limits and will get back to you as soon as I hear back from the team.
Thank you for your patience.
-
KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee
2023-04-18T17:59:02.9266667+00:00 @Anonymous Just wanted to update you that I'm still working with respective product owners and will keep you posted once we have more information about the root case and possible resolution.
Thank you for your patience.
-
Anonymous
2023-05-05T12:55:52.1133333+00:00 Hi @KranthiPakala-MSFT , any updates? The issue persists.
Thank you.
-
KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee
2023-05-05T17:36:21.4766667+00:00 Hi @Anonymous Thanks for getting back. AFAIK product team are evaluating the other scenarios to fix the reported problem. I have reached out to product to provide an update on the same and awaiting their response. Will keep you posted as soon as I receive the response.
Thank you
-
KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee
2023-05-22T14:37:38.6766667+00:00 @Anonymous Wanted to let you know that Product team are actively working on it. As this functionality has dependencies on other features, it is taking longer time than expected. I will keep you posted once I have a final update from the team.
Thank you!
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 70%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EFM%3C/text%3E%3C/svg%3E)
Forlani Mauro 1 Reputation point2024-02-01T16:01:56.7666667+00:00 Hi @KranthiPakala-MSFT , any updates regarding this issue?
Thank you
Sign in to comment