Issue while loading data in ADLS GEN2(SINK)/Extracting files from ADLS GEN2(SOURCE)

pankaj chaturvedi 86 Reputation points
2020-11-27T14:50:45.197+00:00

Hi Team,

I am extracting data from REST API and loading into ADLS and ADLS to SQL DB.

I am encountering the below errors:

activity flow-- copy activity(REST API to ADLS)----->copy activity(ADLS to SQL DB)

step 1- while copying data from rest api to ADLS:

Failure happened on 'Sink' side.

ErrorCode=AdlsGen2OperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ADLS Gen2 operation failed for: Operation returned an invalid status code

'PreconditionFailed'. Account: 'testadl'. FileSystem: 'INPUT. Path: 'input test /YYYY=2020/MM=11/DD=26/customer_test_2020-11-26.json'. ErrorCode: 'LeaseLost'. Message: 'A lease ID was specified, but the lease for the resource has expired.'. RequestId: 'a9a153a7-401f-007f-739e-c4fe17000000'. TimeStamp: 'Fri, 27 Nov 2020 09:18:26

GMT'..,Source=Microsoft.DataTransfer.ClientLibrary,''Type=Microsoft.Azure.Storage.Data.Models.ErrorSchemaException,Message=Operation returned an invalid status code 'PreconditionFailed',Source=Microsoft.DataTransfer.ClientLibrary,'

step 2- while copying data from ADLS to SQL DB:

Details
Failure happened on 'Source' side. 'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ADLS Gen2 operation failed for: Operation returned an invalid status code **'RequestedRangeNotSatisfiable'. Account: 'testadl'.

FileSystem: 'INPUT'. Path: 'input test /YYYY=2020/MM=11/DD=26/customer_testcase_2020-11-26.json'. ErrorCode: 'InvalidRange'. Message: ****'The range specified is invalid for the current size of the resource.'.** RequestId: 'aa879dc9-e01f-0097-22c1-c403ec000000'. TimeStamp: 'Fri, 27 Nov 2020 13:28:44

GMT'..,Source=Microsoft.DataTransfer.ClientLibrary,''Type=Microsoft.Azure.Storage.Data.Models.ErrorSchemaException,Message=Operation returned an invalid status code

'RequestedRangeNotSatisfiable',Source=Microsoft.DataTransfer.ClientLibrary,'

I am unable to get why those errors are generating. Could you please someone help out on this.

Thanks,
pankaj

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,341 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,539 questions

2 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. Derome, Eric 11 Reputation points
    2021-08-27T16:12:40.457+00:00

    Hello,
    Is this issue resolved ?
    We're getting this error which seems the same :
    ErrorCode=AdlsGen2OperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ADLS Gen2 operation failed for: Operation returned an invalid status code 'PreconditionFailed'. Account: 'povazudevstoragedatalake'. FileSystem: '01-brute'. Path: 'lnkHoraireChrono/2021/08/26/lnkHoraireChrono_20200402.parquet'. ErrorCode: 'LeaseLost'. Message: 'A lease ID was specified, but the lease for the resource has expired.'. RequestId: 'c04302f3-c01f-0013-6598-9a5bbe000000'. TimeStamp: 'Thu, 26 Aug 2021 16:32:59 GMT'..,Source=Microsoft.DataTransfer.ClientLibrary,''Type=Microsoft.Azure.Storage.Data.Models.ErrorSchemaException,Message=Operation returned an invalid status code 'PreconditionFailed',Source=Microsoft.DataTransfer.ClientLibrary,'", "failureType": "UserError", "target": "CPD_SQL_HoraireChrono_DL_Raw", "details": [] }

    1 person found this answer helpful.
  2. HarithaMaddi-MSFT 10,126 Reputation points
    2020-12-07T14:53:09.83+00:00

    Hi @pankaj chaturvedi ,

    We have not received a response from you. Please suggest if the first error due to concurrent runs is resolved. For the second error, product team suggested that RequestedRangeNotSatisfiable indicates the pipeline is trying to access past the length of the file/blob. From this page, If the offset is invalid and exceeds the blob’s total length, the request will return status code 416 (Requested Range Not Satisfiable). Please check the configuration details and let us know if the issue persists.

    Thanks for your patience!

    ---

    • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification.