question

MadasiSrinivas-3218 avatar image
0 Votes"
MadasiSrinivas-3218 asked CathyLee-4290 commented

ErrorCode=SystemErrorOutOfMemory getting while processing file

Error details
Error code1000
Troubleshooting guide
Failure typeSystem error
DetailsFailure happened on 'Sink' side. ErrorCode=SystemErrorOutOfMemory,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=A task failed with out of memory.,Source=Microsoft.DataTransfer.TransferTask,''Type=System.OutOfMemoryException,Message=Array dimensions exceeded supported range.,Source=System.Core,'

I'm using 2 copy datas one is to insert the CSV(blob) into SQL and the other is to export from SQL to blob storage.

file size is aprox 200 MB and record count is 400 K.

run id: fd597d6b-da0a-4ec9-8ef6-7c00d0705388

azure-data-factory
· 16
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @MadasiSrinivas-3218 ,

Welcome to Microsoft Q&A forum and thanks for your query.

Could you please confirm which copy activity is throwing this error? Is it Copy from CSV to SQL or Export from SQL to Blob? And are you experiencing this error message consistently or intermittent?


Also please do share the failed Activity runID as well as the failed pipeline runID for further analysis.

Looking forward to your response.

Thanks.

1 Vote 1 ·

Hi Kranthi, Thanks for your reply.

This happening consistently in the copy data activity where I'm exporting to Blob. Up to some 200K records, I don't see any issues, when I increase it to 400K started seeing this issues.

Failed pipeline run id: 4582bdb1-f589-4cec-8772-eae6cdc1b5af
Failed Activity run id: 837409a9-22dc-44d2-94a7-e5a7a5f6f1a7

Regards,
Srinivas

0 Votes 0 ·

Hi @MadasiSrinivas-3218 , sorry for the delay in my response and thanks for your response, additional details. We will look into the runID's provided and will get back as soon as we have an update.

We appreciate your patience.

Thank you

0 Votes 0 ·
Show more comments

Hi @MadasiSrinivas-3218 ,

Following up to see if you have got a chance to see my previous comment? If so could you please share few additional details as requested to better assist on this issue.

Thanks

1 Vote 1 ·

Hi, same issue here when copying about 1GB of data using the Salesforce source to Azure blob storage sink JSON file. Copy works fine for smaller amounts of data from Salesforce. Default settings on the pipeline (see screenshot). Same error with DIU's set to 32. Details imply the 1 GB was pulled from Salesforce ok. Please advise.

Run ID: b303acc2-561d-4b60-aa9f-b118fddcbde7

Failure happened on 'Sink' side. ErrorCode=SystemErrorOutOfMemory,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=A task failed with out of memory.,Source=Microsoft.DataTransfer.TransferTask,''Type=System.OutOfMemoryException,Message=Exception of type 'System.OutOfMemoryException' was thrown.,Source=mscorlib,'

61132-screenshot-2021-01-28-130459.png
61080-screenshot-2021-01-28-130239.png


0 Votes 0 ·

Hi @MadasiSrinivas-3218,

After having conversation with internal team. Below are findings and workaround to overcome this issue.

One possible root cause could be you might have a very big row, runtime will try to allocate very big array to store the row string while serialize the row to CSV, that will hit the limit (https://docs.microsoft.com/en-us/dotnet/framework/configure-apps/file-schema/runtime/gcallowverylargeobjects-element).

To work around this issue, it is recommended to run the copy activity via SHIR:

  1. In the SHIR installation folder 'Microsoft Integration Runtime{version}\Shared\diawp.exe.config', find a file with name 'diawp.exe.config'

  2. <gcAllowVeryLargeObjects enabled="true" /> as a child XML node of runtime XML node
    61564-image.png

  3. Restart the self-hosted IR service

  4. Run the copy activity via the SHIR by change the linked service of source or sink to the SHIR


0 Votes 0 ·
image.png (64.0 KiB)

Continuation to above comment:

@MadasiSrinivas-3218, @robo3459-5734 - Could you please try the above workaround provided and let us know if that helps to resolve your issue.

@robo3459-5734 - If the workaround didn't resolve your issue, I would recommend to open a separate new thread as your requirement seems different. It also help us to track this issue separate and also helps other community members to pitch in if they have experienced similar situation.

Please let us know how it goes with SHIR. We look forward to your confirmation.

Thank you

0 Votes 0 ·

Hi Kranthi,

Thanks for this workaround, I will try and let you know if this is working.

Regards,
Srinivas

0 Votes 0 ·
Show more comments

@KranthiPakala-MSFT we are having the same issue and I'm wondering if the modification of the config file applies to updating Azure IR's or just on prem IR's?

0 Votes 0 ·

0 Answers