How to load BSEG table FROM SAP ECC/HANA to Azure through ADF using the SAP connector?

Question

question

VMZ7 asked Feb 26, '22 HimanshuSinha-MSFT commented Mar 16, '22

How to load BSEG table FROM SAP ECC/HANA to Azure through ADF using the SAP connector?

Hi,
I am trying to load data of BSEG from SAP ECC to Azure. Since BSEG is a huge table, I am not able to do a full load of the historical data.
I've tried partition options over Calendar Date, increasing parallelism but nothing seems to be working.

SAP Server has a memory of 10GB from which I am trying to load BSEG.

Any Suggestions/ Help would be appreciated.

Thanks

azure-data-factory azure-data-lake-storage azure-sap

· 2

5 |1600 characters needed characters left characters exceeded

Attachments: Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

HimanshuSinha-MSFT · Mar 02 at 12:12 AM

Hello @VMZ7,
Thanks for the question and using MS Q&A platform.
As we understand the ask here is to copy the BSEG table to Azure , please do let us know if its not accurate.
Let me start with , I am not SAP literate and neither I have an environment to test the ask here . i was reading and I did found this link https://stackoverflow.com/questions/71209436/delta-load-on-bseg-table-into-azure-using-sap-table-conenctor and I am sure if you got a chance to read this before .
You did mentioned "nothing seems to be working" , can you please lets us know what is that you are experiencing any error , any config issues etc .

Please do let me if you have any queries.
Thanks
Himanshu

0 ·

VMZ7 HimanshuSinha-MSFT · Mar 02 at 08:29 PM

Hi @HimanshuSinha-MSFT ,

When I am trying to load data from BSEG table into Azure Synapse, I get an error saying

Operation on target Copy_z0z failed: ‘Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Failed to invoke function /SAPDS/RFC_READ_TABLE2 with error: SAP.Middleware.Connector.RfcAbapRuntimeException, message: No more memory available to add rows to an internal table., stacktrack: at SAP.Middleware.Connector.RfcConnection.ThrowRfcErrorMsg() at SAP.Middleware.Connector.RfcConnection.ReadBytes(Byte* buffer, Int32 count) at SAP.Middleware.Connector.RfcConnection.ReadRfcIDBegin(Int32& length) at SAP.Middleware.Connector.RfcConnection.ReadUpTo(RFCGET readState, RfcFunction function, RFCID toRid) at SAP.Middleware.Connector.RfcConnection.RfcReceive(RfcFunction function) at SAP.Middleware.Connector.RfcFunction.RfcDeserialize(RfcConnection conn, IRfcIOStream stream) Boolean initStatefulSession, Boolean checkForErrors) at Microsoft.Practices.TransientFaultHandling.RetryPolicy.,Source=Microsoft.DataTransfer.Runtime.SapRfcHelper,”Type=SAP.Middleware.Connector.RfcAbapRuntimeException,Message=No more memory available to add rows to an internal table.,Source=sapnco,

I know this is because the data I am trying to load is too large, I have tried to go for the smallest chunk and yet I am facing this issue.
We cannot increase the memory on SAP Server, I need help with some approaches on the Azure end.

So far I have used partition option in Azure
Increasing/Reducing Parallelism
I need some other approach or way to get this data.

Thanks!

0 ·

question