How can I use a custom RFC to retrieve data via SAP table connector in ADF?

Zazazan 0

How can I use a custom RFC to retrieve data via SAP table connector in ADF. My custom remote function does not have the same importing parameters (QUERY_TABLE, Delimiter, ROWCOUNT/Option/Fields) as the standard module SAPDS/RFC_READ_TABLE2 but custom parameters. Thus, how can I input my custom parameters in Azure data factory?

Harishga 3,505 Reputation points Microsoft Vendor

2024-04-22T06:57:28.06+00:00

@Zazazan
Welcome to Microsoft Q&A platform and thanks for posting your question here.

To use a custom RFC to retrieve data via SAP table connector in Azure Data Factory, you need to follow these steps:

step 1 Create a Custom RFC Function Module

Create a custom RFC function module in your SAP system that defines how the data is retrieved from your SAP system and returned to the service. The custom function module must have an interface implemented (import, export, tables) that's similar to /SAPDS/RFC_READ_TABLE2, which is the default interface used by the service.

Step 2: Create a Pipeline in ADF

In ADF, create a pipeline with a copy activity that uses the SAP table connector as the source.

Step 3: Set the Copy Activity Source Section

In the copy activity source section, set the type property to SapTableSource and the customRfcReadTableFunctionModule property to the name of your custom RFC function module.

Step 4: Specify Custom Parameters

Specify your custom parameters in the rfcTableOptions property of the copy activity source section. The rfcTableOptions property allows you to specify the options to filter the rows in an SAP table using the SAP query operator table.

Why Custom Remote Function Does Not Have the Same Importing Parameters?

The reason why your custom remote function does not have the same importing parameters as the standard module SAPDS/RFC_READ_TABLE2 is that the standard module is designed to work with a specific set of parameters that are commonly used to read data from an SAP table. However, your custom remote function may have been designed to work with a different set of parameters that are specific to your SAP system or business requirements.

How to Input Custom Parameters in Azure Data Factory?

To input your custom parameters in Azure Data Factory (ADF), you can specify them in the rfcTableOptions property of the copy activity source section. The rfcTableOptions property allows you to specify the options to filter the rows in an SAP table using the SAP query operator table.

Reference https://learn.microsoft.com/en-us/answers/questions/655705/sap-table-connector-how-to-call-rfc-function-modul

Hope this helps. Do let us know if you any further queries.
Zazazan 0 Reputation points

2024-04-22T07:16:18.7066667+00:00

Hi Harishga,

My function module does not have the import parameter QUERY_TABLE, which corresponds to 'source dataset' in Azure Data Factory and is mandatory.

How can I override this parameter and only input my own?
Harishga 3,505 Reputation points Microsoft Vendor

2024-04-22T12:10:09.7766667+00:00

@Zazazan
If your custom RFC function module does not have the import parameter QUERY_TABLE, you can still use it in Azure Data Factory (ADF) by specifying a dummy value for the QUERY_TABLE parameter in the source dataset.

To override the mandatory QUERY_TABLE parameter, you can specify a dummy value for it in the source dataset. This will allow you to use your custom RFC function module without having to modify it to include the QUERY_TABLE parameter.
Zazazan 0 Reputation points

2024-04-22T12:21:08.3033333+00:00

Harishga

Thank you for the information!

In my specific case, i want to use the FM ZZ_READ_VM and input the importing parameters IV_BUKR and IV_GJ . I tried it this way and have already input a dummy value for the source dataset (aka QUERY_TABLE):

and get this error:

Errors on "Source". ErrorCode=SapRfcClientOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=SapRfcClient operation 'ReadTable' failed. Please contact SAP support if you need further help. Error message: 'Element QUERY_TABLE of container metadata ZZ_READ_VM unknown',Source=Microsoft.DataTransfer.Runtime.SapRfcHelper,''Type=SAP.Middleware.Connector.RfcInvalidParameterException,Message=Element QUERY_TABLE of container metadata ZZ_READ_VM unknown,Source=sapnco,'

can you please help?
Harishga 3,505 Reputation points Microsoft Vendor

2024-04-24T04:30:19.87+00:00

@Zazazan
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

2 answers

Amira Bedhiafi 15,596 Reputation points

2024-04-21T18:39:45.48+00:00
Using the SAP Table Connector, it's definitely possible to filter data as you described. For example, if you're retrieving table DD03L from SAP and want to exclude rows where certain patterns appear at the beginning, you can use the following query:

FIELDNAME NOT LIKE '.%' AND FIELDNAME NOT LIKE '$%' AND FIELDNAME NOT LIKE '#%'

You can find more information about SAP query operators in the "Copy Activity Properties" section of the documentation.

COLUMN EQ 'SOME VALUE' AND COLUMN1 EQ 'SOME VALUE'

https://learn.microsoft.com/en-us/azure/data-factory/connector-sap-table?tabs=data-factory#create-custom-function-module

https://stackoverflow.com/questions/74940848/sap-table-connector-how-to-querying-sap-table-using-rfc-from-azure-synapse
Please sign in to rate this answer.

0 comments No comments
Sign in to comment
Harishga 3,505 Reputation points Microsoft Vendor

2024-04-23T03:12:27.4066667+00:00

@Zazazan
The error message "Element QUERY_TABLE of container metadata ZZ_READ_VM unknown" states that the SAP RFC function module ZZ_READ_VM you are using in Azure Data Factory (ADF) does not have the QUERY_TABLE parameter defined in its import interface.

To resolve this issue, you will need to modify your custom RFC function module ZZ_READ_VM to include the QUERY_TABLE parameter in its import interface. The QUERY_TABLE parameter is mandatory for the SAP table connector in ADF, as it is used to specify the name of the SAP table that you want to read data from.

Once you have modified your custom RFC function module ZZ_READ_VM to include the QUERY_TABLE parameter, you can specify the name of the SAP table you want to read data from in the source dataset of your ADF pipeline.

If you have already modified your custom RFC function module ZZ_READ_VM to include the QUERY_TABLE parameter and are still encountering issues, you may need to check the metadata of the ZZ_READ_VM function module to ensure that the QUERY_TABLE parameter is defined correctly. You can also try testing the ZZ_READ_VM function module in SAP to ensure that it is working correctly.

I hope this information helps you. Let me know if you have any further questions or concerns.
Please sign in to rate this answer.

0 comments No comments
Sign in to comment