I am trying to deploy a DataTransferStep with azureml pipeline
source -> SQL database
sink -> Azure Blob
using yaml pipelines
additonal comments:
This is built similar to pipeline class as in
https://docs.microsoft.com/en-us/python/api/azureml-pipeline-core/azureml.pipeline.core.pipeline.pipeline?view=azure-ml-py
Note: I have deployed successfully yaml other pipelines that uses PythonScriptStep successfully previously
my pipeline fails as below
The above one is built using following yaml snippet
it fails mentioning "The SQL Source payload is invalid: Cannot specify 'sqlReaderQuery', 'storedProcedureParameters' at the same time". whereas only sqlReaderQuery is only provided by me in yaml. storedProcedureParameters takes a default value of None as per https://docs.microsoft.com/en-us/python/api/azureml-core/azureml.data.sql_data_reference.sqldatareference?view=azure-ml-py . I have debugged inside azureml code and verified storedProcedureParameters is None too.

in executionlogs.txt its also found that an additional stored procedure parameters: 0 () is printed.
Copy source: SQL server database: xxxxxxxx, servername: xxxxxxxxxxxxx, serverUri: xxxxxxx-dev.database.windows.netAuthentication: AuthencationType=SqlAuthentication, table: dummy, query: SELECT TOP (100) * FROM dml.annotations, stored procedure parameters: 0 ()

I tried numerous combinations to avoid this default value of 0 () coming for stored procedure parameters since it is the summary of the issue as per logs and nothing worked.
additional analysis:
I tried to implement same as direct code in azureml notebook ( here yaml is not present ) i see that the data transfer from sql to blob works perfectly fine in notebook.
so question is when written via yaml why is it not working and creating a error by adding a default value to stored procedure parameters of SqlDataReference, how to fix it ???*
Also tried in various software versions:
azureml-core 1.26 and 1.36
