question

JohnK-3500 avatar image
0 Votes"
JohnK-3500 asked SaurabhSharma-msft commented

ADF Dataflow and LinkedService Error

Hi,

I am trying to use dataflow to read from REST Source.
I created a linked service and defined a parameter called URL in it and in Base URL I provided "@{linkedService().URL}"
However when I try to use this linked service in data flow, I can't find any field where I can provide the value of this parameter


192928-image.png



Can't see the option to provide URL in data flow tab



192959-image.png

192960-image.png



azure-data-factoryazure-data-lake-storage
image.png (40.5 KiB)
image.png (25.9 KiB)
image.png (37.1 KiB)
5 |1600 characters needed characters left characters exceeded
Toggle Comment visibility. Current Visibility: Visible to all users

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

SaurabhSharma-msft avatar image
1 Vote"
SaurabhSharma-msft answered SaurabhSharma-msft commented

Hi @johnk-3500,

Thanks for using Microsoft Q&A !!
If I understand correctly, you are trying to pass the parameters to a REST linked service while using it in a DataFlow.
In order to pass parameters to this linked service you need to set the Value of the parameter in your pipeline which actually calls this DataFlow. Please refer to the below screenshot -
193283-image.png
Also, if you want to test your DataFlow then you need to pass the required parameters using Debug Settings of your DataFlow. Please refer to the below screenshot -
193228-image.png

Please let me know if you have any questions.

Thanks
Saurabh

Please do not forget to "Accept the answer" wherever the information provided helps you to help others in the community.


image.png (42.2 KiB)
image.png (34.4 KiB)
· 3
5 |1600 characters needed characters left characters exceeded
Toggle Comment visibility. Current Visibility: Visible to all users

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

JohnK-3500 avatar image JohnK-3500 ·

Thanks a lot for this answer
I did the same
However, I am getting this error

Spark job failed: {
"text/plain": "{\"runId\":\"19aeb600-ca33-4655-b5ff-1d7bac2a9dc4\",\"sessionId\":\"825fb93e-341e-461f-9842-7378a900da44\",\"status\":\"Failed\",\"payload\":{\"statusCode\":400,\"shortMessage\":\"java.lang.Exception: DataFlowManagerClient.getPayload: 400\",\"detailedMessage\":\"Failure 2022-04-15 01:22:06.217 failed DebugManager.processJob, run=19aeb600-ca33-4655-b5ff-1d7bac2a9dc4, errorMessage=java.lang.Exception: DataFlowManagerClient.getPayload: 400\"}}\n"
} - RunId: 19aeb600-ca33-4655-b5ff-1d7bac2a9dc

I checked the same API call is working in the PostMan

0 Votes 0 ·
JohnK-3500 avatar image JohnK-3500 ·

If you can check my other question and latest attempt . will be great. Thanks
https://docs.microsoft.com/en-us/answers/questions/812242/adf-linkedserver-token-question.html?childToView=813463#answer-813463

0 Votes 0 ·
SaurabhSharma-msft avatar image SaurabhSharma-msft JohnK-3500 ·

Hi @johnk-3500, ,
Apologies for the delayed response. I see that you have been helped on your other issue.

Please let me know if you still have any questions.
Also, please let me know if you find above reply useful. If yes, please 'Accept the answer' for the above reply. This will help other community members facing similar query to refer to this solution.

Thanks
Saurabh

1 Vote 1 ·