question

Robert-4267 avatar image
0 Votes"
Robert-4267 asked HimanshuSinha-MSFT commented

Azure Data Factory - Passing parameters (pipeline details) into Dataflow - error

When passing in two parameters which equate to @pipeline.RunId and @pipeline.RunDateTime into a DF, I get the error below. I've checked the expression box on the Parameters both on/off - same error. I want to append these values to my data.
When using debug within the data flow, the debug picture of the data is correct with the values set in the debug window. The problem appears to be with the @pipeline.RunId paramrter


Operation on target LoadHubsToStagingDF failed: {"StatusCode":"DF-Executor-ParseError","Message":"Job failed due to reason: Expression cannot be parsed","Details":"Parameter stream has parsing errors\nLine 2 Position 36: missing '=' at ':'\nLine 2 Position 37: mismatched input '44' expecting {'parameters', 'functions', 'as', 'input', 'output', 'constant', 'expression', 'integer', 'short', 'long', 'double', 'float', 'decimal', 'boolean', 'timestamp', 'date', 'byte', 'binary', 'integral', 'number', 'fractional', 'any', IDENTIFIER, ANY_IDENTIFIER}\nLine 3 Position 0: extraneous input 'ip_PipelineRunId' expecting '='"}

azure-data-factory
· 4
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello anonymous user-4267,
Thanks for the ask and using the Microsoft Q&A platform .
Can you please the share ADF JSON and also the DF scripts ? That will give some more idea to look into the issue .


93743-image.png




Thanks
Himanshu


0 Votes 0 ·
image.png (78.4 KiB)

Himanshu,

I am having a similar issue and unable to resolve it.

DF-Executor-ParseError","Message":"Job failed due to reason: Expression cannot be parsed

Can you help?

I have a parameter in my filter transformation that I want to interact with my Data flow parameter and pipeline.

0 Votes 0 ·

Himanshu,

I am having a similar issue and unable to resolve it.

DF-Executor-ParseError","Message":"Job failed due to reason: Expression cannot be parsed

Can you help?

I have a parameter in my filter transformation that I want to interact with my Data flow parameter and pipeline.

0 Votes 0 ·

Hello @SonyaMcNeal-9349 ,
May I request you to please open a new theard ? Laos provide more details of the imoplamentation .

Thanks
Himanshu

0 Votes 0 ·

1 Answer

Robert-4267 avatar image
0 Votes"
Robert-4267 answered HimanshuSinha-MSFT commented

Hi Himanshu - I managed to sort out my problem. I just need to read the following guidance 3 times - the issue was with the timestamps!
https://docs.microsoft.com/en-us/azure/data-factory/parameters-data-flow
Thanks

· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Thanks anonymous user-4267 ,

It was great to know that you were able to get to a resolution . We expect you to keep using this forum and also motivate others to do that same . You can always help other community members by answering to their queries .

Thanks
Himanshu

0 Votes 0 ·