dataflow detailed log

saikumar ellendula 6 Reputation points
2020-06-09T06:30:25.157+00:00

Hi,

one of the Azure data factory pipeline failed with this error. where can we find the more detailed information like in which rows of the source file we have issues.

{"message":"at Source 'source1': Column 'int_col has incompatible types( Found: StringType, Required: IntegerType). Details:at Source 'source1': Column 'int_col has incompatible types( Found: StringType, Required: IntegerType)","failureType":"UserError","target":"df_all_types_poc","errorCode":"DFExecutorUserError"}

Thanks,
Saikumar

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,610 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee
    2020-06-11T00:58:29.02+00:00

    Hi @saikumarellendula-8111, | Could you please tell us what is your source file type? What data type schema indicate in dataflow for Column 'int_col'?

    At the moment there is no other way to find more detailed information of the exact row where the issue is. But internal source confirmed that ADF engineering team is working on some improvements that may address this requirement.

    I would also suggest you to please share your feedback in ADF user voice forum and share the suggestion link here: https://feedback.azure.com/forums/270578-data-factory/

    Or you could also provide a feedback directly from ADF portal as shown below to improve ADF product better.

    9738-adffeedback.png

    Thank you

    Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members.