question

saikumarellendula-8111 avatar image
0 Votes"
saikumarellendula-8111 asked ·

dataflow detailed log

Hi,

one of the Azure data factory pipeline failed with this error. where can we find the more detailed information like in which rows of the source file we have issues.

{"message":"at Source 'source1': Column 'int_col has incompatible types( Found: StringType, Required: IntegerType). Details:at Source 'source1': Column 'int_col has incompatible types( Found: StringType, Required: IntegerType)","failureType":"UserError","target":"df_all_types_poc","errorCode":"DFExecutorUserError"}

Thanks,
Saikumar

azure-data-factory
· 1
10 |1000 characters needed characters left characters exceeded
Toggle Comment visibility. Current Visibility: Visible to all users

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

KranthiPakala-MSFT avatar image KranthiPakala-MSFT ·

Hi @saikumarellendula-8111,

Thanks for reaching out. Could you please share the runID's of the failed pipeline & Activity?

  • Failed pipeline run Id

  • Failed activity run ID

  • Data factory region


0 Votes 0 ·

1 Answer

KranthiPakala-MSFT avatar image
0 Votes"
KranthiPakala-MSFT answered ·

Hi @saikumarellendula-8111, | Could you please tell us what is your source file type? What data type schema indicate in dataflow for Column 'int_col'?


At the moment there is no other way to find more detailed information of the exact row where the issue is. But internal source confirmed that ADF engineering team is working on some improvements that may address this requirement.


I would also suggest you to please share your feedback in ADF user voice forum and share the suggestion link here: https://feedback.azure.com/forums/270578-data-factory/


Or you could also provide a feedback directly from ADF portal as shown below to improve ADF product better.


9738-adffeedback.png



Thank you


Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members.



adffeedback.png (23.8 KiB)
· 1 ·
10 |1000 characters needed characters left characters exceeded
Toggle Comment visibility. Current Visibility: Visible to all users

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

KranthiPakala-MSFT avatar image KranthiPakala-MSFT ·

Hi @saikumarellendula-8111,

Just checking to see if you have got a chance to share your feedback in ADF user voice forum. I have found a similar feedback submitted by other users. Please feel free to up-vote/comment to help increase the priority of feature request.

ADF feature request: Add more specific details to Error displayed for Pipeline activity fails in ADFV2


0 Votes 0 ·