question

ManishaKottary-6919 avatar image
0 Votes"
ManishaKottary-6919 asked KranthiPakala-MSFT edited

ADF error : DFExecutorUserError

I have create a data flow in ADF and I am running it via a pipeline. The pipeline is validated and there are no errors. I am also able to preview all the data in the sink . But on executing the pipeline I am getting the following error :


Error code : DFExecutorUserError

Failure type : User configuration issue
Details:

{"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: at Sink 'sink1': java.sql.BatchUpdateException: Violation of PRIMARY KEY constraint 'employee_pk'. Cannot insert duplicate key in object 'dbo.employee'. The duplicate key value is (E04).","Details":"java.sql.BatchUpdateException: Violation of PRIMARY KEY constraint 'employee_pk'. Cannot insert duplicate key in object 'dbo.employee'. The duplicate key value is (E04).\n\tat shaded.msdataflow.com.microsoft.sqlserver.jdbc.SQLServerStatement.executeBatch(SQLServerStatement.java:1753)\n\tat com.microsoft.dataflow.transformers.store.JDBCWriter.executeBatchSQLs(JDBCStore.scala:457)\n\tat com.microsoft.dataflow.transformers.store.JDBCWriter.executeSQL(JDBCStore.scala:439)\n\tat com.microsoft.dataflow.transformers.store.JDBCWriter$$anonfun$executeTableOpAndPostSQLAndDDL$1.apply$mcV$sp(JDBCStore.scala:485)\n\tat com.microsoft.dataflow.transformers.store.JDBCWriter$$anonfun$executeTableOpAndPostSQLAndDDL$1.apply(JDBCStore.scala:485)\n\tat com.microsoft.dataflow.transformers.store.JDBCWriter$$anonfun$executeTableOpAndPostSQLAndDDL$1.apply(JDBCStore.scala:485)\n\tat com.microsoft.dataflow.transformers.StoreContext$.timed(Store.scala:130)\n\tat com.microsoft.dataflow.transformers.store.JDBCWriter.executeTableOpAndPostSQLAndDDL(JDBCSto"}

azure-data-factory
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

This is a driver error being reported by your SQL sink because you are violating the primary key constraint. Either relax the database constraint or use "error row handling" on the Sink to handle this as an exception.

0 Votes 0 ·

1 Answer

NandanHegde-7720 avatar image
0 Votes"
NandanHegde-7720 answered KranthiPakala-MSFT edited

Hey,
Can you please tell us what your source and sink are ?
And based on the error message: The error is due to data issues at the source and no where related to your ADF.

· 4
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hy @NandanHegde-7720 ,

My source is a XML file and sink is a DB.

Thank you.

0 Votes 0 ·

Search in your XML file and database for the value: E04.
At both the places you might find the value or there are might be multiple records in the XML file itslef.
This seems to be a data related issue and not ADF :)

Hope this helps!

1 Vote 1 ·

Thank you I will look into it.

0 Votes 0 ·
Show more comments