question

AzeemK-2483 avatar image
0 Votes"
AzeemK-2483 asked AzeemK-2483 answered

ADF Generic error while moving data from ADLS Gen 2 to Synapse

I am getting this error below while moving Data from ADLS Gen 2 .csv files to Azure Synapse. I try changing data types for destination and to max length but the errro is still there Source file have almost 3 billion rows

Exception of type 'Microsoft.SqlServer.DataWarehouse.Tds.PdwManagedToNativeInteropException' was thrown.,Source=.Net SqlClient Data Provider,SqlErrorNumber=100000,Class=16,ErrorCode=-2146232060,State=1,Errors=[{Class=16,Number=100000,State=1,Message=PdwManagedToNativeInteropException ErrorNumber: 46724, MajorCode: 467, MinorCode: 24, Severity: 20, State: 2, Exception of type 'Microsoft.SqlServer.DataWarehouse.Tds.PdwManagedToNativeInteropException' was thrown.,},],'

azure-data-factory
· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @AzeemK-2483,

Thank you for posting your query.

You may experience the above error message usually when there is a miss match between source and sink column sizes. Or sometimes it may be due to Source and Sink data type Issues.

You may check the SO thread which addressing similar issue and see if that helps.

Feel free to reach us back if any difficulties after checking the SO thread.


0 Votes 0 ·

Hello @AzeemK-2483,

Following up to see if the above suggestion was helpful. And, if you have any further query do let us know.

0 Votes 0 ·

1 Answer

AzeemK-2483 avatar image
0 Votes"
AzeemK-2483 answered

This was happening due to inserting null value in source to not null in destination

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.