question

Mounica-8649 avatar image
0 Votes"
Mounica-8649 asked HimanshuSinha-MSFT commented

Spark Connector in ADF

Hi, I have created a spark connector to connect to azure data bricks. In copy activity source is spark connector and sink is Azure SQL DB. In spark Connector query, CreatedDate is being converted to String and throwing error where as it is timestamp column.

How to copy timestamp columns from spark to azure sql.

10310-issue.png

{
"errorCode": "2200",
"message": "Failure happened on 'Source' side. ErrorCode=UserErrorOdbcOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ERROR [HY000] [Microsoft][Support] (50130) Conversion from number to string failed due to undersized character buffer.,Source=Microsoft.DataTransfer.ClientLibrary.Odbc.OdbcConnector,''Type=System.Data.Odbc.OdbcException,Message=ERROR [HY000] [Microsoft][Support] (50130) Conversion from number to string failed due to undersized character buffer.,Source=Microsoft Spark ODBC Driver,'",
"failureType": "UserError",
"target": "CopyData",
"details": []
}


azure-data-factoryazure-databricks
issue.png (13.6 KiB)
· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello Mounica-8649 ,

Can you please share with us the way you have configured your linked service ( which is point to an Adb instance ) ?

Thanks
Himanshu

0 Votes 0 ·

Hello Himanshusinha-5732,

Please find the linked server configuration to adb instance.

10398-linkedserveradb.png


And Config for spark connector,

10512-sparkconnector.png


0 Votes 0 ·
linkedserveradb.png (26.0 KiB)
sparkconnector.png (29.0 KiB)

Hello ,

For a deeper investigation and immediate assistance on this issue, if you have a support plan you may file a support ticket, else could you please send an email to AzCommunity@microsoft.com with the below details, so that we can create a one-time-free support ticket for you to work closely on this matter. 
Thread URL:
Subscription ID: 
Subject:Attention <<HImanshu>>
Please let me know once you have done the same

Thanks
Himanshu

0 Votes 0 ·

0 Answers