Recieving DataType Error when its the same in both target and source

Kriti Garg 0 Reputation points
2024-05-13T08:34:55.6066667+00:00

I am trying to create an external table in one of the DB using the tables in another Db but in the server.

I am recieving the below error, what could be the possible issue with the pipeline, can you please help me out.

ErrorCode=DataTypeNotSupported,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=A database operation failed. Please check the inner exception.,Source=,'

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,474 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,761 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Harishga 4,250 Reputation points Microsoft Vendor
    2024-05-13T13:54:07.9733333+00:00

    Hi @Kriti Garg
    Welcome to Microsoft Q&A platform and thanks for posting your question here.

    The DataTypeNotSupported error in Azure Synapse Analytics usually occurs when there is a mismatch between the data types in your source and the data types that are supported for external tables in Synapse.

    To resolve this issue, you can follow these steps:

    • Check the list of supported data types for external tables in Synapse Analytics and ensure that the data types in your source match the supported data types.
    • If the data type from the source is not supported, you need to convert it to a supported data type before creating the external table.
    • Ensure that the external table definition in Synapse matches the data types of the source data. This includes checking for correct data type definitions and syntax in your CREATE EXTERNAL TABLE statement.
    • Verify that you have the necessary permissions to access the data source. For example, you might need the ‘Storage Blob Data Contributor’ role on the storage account you’re trying to query.
    • Check for null values in your data and handle them appropriately, such as by removing them or replacing them with other correct values before creating the external table.
    • Check the inner exception for more details, as it often contains specific information about which data type or column is causing the issue.

    Reference:
    https://learn.microsoft.com/en-us/azure/synapse-analytics/sql/develop-tables-external-tables?tabs=hadoop
    https://learn.microsoft.com/en-us/azure/synapse-analytics/sql/develop-tables-data-types

    I hope this information helps you. Let me know if you have any further questions or concerns.

    0 comments No comments