question

ReddyHaripriya-9550 avatar image
0 Votes"
ReddyHaripriya-9550 asked jagsmcp commented

Dynamic Copy Data Auto column map fails because of case sensitivity issue in Source and Sink ColumnName - Azure Data Factory

Dynamic Copy Data Auto column map fails because of case sensitivity issue in Source and Sink ColumnName - Azure Data Factory


In Source the column is defined as CITYID and in Sink it is CityID. Due to other Pipelines and transformations I cannot alter the table Column names.

Getting the below error:

ErrorCode=UserErrorInvalidColumnMappingColumnNotFound,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Column name 'CityID' cannot be found in either source data or column mapping.,Source=Microsoft.DataTransfer.ServiceLibrary,'

How can we handle this issue without altering the table at the source or sink

Any resolution approach is appreciated, Thanks

azure-data-factory
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Unfortunately, It is not supported. I had similar issues in the past. The best way to deal is have a source target mapping table with exact column names (case sensitive) in the source column. This reduces major headache. I had issue with BranchId vs BranchID.

0 Votes 0 ·

1 Answer

PRADEEPCHEEKATLA-MSFT avatar image
0 Votes"
PRADEEPCHEEKATLA-MSFT answered PRADEEPCHEEKATLA-MSFT commented

Hello @ReddyHaripriya-9550,

Thanks for the question and using MS Q&A platform.

Are you doing explicit mapping (Import Schemas in Mapping section of Copy) or auto mapping from source to sink? If you are doing auto mapping, could you please try explicit mapping by clicking import schemas in Mapping section of your copy activity.

108473-image.png

You will experiencing this error message when you pass mapping without Import Schemas:

108455-adf-clmmappingwithoutimport.gif

You are able to resolve this error message when you pass mapping with Import Schemas:

108456-adf-clmmappingwithimport.gif

Hope this helps. Do let us know if you any further queries.


Please "Accept the answer" if the information helped you. This will help us and others in the community as well.


· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

The above solution will not work because I cannot do Explicit mapping because I'm passing the tables dynamically from a For Loop

0 Votes 0 ·

Hello @ReddyHaripriya-9550,

If you want to consider dynamic column mapping in copy activity, you may checkout this video: Dynamic Column mapping in Copy Activity in Azure Data Factory

Hope this helps.


0 Votes 0 ·

Hello @ReddyHaripriya-9550,

Following up to see if the above suggestion was helpful. And, if you have any further query do let us know.

0 Votes 0 ·