question

FelipeCastaneda-0362 avatar image
0 Votes"
FelipeCastaneda-0362 asked BrianErlich commented

Error in Azure Data factory

Failure happened on 'Sink' side. ErrorCode=DelimitedTextColumnNameNotAllowNull,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The name of column index 3 is empty. Make sure column name is properly specified in the header row.,Source=Microsoft.DataTransfer.Common,'

azure-data-factory
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

I had the same issue, but the cause was different than what I have seen on the forums, so I thought I would add a comment. My data vendor added a column to a CSV file that I get regularly. The were no extra commas or null fields, but I was unable to load the file until I refreshed the schema mapping on the copy data activity and accounted for the new column. The error message I got was as follows:

Operation on target ForEach1 failed: Activity failed because an inner activity failed; Inner activity name: Copy data1, Error: ErrorCode=DelimitedTextColumnNameNotAllowNull,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The name of column index 26 is empty. Make sure column name is properly specified in the header row.,Source=Microsoft.DataTransfer.Common,'

I hope this adds a little something to the conversation,

Brian

0 Votes 0 ·
RyanAbbey-0701 avatar image
0 Votes"
RyanAbbey-0701 answered

Are you trying to do a copy with headers taken from your source file? Your source has not provided a heading for at least one column...

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

KranthiPakala-MSFT avatar image
0 Votes"
KranthiPakala-MSFT answered KranthiPakala-MSFT commented

Hi @felipecastaneda-0362,

Welcome to Microsoft Q&A forum and thanks for posting your query.

As @RyanAbbey-0701 pointed, looks like your source data is missing a column or having an empty column name.

I assume that you are using a copy activity and doing auto mapping in it. If that is the case, then it is by design behavior that when there is an empty column name in copy activity source then it will throw this error.

You can validate the schema structure by clicking on Copy activity source and doing a preview of the source dataset from copy activity level. This would give you hint to figure out where the empty column is and fix it accordingly.

For more info, please refer to this stackoverflow thread where a similar issue was discussed: https://stackoverflow.com/questions/65871486/azure-adf-copy-activity-with-trailing-column-delimiter

Hope this info helps. Do let us know if you have further query.



Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.

· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @felipecastaneda-0362,

We still have not heard back from you. Just wanted to check if the above suggestion was helpful? If it answers your query, please do click “Accept Answer” and/or Up-Vote, as it might be beneficial to other community members reading this thread.

And, if you have any further query do let us know.

0 Votes 0 ·