Trying to export all failed (incompatible) rows for an input CSV file and was hoping I could use the output found in OperationItem, but I have found that in my example file the last two columns are swapped and there is an extra comma at the end. I'm using the correct double quote escaping, it just looks like ADF is changing the order of the CSV columns. Is this a bug?
The setting are here:
And I found it was the last two columns (could be others too).
Output from the logging when it skips incompatible rows:
NOTE: The error is because a field in the CSV exceeds the size of a SQL column.