The log file data generated by the Copy Data activity in an Azure Synapse Pipeline appears to contain an extra \r character embedded within the Message field for Warning level lines, (while Info level lines do not exhibit this behavior.) We are aiming to ingest the log file data into a table, but the extra embedded carriage return character is causing the ingestion of the log data to fail.
Is there any work-around for how the log data from a Copy Data activity is written out?
A few sample lines from the logfile created by the Copy Activity are below. Note the carriage return preceding the date is correct "\r2021-08-19 15:47:41, while the carriage return embedded in the following string causes an additional line break, "gary"",""1"",""2\r"",","Column \'Prop"
Here are some sample logfile lines:
Timestamp,Level,OperationName,OperationItem,Message\r2021-08-19 15:47:41.1313523,Warning,TabularRowSkip,"""2"",""gary"",""1"",""2\r"",","Column \'Prop_2\' contains an invalid value \'1\'. Cannot convert \'1\' to type \'DateTime\'."\r2021-08-19 15:47:41.1313523,Warning,TabularRowSkip,"""3"",""gary"",""2"",""3\r"",","Column \'Prop_2\' contains an invalid value \'2\'. Cannot convert \'2\' to type \'DateTime\'."\r')]