Hello there,
I have a CSV file available in ADLS Gen 2 location. While trying to query the data from SQL server On-Prem, I am getting below error. I have another file, and it is working fine. What should I modify in the file format to get rid of this error.
Error:
HdfsBridge::recordReaderFillBuffer - Unexpected error encountered filling record reader buffer: HadoopExecutionException: No closing string delimiter.
File Format:
FORMAT_TYPE = DELIMITEDTEXT
, FORMAT_OPTIONS (FIELD_TERMINATOR = N',' , STRING_DELIMITER = N'"', DATE_FORMAT = N'yyyy-MM-dd HH:mm'
, USE_TYPE_DEFAULT = False)
CSV File Data:
b7b99200-b790-eb11-b1ac-000d3a9e5194,"4/7/2021 9:02:58 AM","4/7/2021 9:02:58 AM",0,1,,,,,,1,1,,1,1,,1,1,,1,1,,1,,1,False,False,False,,False,False,False,False,False,True,False,False,False,False,,,,,,,,,,,,,dba4ce79-af8c-eb11-b1ac-000d3a8efdd4,"systemuser",,,dba4ce79-af8c-eb11-b1ac-000d3a8efdd4,"systemuser",,,,,a7fd3dd7-fb36-eb11-a813-000d3a8b6b66,"businessunit",,,,,c788a9b1-2137-eb11-a813-000d3a8b6b66,"transactioncurrency",,,,,,,,,dba4ce79-af8c-eb11-b1ac-000d3a8efdd4,"systemuser",,,,,dba4ce79-af8c-eb11-b1ac-000d3a8efdd4,"systemuser",,2782500.0,,,,2782500.0,,,,,,,,,,,,,,,"2021-03-29T17:54:48Z",,,,,,,,,,,"2021-04-07T02:35:30Z",,,,,,,,"Corporation",,,,,,,1,,,,,,"2021-03-29T17:48:44.0000000+00:00",,1,,,,"S Raikar",,,,,,,,,,,,,63d61000-742e-46a1-a30f-e6ed720b1ff5,,,,,,1,,,,,,,,,,,,,,,,,,,,,,,,,,,,,"Raikar",,,,"2021-04-07T04:35:33Z",fe62b29c-e53b-4aac-b240-deba1f0f9350,,,,,,,,"001a000001GDSFjAAP",,,,7605457,b7b99200-b790-eb11-b1ac-000d3a9e5194,,,,,,"S Raikar",,,,,,1