HDFS modify row delimiter

Question

question

SilipigniMarco-6786 asked Feb 19, '21 Monalv-msft edited Apr 7, '21

HDFS modify row delimiter

Hi,
for maintain the standard in my HDFS i need to modify the row delimiter.
I use SSIS to get data from a DB and put in HDFS with the tool "Destination HDFS" , i need to replace the row delimiter from {CR}{LR} to {LR}.
The tool "Destination HDFS" not offer option to change this parameter.

Anyone know how to do for resolve this problem?

sql-server-integration-services

5 |1600 characters needed characters left characters exceeded

Attachments: Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Answer 1 · 2021-02-22T02:06:53.947Z

Monalv-msft answered Feb 22, '21 Monalv-msft edited Apr 7, '21

Hi @SilipigniMarco-6786 ,

We can set the expression [HDFS File Destination].[ColumnDelimiter] in the properties of Data Flow Task.

Please refer to HDFS File Destination and Importing and Exporting data using SSIS Hadoop components.

Best regards,
Mona

If the answer is helpful, please click "Accept Answer" and upvote it.

Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

dft-expression.png (29.0 KiB)

· 2

5 |1600 characters needed characters left characters exceeded

Attachments: Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

SilipigniMarco-6786 · Feb 22, 2021 at 08:34 AM

Hi @Monalv-msft,
Thanks for the answer, but my problem, as explained in the question above, is not in the column delimiter, but in the row delimiter.

0 ·

Monalv-msft SilipigniMarco-6786 · Feb 24, 2021 at 10:01 AM

Hi @SilipigniMarco-6786,

It seems that we cannot change row delimiter in HDFS File Destination now.

Please put forward your need in SQL Server Feedback.

Best Regards,
Mona

0 ·

columndeli.png (15.0 KiB)

hdfs-properties.png (20.3 KiB)

question