question

SilipigniMarco-6786 avatar image
0 Votes"
SilipigniMarco-6786 asked Monalv-msft edited

HDFS modify row delimiter

Hi,
for maintain the standard in my HDFS i need to modify the row delimiter.
I use SSIS to get data from a DB and put in HDFS with the tool "Destination HDFS" , i need to replace the row delimiter from {CR}{LR} to {LR}.
The tool "Destination HDFS" not offer option to change this parameter.

Anyone know how to do for resolve this problem?


sql-server-integration-services
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

Monalv-msft avatar image
0 Votes"
Monalv-msft answered Monalv-msft edited

Hi @SilipigniMarco-6786 ,

We can set the expression [HDFS File Destination].[ColumnDelimiter] in the properties of Data Flow Task.

70422-dft-expression.png

Please refer to HDFS File Destination and Importing and Exporting data using SSIS Hadoop components.

Best regards,
Mona


If the answer is helpful, please click "Accept Answer" and upvote it.

Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.





dft-expression.png (29.0 KiB)
· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @Monalv-msft,
Thanks for the answer, but my problem, as explained in the question above, is not in the column delimiter, but in the row delimiter.

0 Votes 0 ·

Hi @SilipigniMarco-6786,

It seems that we cannot change row delimiter in HDFS File Destination now.

Please put forward your need in SQL Server Feedback.

71561-columndeli.png
71519-hdfs-properties.png

Best Regards,
Mona


0 Votes 0 ·
columndeli.png (15.0 KiB)
hdfs-properties.png (20.3 KiB)