question

CzarR-3851 avatar image
0 Votes"
CzarR-3851 asked Zoehui-MSFT answered

SSIS write a 60Gb data into Amazon S3

Hi, I am extracting data from a table that has 28 million rows and about 60Gb in size. We have CozyRoc suite. One way is to download the file to a local folder and then use CozyROC SFTP from there to move it to S3. Rather than downloading it to a local folder and moving it to S3, is there a way to directly write into S3?

We use SSH connection manager to connect to S3.

Please suggest. Thanks in advance.

sql-server-integration-services
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

Zoehui-MSFT avatar image
1 Vote"
Zoehui-MSFT answered

Hi @CzarR-3851,

Not familiar with Amazon S3 and the 3rd party tool.

Maybe you could try with script task to load data to S3.

Check this to see if it is helpful.

Regards,

Zoe


If the answer is the right solution, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".

Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.


5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.