question

Ald13 avatar image
0 Votes"
Ald13 asked ·

Fastest method to copy 500Gb table from On premise to Azure Sql database

I have a requirement to copy 500Gb table from On premise to Azure Sql database having 50DTU.
I tried import and export wizard but getting timeout error along with this msg:
The buffer manager detected that the system was low on virtual memory, but was unable to swap out any buffers. 14 buffers were considered and 14 were locked. Either not enough memory is available to the pipeline because not enough is installed, other processes are using it, or too many buffers are locked.
(SQL Server Import and Export Wizard)

what can be the fastest way for this?

azure-sql-database
· 1
10 |1000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Is that single table having 500gb data? You may also consider migrating whole database as well.

0 Votes 0 ·
Warrior-7682 avatar image
0 Votes"
Warrior-7682 answered ·

No Import export only works with folders and files. To upload or download that save all files to zip folder then you should be able to export smoothly

·
10 |1000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Mike-Ubezzi-MSFT avatar image
0 Votes"
Mike-Ubezzi-MSFT answered ·

Hi Ald13,

Use the bcp utility, It is super simple and can export on-premise and import to Azure SQL: BCP and SQL Azure

First, run the utility to export the data:

 bcp db.schema.table out C:\Users\user\Documents\GetDataFromSQLAzure.txt -c -U username@servername -S tcp:servername.host -P password

Then load that data file:

 bcp db.schema.table in C:\Users\user\Documents\MoveDataToSQLAzure.txt -c -U username@servername -S tcp:servername.database.windows.net -P password



·
10 |1000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.