Data transfer for large datasets with low or no network bandwidth

This article provides an overview of the data transfer solutions when you have limited to no network bandwidth in your environment and you are planning to transfer large data sets. The article also describes the recommended data transfer options and the respective key capability matrix for this scenario.

To understand an overview of all the available data transfer options, go to Choose an Azure data transfer solution.

Offline transfer or network transfer

Large datasets imply that you have few TBs to few PBs of data. You have limited to no network bandwidth, your network is slow, or it is unreliable. Also:

  • You are limited by costs of network transfer from your Internet Service Providers (ISPs).
  • Security or organizational policies do not allow outbound connections when dealing with sensitive data.

In all the above instances, use a physical device to do a one-time bulk data transfer. Choose from Data Box Disk, Data Box, Data Box Heavy devices which are supplied by Microsoft, or Import/Export using your own disks.

To confirm whether a physical device is the right option, use the following table. It shows the projected time for network data transfer, for various available bandwidths (assuming 90% utilization). If network transfer is projected to be too slow, you should use a physical device.

Network transfer or offline transfer

The options available in this scenario are devices for Azure Data Box offline transfer or Azure Import/Export.

  • Azure Data Box family for offline transfers – Use devices from Microsoft-supplied Data Box devices to move large amounts of data to Azure when you’re limited by time, network availability, or costs. Copy on-premises data using tools such as Robocopy. Depending on the data size intended for transfer, you can choose from Data Box Disk, Data Box, or Data Box Heavy.
  • Azure Import/Export – Use Azure Import/Export service by shipping your own disk drives to securely import large amounts of data to Azure Blob storage and Azure Files. This service can also be used to transfer data from Azure Blob storage to disk drives and ship to your on-premises sites.

Comparison of key capabilities

The following table summarizes the differences in key capabilities.

Data Box Disk Data Box Data Box Heavy Import/Export
Data size Up to 35 TBs Up to 80 TBs per device Up to 800 TB per device Variable
Data type Azure Blobs Azure Blobs
Azure Files
Azure Blobs
Azure Files
Azure Blobs
Azure Files
Form factor 5 SSDs per order 1 X 50-lbs. desktop-sized device per order 1 X ~500-lbs. large device per order Up to 10 HDDs/SSDs per order
Initial setup time Low
(15 mins)
Low to moderate
(<30 mins)
Moderate
(1-2 hours)
Moderate to difficult
(variable)
Send data to Azure Yes Yes Yes Yes
Export data from Azure No No No Yes
Encryption AES 128-bit AES 256-bit AES 256-bit AES 128-bit
Hardware Microsoft supplied Microsoft supplied Microsoft supplied Customer supplied
Network interface USB 3.1/SATA RJ 45, SFP+ RJ45, QSFP+ SATA II/SATA III
Partner integration Some High High Some
Shipping Microsoft managed Microsoft managed Microsoft managed Customer managed
Use when data moves Within a commerce boundary Within a commerce boundary Within a commerce boundary Across geographic boundaries, e.g. US to EU
Pricing Pricing Pricing Pricing Pricing

Next steps