How to send large data files online

Large data files are often shared between technical teams and require specialized transfer tools.

Who sends large data files

Large data files are often shared between researchers, engineers, and analysts.

Why specialized services are used

Because these data files can be very large, specialized file transfer services are commonly used to deliver them efficiently.

Typical data deliveries

Field Typical material Size
Research Measurement series, simulation output 10 GB to several TB
Engineering CAD, BIM, sensor logs 5 to 50 GB
Analytics Database dumps, event logs 1 to 100 GB
Media Image and video corpora 50 GB and above
Life sciences Sequencing and imaging data 100 GB and above

Sending a dataset

  1. Archive many small files into one package to avoid per-file overhead.
  2. Include a plain-text description of the structure, format, and units.
  3. Upload over a wired connection, ideally outside peak hours.
  4. Set an expiration that covers the recipient's processing time, not just the download.
  5. Share the link, or keep the dataset in storage if several teams will need it.

What matters in data exchange

MyAirBridge transfers reach 250 GB on Pro and are unlimited on Enterprise, with storage kept in regional data centres in the EU, the United States and Asia.

FAQ

Why are large datasets not usually sent by email?

They are orders of magnitude beyond attachment limits, and email would also alter or block many of the file types involved.

Who typically transfers large datasets?

Researchers, engineers, analysts, and life science teams, often across institutions in different countries.

How large a dataset can be transferred?

Up to 250 GB per transfer on Pro, and without a limit on Enterprise.

Summary

Datasets need delivery that preserves integrity, carries documentation, and remains available long enough for processing to start. Archiving small files, transferring over stable connections, and keeping data in the user's own region cover the practical requirements of research and engineering exchange.