When You Need to Transfer Petabytes to the Cloud, Amazon Will Send You This

 

When satellite imagery service DigitalGlobe wanted to transfer their archive to the cloud they had one, really big challenge.

The company has been collecting images of Earth since 2001. In that time they have collected more than 7 billion square kilometers of imagery, creating an archive that now consumes 100 petabytes (a single petabyte = 1000 TB) of storage and increases by 10 PB per year.

To upload that much data to the cloud through traditional means would take way too long and cost way too much. Enter AWS Snowmobile, a 45-foot long truck with up to 100 PB of storage capacity.

Amazon recommends Snowmobile for the cloud migration of datasets of 10PB or more in a single location. The ruggedized shipping container is tamper-resistant, water-resistant, temperature controlled, and GPS-tracked.
 
While each Snowmobile has a total capacity of up to 100 petabytes, up to 10 Snowmobiles can be used in parallel to transfer an exabyte of data (1 exabyte = 1000 petabytes).

Snowmobile is designed to transfer data at a rate up to 1 Tb/s, which means you could fill a 100PB Snowmobile in less than 10 days. The Snowmobile comes with a removable connector rack that needs to be mounted on one of your data center racks where it can be connected directly to your high-speed network backbone. The connector racks provides multiple 40Gb/s interfaces that can transfer up to 1 Tb/s in aggregate. [source]

Snowmobile uses multiple layers of security designed to protect your data including dedicated security personnel, GPS tracking, alarm monitoring, 24/7 video surveillance, and an optional escort security vehicle while in transit. All data is encrypted with 256-bit encryption keys managed through the AWS Key Management Service (KMS) and designed to ensure both security and full chain-of-custody of your data. [source]

Snowmobile jobs cost $0.005/GB/month based on the amount of provisioned Snowmobile storage capacity and the end to end duration of the job, which starts when a Snowmobile departs an AWS data center for delivery to the time when data ingestion into AWS is complete. For more information visit AWS Snowmobile.

 

 

These 360 TB Discs Will Last for 13.8 Billion Years

 

Using nanostructured glass, scientists from the University of Southampton’s Optoelectronics Research Centre (ORC) have developed the recording and retrieval processes of five dimensional (5D) digital data by femtosecond laser writing.

The storage allows unprecedented properties including 360 TB/disc data capacity, thermal stability up to 1,000°C and virtually unlimited lifetime at room temperature (13.8 billion years at 190°C) opening a new era of eternal data archiving. [source]

 

 

The technology was first experimentally demonstrated in 2013. Documents are recorded using ultrafast laser, producing extremely short and intense pulses of light. The file is written in three layers of nanostructured dots separated by five micrometres (one millionth of a metre).
 
The self-assembled nanostructures change the way light travels through glass, modifying polarisation of light that can then be read by combination of optical microscope and a polariser, similar to that found in Polaroid sunglasses. [source]

 

 

Coined as the ‘Superman memory crystal’, as the glass memory has been compared to the “memory crystals” used in the Superman films, the data is recorded via self-assembled nanostructures created in fused quartz. The information encoding is realised in five dimensions: the size and orientation in addition to the three dimensional position of these nanostructures.

Major documents from human history such as Universal Declaration of Human Rights (UDHR), Newton’s Opticks, Magna Carta and Kings James Bible, have been saved as digital copies that could survive the human race.

For more information visit the University of Southampton