Increasing resolution in sensor technology and advances in the computational sciences is leading to the generation of unprecedented amounts of data. For example, electron microscopy is now being used to image mouse brains, producing datasets on the order of 100,000 x 100,000 x 10,000; further modern computational methods utilize meshes consisting of billions of degrees of freedom, computed across tens of thousands of time steps. Such datasets can easily reach terabytes in size, with petabyte datasets now a reality.

News >