[ale] A petabyte here, a petabyte there ...

[James P. Kinney III]

A friend of mine works at Fermi lab. The D0 project generates ~2TB every
of data in about .001 usec. This volume gets filtered down to about 10
GB through a huge pile of systems (my friend wrote some of the physics
event filtering code) and finally get dumped to an array of tape drives.

This process repeats every 20 seconds they have beam time.

On Fri, 2007-07-27 at 17:17 -0400, Greg Freemyer wrote:
> I've had 2 different client conversations in the last 2 days.
> 
> All I can say is "A petabyte here, a petabyte there, and pretty soon
> you're talking real data".
> 
> Seriously, one claimed to have 3 PB of unstructured data (office
> files, logs, etc.).  The other one was smaller.  They only had 1 PB of
> unstructured data.
> 
> I admit to being a little taken aback, especially the first time.  I
> guess it is time to add exabyte to my repertoire.  That way I can say,
> 
> "Oh.., only .1% of a Exabyte, sure our solution can handle that with
> no problem. (cough, cough) I was afraid you would need something
> large."
> 
> Are others starting to see numbers like that at the large Enterprise
> level?  (Both of these companies had multiple NAS units at multiple
> sites.  I think the biggest single NAS I heard of is 200TB so far.  I
> really had gotten away from these huge systems for while.  I guess I
> need a refresher about what's happening out there in the "enterprise
> world".)
> 
> Greg
> -- 
> Greg Freemyer
> The Norcross Group
> Forensics for the 21st Century
> _______________________________________________
> Ale mailing list
> Ale at ale.org
> http://www.ale.org/mailman/listinfo/ale
> 
-- 
James P. Kinney III          
CEO & Director of Engineering 
Local Net Solutions,LLC        
770-493-8244                    
http://www.localnetsolutions.com

GPG ID: 829C6CA7 James P. Kinney III (M.S. Physics)
<jkinney at localnetsolutions.com>
Fingerprint = 3C9E 6366 54FC A3FE BA4D 0659 6190 ADC3 829C 6CA7
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part