[ale] A petabyte here, a petabyte there ...

[Chris Farris]

2TB/.001usec ?

I'd love to hear how they manage to capture that.

I just crossed the TB threshold on my home network. Yay Sol11 & ZFS!

Chris

James P. Kinney III wrote:
> A friend of mine works at Fermi lab. The D0 project generates ~2TB every
> of data in about .001 usec. This volume gets filtered down to about 10
> GB through a huge pile of systems (my friend wrote some of the physics
> event filtering code) and finally get dumped to an array of tape drives.
>
> This process repeats every 20 seconds they have beam time.
>
> On Fri, 2007-07-27 at 17:17 -0400, Greg Freemyer wrote:
>   
>> I've had 2 different client conversations in the last 2 days.
>>
>> All I can say is "A petabyte here, a petabyte there, and pretty soon
>> you're talking real data".
>>
>> Seriously, one claimed to have 3 PB of unstructured data (office
>> files, logs, etc.).  The other one was smaller.  They only had 1 PB of
>> unstructured data.
>>
>> I admit to being a little taken aback, especially the first time.  I
>> guess it is time to add exabyte to my repertoire.  That way I can say,
>>
>> "Oh.., only .1% of a Exabyte, sure our solution can handle that with
>> no problem. (cough, cough) I was afraid you would need something
>> large."
>>
>> Are others starting to see numbers like that at the large Enterprise
>> level?  (Both of these companies had multiple NAS units at multiple
>> sites.  I think the biggest single NAS I heard of is 200TB so far.  I
>> really had gotten away from these huge systems for while.  I guess I
>> need a refresher about what's happening out there in the "enterprise
>> world".)
>>
>> Greg
>> -- 
>> Greg Freemyer
>> The Norcross Group
>> Forensics for the 21st Century
>> _______________________________________________
>> Ale mailing list
>> Ale at ale.org
>> http://www.ale.org/mailman/listinfo/ale
>>
>>     
>> ------------------------------------------------------------------------
>>
>> _______________________________________________
>> Ale mailing list
>> Ale at ale.org
>> http://www.ale.org/mailman/listinfo/ale

-- 
Chris Farris				chris at vitalpowers dot com
The Exercise of Vital Powers		404 806 1403
http://www.vitalpowers.com