[GE users] Experiences with pvfs2

Craig Tierney ctierney at hypermall.net
Thu Oct 26 13:56:25 BST 2006


    [ The following text is in the "ISO-8859-1" character set. ]
    [ Your display is set for the "ISO-8859-10" character set.  ]
    [ Some special characters may be displayed incorrectly. ]

Bruno Mattarollo wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
> 
> You might want to have a look at Lustre [ http://clusterfs.com/ ], it's 
> open source and was designed for IO intensive scenarios.
> 

Lustre isn't a good option either.  It was design for large,sequential
IO like PVFS.  Its metadata performance is very poor.  A single compile
is painful, and since Lustre only support a single metadata server 
performance won't scale.

Craig





> /B
> 
> On 26/10/2006, at 10:39 PM, Craig Tierney wrote:
> 
>> You do not want PVFS2 for this.  PVFS2 was designed for large, 
>> sequential IO.  Its meta-data performance is very poor.  One
>> client compiling on a node is going to very slow, and overwhelm
>> the servers and any other processes (even if they are doing
>> large,sequential IO).
>>
>> There are options out there, but they are not free.  Products
>> like Ibrix, Panasas, Terascale, and Isilon are distributed filesystems.
> 
> - --bruno mattarollo <bruno.mattarollo at rsp.com.au>
> chief technology officer
> gnupg: 65A6 C94A 1978 9B42 6ED2 FBCE 1BD2 756B 3A80 D8FC
> - ----------------------------------------------------------------
> rising sun pictures -- http://www.rsp.com.au/
> - ----------------------------------------------------------------
> direct line +61 (0)2 9338 6483
> mobile ph +61 (0)405 354 474
> - ----------------------------------------------------------------
> syd tel +61 2 9338 6400 -- fax +61 2 9338 6401
> suite 15, 16 charles street, redfern, sydney, nsw 2016
> - ----------------------------------------------------------------
> adl tel +61 8 8400 6400 -- fax +61 8 8400 6401
> level 1, 180 pulteney street, adelaide, sa 5000
> - ----------------------------------------------------------------
> rising sun research -- http://www.risingsunresearch.com/
> - ----------------------------------------------------------------
> 
> 
> -----BEGIN PGP SIGNATURE-----
> 
> iEYEARECAAYFAkVArSQACgkQG9J1azqA2PwFWQCeLmijlY8OSnbewqS0Hwr1rCDy
> 2PAAoM+UAwv6+8QMqpZAsYmYBxjhgWx3
> =B7T/
> -----END PGP SIGNATURE-----
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
> For additional commands, e-mail: users-help at gridengine.sunsource.net
> 
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
For additional commands, e-mail: users-help at gridengine.sunsource.net




More information about the gridengine-users mailing list