[GE users] File server overloading

Sean Davis sdavis2 at mail.nih.gov
Tue Jan 29 12:42:36 GMT 2008


    [ The following text is in the "UTF-8" character set. ]
    [ Your display is set for the "ISO-8859-10" character set.  ]
    [ Some characters may be displayed incorrectly. ]

On Jan 28, 2008 6:48 PM, Gary Thomas <gthomas at forteds.com> wrote:
>
>
>
>
> Does anyone have experience with using Redhat's GFS with SGE.  We are having
> problems where
> 15-20 execution hosts running jobs that reside on the same file server are
> overloading the server.
> We have 3 file servers and are thinking about using GFS to combine them into
> a file system so
> We can have all 60 of our execution hosts running off the same virtual file
> system.  We're looing
> At expanding to over 100 execution hosts in the near future and need a file
> server system that can
> Keep up.
>
> Any suggestions would be appreciated.

And have you looked at AFS (Andrew File System)?  It is designed with
caching of files locally in mind.  Obviously, such caching only makes
sense in certain job types, but it might be worth looking into.

Sean

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
For additional commands, e-mail: users-help at gridengine.sunsource.net




More information about the gridengine-users mailing list