[GE dev] Announcing Sun Grid Engine 6.2 Update 2 feature update release

brooks brooks at aero.org
Thu Mar 5 18:25:42 GMT 2009


On Thu, Mar 05, 2009 at 05:36:45PM +0100, andy wrote:
> Brooks,
> 
> > On Thu, Mar 05, 2009 at 04:36:32PM +0100, andy wrote:
> > > Brooks,
> > >
> > > you are right - my message could be misread by the innocent reader. Its
> > > FreeBSD origin certainly could have been mentioned.
> >
> > Would you mind adding something like "Jason Evans developed jemalloc for
> > use in FreeBSD where it was included in the 7.0 release" to the web
> > version of the release announcement.  Jason definitely deserves credit.
> 
> ok!

Thanks!

-- Brooks

> > > We used the code from the Mozilla project since it was ported to Linux.
> > >
> > > There were strange issues with the library on older Linux systems: since we
> > > uses the oldest supported system for compiling the Grid Engine binaries we
> > > ran into issues with the 32-bit binaries. That's the reason why the 32-bit
> > > Linux binaries do no use jemalloc.
> >
> > Odd, have you tried contacting Jason about this?  He's busy, but
> > generally pretty responsive.
> 
> no we haven't. I thinks it's not really important for the courtesy binaries -
> hardly anyone would today install a large scale high throughput cluster on a
> 32-bit capable CPU I guess.
> 
> Anyone compiling SGE for oneself still can build it with the jemalloc
> library and has good chances to get it running if the system is not too
> old.
> 
> Btw., our malloc lib evaluation included looking at libhoard - also good,
> but licensing difficulties and the Google malloc library - also (very), but
> non-portable at all due to it's use of assembler code.
> 
> Andy
> 
> 
> >
> > -- Brooks
> >
> > > Just wondering when the Linux community will take the challenge and decide
> > > to use an acceptable malloc library by default. It's quite annoying that end
> > > user software has to take care about such staff (and customers think the
> > > software is crappy and not ...)
> > >
> > > The good news is that when building SGE you can get a shared jealloc library
> > > for free:-):
> > >
> > >    % aimk -shared-libs -only-jemalloc"
> > >
> > > Then you just set $LD_PRELOAD and can examine/enjoy the benefits of a
> > > different malloc library on Linux for your own application.
> > >
> > > Andy
> > >
> > > > On Thu, Mar 05, 2009 at 02:56:28PM +0100, andy wrote:
> > > > > jemalloc Library
> > > > > ----------------
> > > > > Linux distributions (x64 platforms) come with a default memory allocator
> > > > > library which is not as efficient as the open source jemalloc memory
> > > > > allocator library also used by the Firefox browser. SGE 6.2 Update 2
> > > > > replaces the native Linux malloc library with the jemalloc library. This has
> > > > > a positive effect on the master host performance in large and high
> > > > > throughput Sun Grid Engine clusters on Linux and reduces the memory
> > > > > footprint up to 20%. This will lead to a significant performance increase.
> > > >
> > > > To give credit where it's due, jemalloc was originally written to be
> > > > the new FreeBSD malloc and became the default in 7.0.  The Firefox
> > > > team deserves credit for recognizing a good thing when they saw it and
> > > > providing testing which lead to significant improvements.
> > > >
> > > > -- Brooks
> > >
> > > ------------------------------------------------------
> > > http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=39&dsMessageId=121373
> > >
> > > To unsubscribe from this discussion, e-mail: [dev-unsubscribe at gridengine.sunsource.net].
> > >
> >
> > ------------------------------------------------------
> > http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=39&dsMessageId=121386
> >
> > To unsubscribe from this discussion, e-mail: [dev-unsubscribe at gridengine.sunsource.net].
> >
> 
> ------------------------------------------------------
> http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=39&dsMessageId=121412
> 
> To unsubscribe from this discussion, e-mail: [dev-unsubscribe at gridengine.sunsource.net].
>

------------------------------------------------------
http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=39&dsMessageId=121466

To unsubscribe from this discussion, e-mail: [dev-unsubscribe at gridengine.sunsource.net].



More information about the gridengine-users mailing list