[GE users] hadoop (0.20.1) integration with GE 6.2u5

chambon chambon at cc.in2p3.fr
Thu Dec 23 11:59:07 GMT 2010


I try to setup hadoop with GE 6.2u5
I carefully follow the process as described in "Beta Testing the Sun Grid Engine Hadoop Integration"
(for that matter, I can confirm that it's ok with hadoop 0.20.1 and I can't compile (classpath problem) with hadoop 0.20.2)

Every thing was ok, until I try to run the Loadsensor
With "setup.pl -i", complex and PE were created, but loadsensor wasn't lauched
If I 'manually' run  load_sensor.sh, nothing happens (the script exit immediately)

Looking inside load_sensor.sh, if I try :
 > hadoop --config $HADOOP_CONF_DIR com.sun.grid.herd.HerdLoadSensor `hostname`
Exception in thread "main" java.lang.NoClassDefFoundError: com/sun/grid/herd/HerdLoadSensor
Caused by: java.lang.ClassNotFoundException: com.sun.grid.herd.HerdLoadSensor

If I set the jar path (jar $SGE_ROOT/lib/herd.jar), I got a  NullPointerException

>  hadoop --config $HADOOP_CONF_DIR jar $SGE_ROOT/lib/herd.jar com.sun.grid.herd.HerdLoadSensor `hostname`
Dec 23, 2010 11:59:28 AM com.sun.grid.herd.HerdLoadSensor run
INFO: Started Herd load sensor
Dec 23, 2010 11:59:28 AM com.sun.grid.herd.HerdLoadSensor main
WARNING: Error while running command: java.lang.NullPointerException
        at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:134)
As someone encountered the same failure ?

Best regards


To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].

More information about the gridengine-users mailing list