[GE users] Problems compiling hadoop SGE integration in SGE 62u5

goncalo goncalo at lip.pt
Thu Apr 1 16:44:36 BST 2010


Hi All...

I'm trying to compile  SGE 62u5, and it is failing in the hadoop SGE 
integration phase.

I have installed hadoop-0.20.2 under /usr/local/sge/hadoop-0.20.2, and I 
have set all the build.xml files:

[root at sge02 source]# cat build_private.properties | grep hadoop
hadoop.javac.source=1.6
hadoop.javac.target=1.6
hadoop.home=/usr/local/sge/hadoop-0.20.2/

[root at sge02 source]# cat libs/herd/build.xml | grep hadoop
<property name="hadoop.dir" value="${hadoop.home}"/>
<property name="javac.source" value="${hadoop.javac.source}"/>
<property name="javac.target" value="${hadoop.javac.target}"/>

[root at sge02 source]# cat libs/herd/nbproject/project.properties | grep 
hadoop.dir
hadoop.dir=/usr/local/sge/hadoop-0.20.2
file.reference.commons-cli-1.2.jar=${hadoop.dir}/lib/commons-cli-1.2.jar
file.reference.commons-codec-1.3.jar=${hadoop.dir}/lib/commons-codec-1.3.jar
file.reference.commons-el-1.0.jar=${hadoop.dir}/lib/commons-el-1.0.jar
file.reference.commons-httpclient-3.0.1.jar=${hadoop.dir}/lib/commons-httpclient-3.0.1.jar
file.reference.commons-logging-1.0.4.jar=${hadoop.dir}/lib/commons-logging-1.0.4.jar
file.reference.commons-logging-api-1.0.4.jar=${hadoop.dir}/lib/commons-logging-api-1.0.4.jar
file.reference.commons-net-1.4.1.jar=${hadoop.dir}/lib/commons-net-1.4.1.jar
file.reference.core-3.1.1.jar=${hadoop.dir}/lib/core-3.1.1.jar
file.reference.hadoop-0.20.1-core.jar=${hadoop.dir}/hadoop-0.20.1-core.jar
file.reference.hadoop-0.20.1-tools.jar=${hadoop.dir}/hadoop-0.20.1-tools.jar
file.reference.hsqldb-1.8.0.10.jar=${hadoop.dir}/lib/hsqldb-1.8.0.10.jar
file.reference.jasper-compiler-5.5.12.jar=${hadoop.dir}/lib/jasper-compiler-5.5.12.jar
file.reference.jasper-runtime-5.5.12.jar=${hadoop.dir}/lib/jasper-runtime-5.5.12.jar
file.reference.jets3t-0.6.1.jar=${hadoop.dir}/lib/jets3t-0.6.1.jar
file.reference.jetty-6.1.14.jar=${hadoop.dir}/lib/jetty-6.1.14.jar
file.reference.jetty-util-6.1.14.jar=${hadoop.dir}/lib/jetty-util-6.1.14.jar
file.reference.junit-3.8.1.jar=${hadoop.dir}/lib/junit-3.8.1.jar
file.reference.kfs-0.2.2.jar=${hadoop.dir}/lib/kfs-0.2.2.jar
file.reference.log4j-1.2.15.jar=${hadoop.dir}/lib/log4j-1.2.15.jar
file.reference.oro-2.0.8.jar=${hadoop.dir}/lib/oro-2.0.8.jar
file.reference.servlet-api-2.5-6.1.14.jar=${hadoop.dir}/lib/servlet-api-2.5-6.1.14.jar
file.reference.slf4j-api-1.4.3.jar=${hadoop.dir}/lib/slf4j-api-1.4.3.jar
file.reference.slf4j-log4j12-1.4.3.jar=${hadoop.dir}/lib/slf4j-log4j12-1.4.3.jar
file.reference.xmlenc-0.52.jar=${hadoop.dir}/lib/xmlenc-0.52.jar

Nevertheless, I'm missing something because the compilation aborts with 
the following message:

     [java]     [javac] Compiling 5 source files to 
/usr/local/sge/gridengine/source/CLASSES/herd/classes
      [java]     [javac] 
/usr/local/sge/gridengine/source/libs/herd/src/com/sun/grid/herd/HerdJsv.java:50: 
package org.apache.hadoop.conf does not exist
      [java]     [javac] import org.apache.hadoop.conf.Configuration;
      [java]     [javac]                              ^
      [java]     [javac] 
/usr/local/sge/gridengine/source/libs/herd/src/com/sun/grid/herd/HerdJsv.java:51: 
package org.apache.hadoop.conf does not exist
(...)

I'm missing ideas now... Any help is appreciated
Cheers
Goncalo

------------------------------------------------------
http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=252049

To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].

    [ Part 2, "S/MIME Cryptographic Signature" ]
    [ Application/PKCS7-SIGNATURE (Name: "smime.p7s") 2.7 KB. ]
    [ Unable to print this part. ]



More information about the gridengine-users mailing list