hama-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raied Salman <salm...@vcu.edu>
Subject Re: help in installing Hama / Zookeeper
Date Wed, 13 Jan 2010 17:15:25 GMT
Thanks for the detailed instructions. However, I followed your instructions
but still I am having the following error


(*10/01/13 11:58:41 INFO mapred.JobClient: Task Id :
attempt_201001131136_0004_r_000000_2, Status : FAILED*

*Error: java.lang.ClassNotFoundException: org.apache.zookeeper.Watcher)*:
* *

I am running the rand example as follows:



*root@vcuhadoop3:~/hama/bin# ./hama examples rand 20 20 20% MATR*

*10/01/13 11:57:46 INFO zookeeper.ZooKeeper: Client
environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT*

*10/01/13 11:57:46 INFO zookeeper.ZooKeeper: Client environment:host.name
=vcuhadoop3*

*10/01/13 11:57:46 INFO zookeeper.ZooKeeper: Client
environment:java.version=1.6.0_17*

*10/01/13 11:57:46 INFO zookeeper.ZooKeeper: Client
environment:java.vendor=Sun Microsystems Inc.*

*10/01/13 11:57:46 INFO zookeeper.ZooKeeper: Client
environment:java.home=/usr/lib/jvm/jdk1.6.0_17/jre*

*10/01/13 11:57:46 INFO zookeeper.ZooKeeper: Client
environment:java.class.path=/root/hama/bin/../conf:/usr/lib/jvm/jdk1.6.0_17/lib/tools.jar:/root/hama/build/classes:/root/hama/build/test:/root/hama/build:/root/hama/hama-0.2.0-dev-examples.jar:/root/hama/hama-0.2.0-dev.jar:/root/hama/hama-0.2.0-dev-test.jar:/root/hama/lib/AgileJSON-2009-03-30.jar:/root/hama/lib/commons-cli-2.0-SNAPSHOT.jar:/root/hama/lib/commons-el-from-jetty-5.1.4.jar:/root/hama/lib/commons-httpclient-3.0.1.jar:/root/hama/lib/commons-logging-1.0.4.jar:/root/hama/lib/commons-logging-api-1.0.4.jar:/root/hama/lib/commons-math-1.1.jar:/root/hama/lib/hadoop-0.20.1-core.jar:/root/hama/lib/hadoop-0.20.1-test.jar:/root/hama/lib/hbase-0.20.2.jar:/root/hama/lib/hbase-0.20.2-test.jar:/root/hama/lib/jasper-compiler-5.5.12.jar:/root/hama/lib/jasper-runtime-5.5.12.jar:/root/hama/lib/javacc.jar:/root/hama/lib/jetty-6.1.14.jar:/root/hama/lib/jetty-util-6.1.14.jar:/root/hama/lib/jruby-complete-1.2.0.jar:/root/hama/lib/json.jar:/root/hama/lib/junit-3.8.1.jar:/root/hama/lib/libthrift-r771587.jar:/root/hama/lib/log4j-1.2.13.jar:/root/hama/lib/log4j-1.2.15.jar:/root/hama/lib/servlet-api-2.5-6.1.14.jar:/root/hama/lib/xmlenc-0.52.jar:/root/hama/lib/zookeeper-3.2.2.jar:/root/hama/lib/jetty-ext/*.jar:/root/hama/lib/findbugs/annotations.jar:/root/hama/lib/findbugs/ant.jar:/root/hama/lib/findbugs/asm-3.0.jar:/root/hama/lib/findbugs/asm-analysis-3.0.jar:/root/hama/lib/findbugs/asm-commons-3.0.jar:/root/hama/lib/findbugs/asm-tree-3.0.jar:/root/hama/lib/findbugs/asm-util-3.0.jar:/root/hama/lib/findbugs/asm-xml-3.0.jar:/root/hama/lib/findbugs/bcel.jar:/root/hama/lib/findbugs/dom4j-full.jar:/root/hama/lib/findbugs/findbugs-ant.jar:/root/hama/lib/findbugs/findbugsGUI.jar:/root/hama/lib/findbugs/findbugs.jar:/root/hama/lib/findbugs/jsr305.jar:/root/hama/lib/findbugs/plugin/coreplugin.jar:/root/hadoop-0.20.1/conf:/root/hbase-0.20.2/conf
*

*10/01/13 11:57:46 INFO zookeeper.ZooKeeper: Client
environment:java.library.path=/usr/lib/jvm/jdk1.6.0_17/jre/lib/i386/client:/usr/lib/jvm/jdk1.6.0_17/jre/lib/i386:/usr/lib/jvm/jdk1.6.0_17/jre/../lib/i386:/usr/java/packages/lib/i386:/lib:/usr/lib
*

*10/01/13 11:57:46 INFO zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/tmp*

*10/01/13 11:57:46 INFO zookeeper.ZooKeeper: Client
environment:java.compiler=<NA>*

*10/01/13 11:57:46 INFO zookeeper.ZooKeeper: Client environment:os.name
=Linux*

*10/01/13 11:57:46 INFO zookeeper.ZooKeeper: Client environment:os.arch=i386
*

*10/01/13 11:57:46 INFO zookeeper.ZooKeeper: Client
environment:os.version=2.6.31-14-generic*

*10/01/13 11:57:46 INFO zookeeper.ZooKeeper: Client environment:user.name
=root*

*10/01/13 11:57:46 INFO zookeeper.ZooKeeper: Client
environment:user.home=/root*

*10/01/13 11:57:46 INFO zookeeper.ZooKeeper: Client
environment:user.dir=/root/hama/bin*

*10/01/13 11:57:46 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=vcuhadoop3:2181 sessionTimeout=60000
watcher=org.apache.hadoop.hbase.client.HConnectionManager$ClientZKWatcher@5d173
*

*10/01/13 11:57:46 INFO zookeeper.ClientCnxn:
zookeeper.disableAutoWatchReset is false*

*10/01/13 11:57:46 INFO zookeeper.ClientCnxn: Attempting connection to
server vcuhadoop3/128.172.192.168:2181*

*10/01/13 11:57:46 INFO zookeeper.ClientCnxn: Priming connection to
java.nio.channels.SocketChannel[connected
local=/128.172.192.168:42766remote=vcuhadoop3/
128.172.192.168:2181]*

*10/01/13 11:57:46 INFO zookeeper.ClientCnxn: Server connection successful*

*2010-01-13 11:57:46,564 - INFO
[NIOServerCxn.Factory:2181:NIOServerCnxn@607] - Connected to /
128.172.192.168:42766 lastZxid 0*

*2010-01-13 11:57:46,565 - INFO
[NIOServerCxn.Factory:2181:NIOServerCnxn@639] - Creating new session
0x126288bc7a60005*

*2010-01-13 11:57:46,599 - INFO  [SyncThread:0:NIOServerCnxn@992] - Finished
init of 0x126288bc7a60005 valid:true*

*2010-01-13 11:57:47,073 - WARN  [ProcessThread:-1:PrepRequestProcessor@402]
- Got exception when processing sessionid:0x126288bc7a60005 type:create
cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown n/a*

*org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode =
NodeExists*

*        at
org.apache.zookeeper.server.PrepRequestProcessor.pRequest(PrepRequestProcessor.java:245)
*

*        at
org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:114)
*

*10/01/13 11:57:47 INFO matrix.AbstractMatrix: Initializing the matrix
storage.*

*2010-01-13 11:57:47,520 - WARN  [ProcessThread:-1:PrepRequestProcessor@402]
- Got exception when processing sessionid:0x126288bc7a60005 type:create
cxid:0x5 zxid:0xfffffffffffffffe txntype:unknown n/a*

*org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode =
NodeExists*

*        at
org.apache.zookeeper.server.PrepRequestProcessor.pRequest(PrepRequestProcessor.java:245)
*

*        at
org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:114)
*

*10/01/13 11:57:53 INFO matrix.AbstractMatrix: Create Matrix
SparseMatrix_randowbnz*

*10/01/13 11:57:53 INFO matrix.AbstractMatrix: Create the 20 * 20 random
matrix : SparseMatrix_randowbnz*

*Wrote input for Map #0*

*Wrote input for Map #1*

*10/01/13 11:57:54 WARN mapred.JobClient: Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the same.*

*10/01/13 11:57:54 INFO input.FileInputFormat: Total input paths to process
: 2*

*10/01/13 11:57:55 INFO mapred.JobClient: Running job: job_201001131136_0004
*

*10/01/13 11:57:56 INFO mapred.JobClient:  map 0% reduce 0%*

*10/01/13 11:58:06 INFO mapred.JobClient:  map 100% reduce 0%*

*10/01/13 11:58:17 INFO mapred.JobClient: Task Id :
attempt_201001131136_0004_r_000000_0, Status : FAILED*

*Error: java.lang.ClassNotFoundException: org.apache.zookeeper.Watcher*

*        at java.net.URLClassLoader$1.run(URLClassLoader.java:200)*

*        at java.security.AccessController.doPrivileged(Native Method)*

*        at java.net.URLClassLoader.findClass(URLClassLoader.java:188)*

*        at java.lang.ClassLoader.loadClass(ClassLoader.java:303)*

*        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)*

*        at java.lang.ClassLoader.loadClass(ClassLoader.java:248)*

*        at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:316)*

*        at java.lang.ClassLoader.defineClass1(Native Method)*

*        at java.lang.ClassLoader.defineClass(ClassLoader.java:616)*

*        at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)*

*        at java.net.URLClassLoader.defineClass(URLClassLoader.java:260)*

*        at java.net.URLClassLoader.access$000(URLClassLoader.java:56)*

*        at java.net.URLClassLoader$1.run(URLClassLoader.java:195)*

*        at java.security.AccessController.doPrivileged(Native Method)*

*        at java.net.URLClassLoader.findClass(URLClassLoader.java:188)*

*        at java.lang.ClassLoader.loadClass(ClassLoader.java:303)*

*        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)*

*        at java.lang.ClassLoader.loadClass(ClassLoader.java:248)*

*        at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:316)*

*        at
org.apache.hadoop.hbase.client.HConnectionManager.getClientZooKeeperWatcher(HConnectionManager.java:151)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getZooKeeperWrapper(HConnectionManager.java:886)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:902)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:581)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:557)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:631)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:590)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:557)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:631)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:594)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:557)
*

*        at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:127)*

*        at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:105)*

*        at
org.apache.hadoop.hbase.mapreduce.TableOutputFormat.getRecordWriter(TableOutputFormat.java:116)
*

*        at
org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:553)*

*        at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)*

*        at org.apache.hadoop.mapred.Child.main(Child.java:170)*

* *

*10/01/13 11:58:28 INFO mapred.JobClient: Task Id :
attempt_201001131136_0004_r_000000_1, Status : FAILED*

*Error: java.lang.ClassNotFoundException: org.apache.zookeeper.Watcher*

*        at java.net.URLClassLoader$1.run(URLClassLoader.java:200)*

*        at java.security.AccessController.doPrivileged(Native Method)*

*        at java.net.URLClassLoader.findClass(URLClassLoader.java:188)*

*        at java.lang.ClassLoader.loadClass(ClassLoader.java:303)*

*        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)*

*        at java.lang.ClassLoader.loadClass(ClassLoader.java:248)*

*        at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:316)*

*        at java.lang.ClassLoader.defineClass1(Native Method)*

*        at java.lang.ClassLoader.defineClass(ClassLoader.java:616)*

*        at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)*

*        at java.net.URLClassLoader.defineClass(URLClassLoader.java:260)*

*        at java.net.URLClassLoader.access$000(URLClassLoader.java:56)*

*        at java.net.URLClassLoader$1.run(URLClassLoader.java:195)*

*        at java.security.AccessController.doPrivileged(Native Method)*

*        at java.net.URLClassLoader.findClass(URLClassLoader.java:188)*

*        at java.lang.ClassLoader.loadClass(ClassLoader.java:303)*

*        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)*

*        at java.lang.ClassLoader.loadClass(ClassLoader.java:248)*

*        at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:316)*

*        at
org.apache.hadoop.hbase.client.HConnectionManager.getClientZooKeeperWatcher(HConnectionManager.java:151)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getZooKeeperWrapper(HConnectionManager.java:886)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:902)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:581)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:557)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:631)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:590)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:557)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:631)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:594)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:557)
*

*        at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:127)*

*        at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:105)*

*        at
org.apache.hadoop.hbase.mapreduce.TableOutputFormat.getRecordWriter(TableOutputFormat.java:116)
*

*        at
org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:553)*

*        at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)*

*        at org.apache.hadoop.mapred.Child.main(Child.java:170)*

* *

*10/01/13 11:58:41 INFO mapred.JobClient: Task Id :
attempt_201001131136_0004_r_000000_2, Status : FAILED*

*Error: java.lang.ClassNotFoundException: org.apache.zookeeper.Watcher*

*        at java.net.URLClassLoader$1.run(URLClassLoader.java:200)*

*        at java.security.AccessController.doPrivileged(Native Method)*

*        at java.net.URLClassLoader.findClass(URLClassLoader.java:188)*

*        at java.lang.ClassLoader.loadClass(ClassLoader.java:303)*

*        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)*

*        at java.lang.ClassLoader.loadClass(ClassLoader.java:248)*

*        at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:316)*

*        at java.lang.ClassLoader.defineClass1(Native Method)*

*        at java.lang.ClassLoader.defineClass(ClassLoader.java:616)*

*        at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)*

*        at java.net.URLClassLoader.defineClass(URLClassLoader.java:260)*

*        at java.net.URLClassLoader.access$000(URLClassLoader.java:56)*

*        at java.net.URLClassLoader$1.run(URLClassLoader.java:195)*

*        at java.security.AccessController.doPrivileged(Native Method)*

*        at java.net.URLClassLoader.findClass(URLClassLoader.java:188)*

*        at java.lang.ClassLoader.loadClass(ClassLoader.java:303)*

*        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)*

*        at java.lang.ClassLoader.loadClass(ClassLoader.java:248)*

*        at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:316)*

*        at
org.apache.hadoop.hbase.client.HConnectionManager.getClientZooKeeperWatcher(HConnectionManager.java:151)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getZooKeeperWrapper(HConnectionManager.java:886)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:902)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:581)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:557)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:631)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:590)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:557)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:631)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:594)
*

*        at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:557)
*

*        at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:127)*

*        at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:105)*

*        at
org.apache.hadoop.hbase.mapreduce.TableOutputFormat.getRecordWriter(TableOutputFormat.java:116)
*

*        at
org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:553)*

*        at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)*

*        at org.apache.hadoop.mapred.Child.main(Child.java:170)*

* *

*10/01/13 11:58:56 INFO mapred.JobClient: Job complete:
job_201001131136_0004*

*10/01/13 11:58:56 INFO mapred.JobClient: Counters: 12*

*10/01/13 11:58:56 INFO mapred.JobClient:   Job Counters*

*10/01/13 11:58:56 INFO mapred.JobClient:     Launched reduce tasks=4*

*10/01/13 11:58:56 INFO mapred.JobClient:     Launched map tasks=2*

*10/01/13 11:58:56 INFO mapred.JobClient:     Data-local map tasks=2*

*10/01/13 11:58:56 INFO mapred.JobClient:     Failed reduce tasks=1*

*10/01/13 11:58:56 INFO mapred.JobClient:   FileSystemCounters*

*10/01/13 11:58:56 INFO mapred.JobClient:     HDFS_BYTES_READ=216*

*10/01/13 11:58:56 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=2106*

*10/01/13 11:58:56 INFO mapred.JobClient:   Map-Reduce Framework*

*10/01/13 11:58:56 INFO mapred.JobClient:     Combine output records=0*

*10/01/13 11:58:56 INFO mapred.JobClient:     Map input records=2*

*10/01/13 11:58:56 INFO mapred.JobClient:     Spilled Records=20*

*10/01/13 11:58:56 INFO mapred.JobClient:     Map output bytes=1990*

*10/01/13 11:58:56 INFO mapred.JobClient:     Combine input records=0*

*10/01/13 11:58:56 INFO mapred.JobClient:     Map output records=20*

*2010-01-13 11:58:56,598 - WARN
[NIOServerCxn.Factory:2181:NIOServerCnxn@518] - Exception causing close of
session 0x126288bc7a60005 due to java.io.IOException: Read error*

*root@vcuhadoop3:~/hama/bin# 2010-01-13 11:58:56,658 - INFO
[NIOServerCxn.Factory:2181:NIOServerCnxn@857] - closing
session:0x126288bc7a60005 NIOServerCnxn:
java.nio.channels.SocketChannel[connected local=/128.172.192.168:2181remote=/
128.172.192.168:42766]*

*2010-01-13 11:59:36,000 - INFO  [SessionTracker:SessionTrackerImpl@133] -
Expiring session 0x126288bc7a60005*

*2010-01-13 11:59:36,001 - INFO  [SessionTracker:ZooKeeperServer@326] -
Expiring session 0x126288bc7a60005*

*2010-01-13 11:59:36,001 - INFO  [ProcessThread:-1:PrepRequestProcessor@384]
- Processed session termination request for id: 0x126288bc7a60005*

* *

The jps indicate that all processes are running hadoop/hbase/hama/zookeeper:

* *

*root@vcuhadoop3:~/hbase-0.20.2/conf# jps*

*15606 JobTracker*

*15741 TaskTracker*

*15843 QuorumPeerMain*

*16327 HamaMaster*

*16084 HMaster*

*15236 NameNode*

*15529 SecondaryNameNode*

*15377 DataNode*

*19575 Jps*

* *

Any feedback will be helpful



Raied


On Tue, Jan 12, 2010 at 8:55 PM, Edward J. Yoon <edwardyoon@apache.org>wrote:

> Hi,
> Try the following commands:
>
> 1) download hama
>
> [root@udanax src]# ls
> hbase-0.20.2
> zookeeper-3.2.2
> hadoop-0.20.1
>
> [root@udanax src]# svn checkout
> http://svn.apache.org/repos/asf/incubator/hama/trunk hama-trunk
> [root@udanax src]# rm -rf hama-trunk/lib/hbase*.jar
> [root@udanax src]# rm -rf hama-trunk/lib/zookeeper*.jar
> [root@udanax src]# cp hbase-0.20.2/hbase*.jar hama-trunk/lib
> [root@udanax src]# cp zookeeper-3.2.2/zoo**.jar hama-trunk/lib
> [root@udanax src]# cd hama-trunk
> [root@udanax src]# ant package
> [root@udanax src]# cp build/*.jar ./
>
> 2) start hadoop
>
> [root@udanax src]# cp hbase-0.20.2/hbase-0.20.2*.jar hadoop-0.20.1/lib
> [root@udanax src]# cp hama-trunk/hama-0.2.0-dev*.jar hadoop-0.20.1/lib
> [root@udanax src]# hadoop-0.20.1/bin/start-all.sh
> [root@udanax src]# ps -ef | grep hama
>
> root     28643     1 10 04:39 ?        00:00:01
> /usr/java/jdk1.6.0_17/bin/java -Xmx2000m
> -Dhadoop.log.dir=/usr/local/src/hadoop-0.20.1/bin/../logs
> -Dhadoop.log.file=hadoop-root-tasktracker-udanax.org.log
> -Dhadoop.home.dir=/usr/local/src/hadoop-0.20.1/bin/..
> -Dhadoop.id.str=root -Dhadoop.root.logger=INFO,DRFA
>
> -Djava.library.path=/usr/local/src/hadoop-0.20.1/bin/../lib/native/Linux-i386-32
> -Dhadoop.policy.file=hadoop-policy.xml -classpath
> ...
>
> n/../lib/hama-0.2.0-dev-examples.jar:/usr/local/src/hadoop-0.20.1/bin/../lib/hama-0.2.0-dev-test.jar:/usr/local/src/hadoop-0.20.1/bin/../lib/hama-0.2.0-dev.jar:/usr/local/src/hadoop-0.20.1/bin/../lib/hbase-0.20.2-test.jar:/usr/local/src/hadoop-0.20.1/bin/../lib/hbase-0.20.2.jar:/usr/local/src/hadoop-0.20.1/bin/../lib/hsqldb-1.8.0.10.jar:/usr/local/src/hadoop-0.20.1/bin/../lib/jasper-compiler-5.5.12.jar:/usr/local/src/hadoop-0.20.1/bin/../lib/jasper-runtime-5.5.12.jar:/usr/local/src/hadoop-0.20.1/bin/../lib/jets3t-0.6.1.jar:/usr/local/src/hadoop-0.20.1/bin/../lib/jetty-6.1.14.jar:/usr/local/src/hadoop-0.20.1/bin/../lib/jetty-util-6.1.14.jar:/usr/local/src/hadoop-0.20.1/bin/../
> ...
> org.apache.hadoop.mapred.TaskTracker
>
> 3) start zookeeper
>
> [root@udanax src]# zookeeper-3.2.2/bin/zkServer.sh start
> ...
>
> [root@udanax src]# zookeeper-3.2.2/bin/zkServer.sh status
> JMX enabled by default
> Using config: /usr/local/src/zookeeper-3.2.2/bin/../conf/zoo.cfg
> 2010-01-14 04:43:42,640 - INFO
> [NIOServerCxn.Factory:2181:NIOServerCnxn@722] - Processing stat
> command from /127.0.0.1:47624
> 2010-01-14 04:43:42,643 - WARN
> [NIOServerCxn.Factory:2181:NIOServerCnxn@518] - Exception causing
> close of session 0x0 due to java.io.IOException: Responded to info
> probe
> 2010-01-14 04:43:42,644 - INFO
> [NIOServerCxn.Factory:2181:NIOServerCnxn@857] - closing session:0x0
> NIOServerCnxn: java.nio.channels.SocketChannel[connected
> local=/127.0.0.1:2181 remote=/127.0.0.1:47624]
> Mode: standalone
>
> 4) start hbase
>
> [root@udanax src]# hbase-0.20.2/bin/start-hbase.sh
> udanax.org: starting zookeeper, logging to
> /usr/local/src/hbase-0.20.2/bin/../logs/hbase-root-zookeeper-udanax.org.out
> starting master, logging to
> /usr/local/src/hbase-0.20.2/bin/../logs/hbase-root-master-udanax.org.out
> udanax.org: starting regionserver, logging to
>
> /usr/local/src/hbase-0.20.2/bin/../logs/hbase-root-regionserver-udanax.org.out
>
> 5) start hama example
>
> [root@udanax src]# hama-trunk/bin/hama examples rand 20 20 20% tmp
> ....
> 10/01/14 04:44:54 INFO zookeeper.ClientCnxn: Server connection successful
> 10/01/14 04:44:54 INFO matrix.AbstractMatrix: Initializing the matrix
> storage.
> 10/01/14 04:45:01 INFO matrix.AbstractMatrix: Create Matrix
> SparseMatrix_randehogu
> 10/01/14 04:45:01 INFO matrix.AbstractMatrix: Create the 20 * 20
> random matrix : SparseMatrix_randehogu
> Wrote input for Map #0
> Wrote input for Map #1
> Wrote input for Map #2
>
> On Wed, Jan 13, 2010 at 4:31 AM, Raied Salman <salmanr@vcu.edu> wrote:
> > Dear all,
> >
> > I have one node cluster running with hadoop 0.20.1 (the pi example is
> > running). I also installed Hbase 0.20.2 and is working good as well (I
> > managed to create tables).
> >
> > Finally I tried to install “hama” which requested “zookeeper”. I am not
> able
> > to run any example in hama such as:
> >
> > bin/hama examples rand –m 10 –r 10 2000 2000 30.5% matrixA
> >
> >
> >
> > The errors I am getting are:
> >
> > *root@vcuhadoop3:~/hama/bin# ./hama examples rand -m 2 -r 1 10 10 30%
> QQ*
> >
> > *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> > environment:zookeeper.version=3.2.1-808558, built on 08/27/2009 18:48
> GMT*
> >
> > *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client environment:
> host.name
> > =vcuhadoop3*
> >
> > *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> > environment:java.version=1.6.0_17*
> >
> > *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> > environment:java.vendor=Sun Microsystems Inc.*
> >
> > *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> > environment:java.home=/usr/lib/jvm/jdk1.6.0_17/jre*
> >
> > *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> >
> environment:java.class.path=/root/hama/bin/../conf:/usr/lib/jvm/jdk1.6.0_17/lib/tools.jar:/root/hama/build/classes:/root/hama/build/test:/root/hama/build:/root/hama/hama-0.2.0-dev-examples.jar:/root/hama/hama-0.2.0-dev.jar:/root/hama/hama-0.2.0-dev-test.jar:/root/hama/lib/AgileJSON-2009-03-30.jar:/root/hama/lib/commons-cli-2.0-SNAPSHOT.jar:/root/hama/lib/commons-el-from-jetty-5.1.4.jar:/root/hama/lib/commons-httpclient-3.0.1.jar:/root/hama/lib/commons-logging-1.0.4.jar:/root/hama/lib/commons-logging-api-1.0.4.jar:/root/hama/lib/commons-math-1.1.jar:/root/hama/lib/hadoop-0.20.1-core.jar:/root/hama/lib/hadoop-0.20.1-test.jar:/root/hama/lib/hbase-0.20.0.jar:/root/hama/lib/hbase-0.20.0-test.jar:/root/hama/lib/jasper-compiler-5.5.12.jar:/root/hama/lib/jasper-runtime-5.5.12.jar:/root/hama/lib/javacc.jar:/root/hama/lib/jetty-6.1.14.jar:/root/hama/lib/jetty-util-6.1.14.jar:/root/hama/lib/jruby-complete-1.2.0.jar:/root/hama/lib/json.jar:/root/hama/lib/junit-3.8.1.jar:/root/hama/lib/libthrift-r771587.jar:/root/hama/lib/log4j-1.2.13.jar:/root/hama/lib/log4j-1.2.15.jar:/root/hama/lib/servlet-api-2.5-6.1.14.jar:/root/hama/lib/xmlenc-0.52.jar:/root/hama/lib/zookeeper-3.2.1.jar:/root/hama/lib/jetty-ext/*.jar:/root/hama/lib/findbugs/annotations.jar:/root/hama/lib/findbugs/ant.jar:/root/hama/lib/findbugs/asm-3.0.jar:/root/hama/lib/findbugs/asm-analysis-3.0.jar:/root/hama/lib/findbugs/asm-commons-3.0.jar:/root/hama/lib/findbugs/asm-tree-3.0.jar:/root/hama/lib/findbugs/asm-util-3.0.jar:/root/hama/lib/findbugs/asm-xml-3.0.jar:/root/hama/lib/findbugs/bcel.jar:/root/hama/lib/findbugs/dom4j-full.jar:/root/hama/lib/findbugs/findbugs-ant.jar:/root/hama/lib/findbugs/findbugsGUI.jar:/root/hama/lib/findbugs/findbugs.jar:/root/hama/lib/findbugs/jsr305.jar:/root/hama/lib/findbugs/plugin/coreplugin.jar:/root/hadoop-0.20.1/conf:/root/hbase-0.20.2/conf
> > *
> >
> > *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> >
> environment:java.library.path=/usr/lib/jvm/jdk1.6.0_17/jre/lib/i386/client:/usr/lib/jvm/jdk1.6.0_17/jre/lib/i386:/usr/lib/jvm/jdk1.6.0_17/jre/../lib/i386:/usr/java/packages/lib/i386:/lib:/usr/lib
> > *
> >
> > *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> > environment:java.io.tmpdir=/tmp*
> >
> > *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> > environment:java.compiler=<NA>*
> >
> > *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client environment:os.name
> > =Linux*
> >
> > *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> environment:os.arch=i386
> > *
> >
> > *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> > environment:os.version=2.6.31-14-generic*
> >
> > *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client environment:
> user.name
> > =root*
> >
> > *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> > environment:user.home=/root*
> >
> > *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> > environment:user.dir=/root/hama/bin*
> >
> > *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Initiating client
> connection,
> > connectString=localhost:2181 sessionTimeout=60000
> >
> watcher=org.apache.hadoop.hbase.client.HConnectionManager$ClientZKWatcher@a32b
> > *
> >
> > *10/01/12 13:08:22 INFO zookeeper.ClientCnxn:
> > zookeeper.disableAutoWatchReset is false*
> >
> > *10/01/12 13:08:22 INFO zookeeper.ClientCnxn: Attempting connection to
> > server localhost/127.0.0.1:2181*
> >
> > *10/01/12 13:08:22 INFO zookeeper.ClientCnxn: Priming connection to
> > java.nio.channels.SocketChannel[connected
> > local=/127.0.0.1:34973remote=localhost/
>  > 127.0.0.1:2181]*
> >
> > *10/01/12 13:08:22 INFO zookeeper.ClientCnxn: Server connection
> successful*
> >
> > *10/01/12 13:08:22 INFO client.HConnectionManager$TableServers: getMaster
> > attempt 0 of 10 failed; retrying after sleep of 2000*
> >
> > *java.io.IOException:
> org.apache.zookeeper.KeeperException$NoNodeException:
> > KeeperErrorCode = NoNode for /hbase/master*
> >
> > *        at
> >
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.readAddressOrThrow(ZooKeeperWrapper.java:331)
> > *
> >
> > *        at
> >
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.readMasterAddressOrThrow(ZooKeeperWrapper.java:240)
> > *
> >
> > *        at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getMaster(HConnectionManager.java:315)
> > *
> >
> > *        at
> > org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:72)*
> >
> > *        at
> >
> org.apache.hama.matrix.AbstractMatrix.setConfiguration(AbstractMatrix.java:91)
> > *
> >
> > *        at
> org.apache.hama.matrix.SparseMatrix.<init>(SparseMatrix.java:62)
> > *
> >
> > *        at
> > org.apache.hama.matrix.SparseMatrix.random_mapred(SparseMatrix.java:122)*
> >
> > *        at
> org.apache.hama.examples.RandomMatrix.main(RandomMatrix.java:49)
> > *
> >
> > *        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)*
> >
> > *        at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> > *
> >
> > *        at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> > *
> >
> > *        at java.lang.reflect.Method.invoke(Method.java:597)*
> >
> > *        at
> >
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
> > *
> >
> > *        at
> > org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)*
> >
> > *        at
> > org.apache.hama.examples.ExampleDriver.main(ExampleDriver.java:34)*
> >
> > *Caused by: org.apache.zookeeper.KeeperException$NoNodeException:
> > KeeperErrorCode = NoNode for /hbase/master*
> >
> > *        at
> > org.apache.zookeeper.KeeperException.create(KeeperException.java:102)*
> >
> > *        at
> > org.apache.zookeeper.KeeperException.create(KeeperException.java:42)*
> >
> > *        at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:892)*
> >
> > *        at
> >
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.readAddressOrThrow(ZooKeeperWrapper.java:327)
> > *
> >
> > *        ... 14 more*
> >
> >
> >
> > The use of “jps” produced:
> >
> >
> >
> > *root@vcuhadoop3:~/hama/bin# jps*
> >
> > *3039 DataNode*
> >
> > *3255 JobTracker*
> >
> > *12264 HQuorumPeer*
> >
> > *15562 HamaMaster*
> >
> > *3395 TaskTracker*
> >
> > *16529 Jps*
> >
> > *2892 NameNode*
> >
> > *3185 SecondaryNameNode*
> >
> > *root@vcuhadoop3:~/hama/bin#*
> >
> >
> >
> > I really appreciate any help
> >
> >
> >
> >
> >
> > Raied
> >
>
>
>
> --
> Best Regards, Edward J. Yoon @ NHN, corp.
> edwardyoon@apache.org
> http://blog.udanax.org
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message