hama-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon" <edwardy...@apache.org>
Subject Re: help in installing Hama / Zookeeper
Date Wed, 13 Jan 2010 01:55:36 GMT
Hi,
Try the following commands:

1) download hama

[root@udanax src]# ls
hbase-0.20.2
zookeeper-3.2.2
hadoop-0.20.1

[root@udanax src]# svn checkout
http://svn.apache.org/repos/asf/incubator/hama/trunk hama-trunk
[root@udanax src]# rm -rf hama-trunk/lib/hbase*.jar
[root@udanax src]# rm -rf hama-trunk/lib/zookeeper*.jar
[root@udanax src]# cp hbase-0.20.2/hbase*.jar hama-trunk/lib
[root@udanax src]# cp zookeeper-3.2.2/zoo**.jar hama-trunk/lib
[root@udanax src]# cd hama-trunk
[root@udanax src]# ant package
[root@udanax src]# cp build/*.jar ./

2) start hadoop

[root@udanax src]# cp hbase-0.20.2/hbase-0.20.2*.jar hadoop-0.20.1/lib
[root@udanax src]# cp hama-trunk/hama-0.2.0-dev*.jar hadoop-0.20.1/lib
[root@udanax src]# hadoop-0.20.1/bin/start-all.sh
[root@udanax src]# ps -ef | grep hama

root     28643     1 10 04:39 ?        00:00:01
/usr/java/jdk1.6.0_17/bin/java -Xmx2000m
-Dhadoop.log.dir=/usr/local/src/hadoop-0.20.1/bin/../logs
-Dhadoop.log.file=hadoop-root-tasktracker-udanax.org.log
-Dhadoop.home.dir=/usr/local/src/hadoop-0.20.1/bin/..
-Dhadoop.id.str=root -Dhadoop.root.logger=INFO,DRFA
-Djava.library.path=/usr/local/src/hadoop-0.20.1/bin/../lib/native/Linux-i386-32
-Dhadoop.policy.file=hadoop-policy.xml -classpath
...
n/../lib/hama-0.2.0-dev-examples.jar:/usr/local/src/hadoop-0.20.1/bin/../lib/hama-0.2.0-dev-test.jar:/usr/local/src/hadoop-0.20.1/bin/../lib/hama-0.2.0-dev.jar:/usr/local/src/hadoop-0.20.1/bin/../lib/hbase-0.20.2-test.jar:/usr/local/src/hadoop-0.20.1/bin/../lib/hbase-0.20.2.jar:/usr/local/src/hadoop-0.20.1/bin/../lib/hsqldb-1.8.0.10.jar:/usr/local/src/hadoop-0.20.1/bin/../lib/jasper-compiler-5.5.12.jar:/usr/local/src/hadoop-0.20.1/bin/../lib/jasper-runtime-5.5.12.jar:/usr/local/src/hadoop-0.20.1/bin/../lib/jets3t-0.6.1.jar:/usr/local/src/hadoop-0.20.1/bin/../lib/jetty-6.1.14.jar:/usr/local/src/hadoop-0.20.1/bin/../lib/jetty-util-6.1.14.jar:/usr/local/src/hadoop-0.20.1/bin/../
...
org.apache.hadoop.mapred.TaskTracker

3) start zookeeper

[root@udanax src]# zookeeper-3.2.2/bin/zkServer.sh start
...

[root@udanax src]# zookeeper-3.2.2/bin/zkServer.sh status
JMX enabled by default
Using config: /usr/local/src/zookeeper-3.2.2/bin/../conf/zoo.cfg
2010-01-14 04:43:42,640 - INFO
[NIOServerCxn.Factory:2181:NIOServerCnxn@722] - Processing stat
command from /127.0.0.1:47624
2010-01-14 04:43:42,643 - WARN
[NIOServerCxn.Factory:2181:NIOServerCnxn@518] - Exception causing
close of session 0x0 due to java.io.IOException: Responded to info
probe
2010-01-14 04:43:42,644 - INFO
[NIOServerCxn.Factory:2181:NIOServerCnxn@857] - closing session:0x0
NIOServerCnxn: java.nio.channels.SocketChannel[connected
local=/127.0.0.1:2181 remote=/127.0.0.1:47624]
Mode: standalone

4) start hbase

[root@udanax src]# hbase-0.20.2/bin/start-hbase.sh
udanax.org: starting zookeeper, logging to
/usr/local/src/hbase-0.20.2/bin/../logs/hbase-root-zookeeper-udanax.org.out
starting master, logging to
/usr/local/src/hbase-0.20.2/bin/../logs/hbase-root-master-udanax.org.out
udanax.org: starting regionserver, logging to
/usr/local/src/hbase-0.20.2/bin/../logs/hbase-root-regionserver-udanax.org.out

5) start hama example

[root@udanax src]# hama-trunk/bin/hama examples rand 20 20 20% tmp
....
10/01/14 04:44:54 INFO zookeeper.ClientCnxn: Server connection successful
10/01/14 04:44:54 INFO matrix.AbstractMatrix: Initializing the matrix storage.
10/01/14 04:45:01 INFO matrix.AbstractMatrix: Create Matrix
SparseMatrix_randehogu
10/01/14 04:45:01 INFO matrix.AbstractMatrix: Create the 20 * 20
random matrix : SparseMatrix_randehogu
Wrote input for Map #0
Wrote input for Map #1
Wrote input for Map #2

On Wed, Jan 13, 2010 at 4:31 AM, Raied Salman <salmanr@vcu.edu> wrote:
> Dear all,
>
> I have one node cluster running with hadoop 0.20.1 (the pi example is
> running). I also installed Hbase 0.20.2 and is working good as well (I
> managed to create tables).
>
> Finally I tried to install “hama” which requested “zookeeper”. I am not able
> to run any example in hama such as:
>
> bin/hama examples rand –m 10 –r 10 2000 2000 30.5% matrixA
>
>
>
> The errors I am getting are:
>
> *root@vcuhadoop3:~/hama/bin# ./hama examples rand -m 2 -r 1 10 10 30% QQ*
>
> *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> environment:zookeeper.version=3.2.1-808558, built on 08/27/2009 18:48 GMT*
>
> *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client environment:host.name
> =vcuhadoop3*
>
> *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> environment:java.version=1.6.0_17*
>
> *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> environment:java.vendor=Sun Microsystems Inc.*
>
> *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> environment:java.home=/usr/lib/jvm/jdk1.6.0_17/jre*
>
> *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> environment:java.class.path=/root/hama/bin/../conf:/usr/lib/jvm/jdk1.6.0_17/lib/tools.jar:/root/hama/build/classes:/root/hama/build/test:/root/hama/build:/root/hama/hama-0.2.0-dev-examples.jar:/root/hama/hama-0.2.0-dev.jar:/root/hama/hama-0.2.0-dev-test.jar:/root/hama/lib/AgileJSON-2009-03-30.jar:/root/hama/lib/commons-cli-2.0-SNAPSHOT.jar:/root/hama/lib/commons-el-from-jetty-5.1.4.jar:/root/hama/lib/commons-httpclient-3.0.1.jar:/root/hama/lib/commons-logging-1.0.4.jar:/root/hama/lib/commons-logging-api-1.0.4.jar:/root/hama/lib/commons-math-1.1.jar:/root/hama/lib/hadoop-0.20.1-core.jar:/root/hama/lib/hadoop-0.20.1-test.jar:/root/hama/lib/hbase-0.20.0.jar:/root/hama/lib/hbase-0.20.0-test.jar:/root/hama/lib/jasper-compiler-5.5.12.jar:/root/hama/lib/jasper-runtime-5.5.12.jar:/root/hama/lib/javacc.jar:/root/hama/lib/jetty-6.1.14.jar:/root/hama/lib/jetty-util-6.1.14.jar:/root/hama/lib/jruby-complete-1.2.0.jar:/root/hama/lib/json.jar:/root/hama/lib/junit-3.8.1.jar:/root/hama/lib/libthrift-r771587.jar:/root/hama/lib/log4j-1.2.13.jar:/root/hama/lib/log4j-1.2.15.jar:/root/hama/lib/servlet-api-2.5-6.1.14.jar:/root/hama/lib/xmlenc-0.52.jar:/root/hama/lib/zookeeper-3.2.1.jar:/root/hama/lib/jetty-ext/*.jar:/root/hama/lib/findbugs/annotations.jar:/root/hama/lib/findbugs/ant.jar:/root/hama/lib/findbugs/asm-3.0.jar:/root/hama/lib/findbugs/asm-analysis-3.0.jar:/root/hama/lib/findbugs/asm-commons-3.0.jar:/root/hama/lib/findbugs/asm-tree-3.0.jar:/root/hama/lib/findbugs/asm-util-3.0.jar:/root/hama/lib/findbugs/asm-xml-3.0.jar:/root/hama/lib/findbugs/bcel.jar:/root/hama/lib/findbugs/dom4j-full.jar:/root/hama/lib/findbugs/findbugs-ant.jar:/root/hama/lib/findbugs/findbugsGUI.jar:/root/hama/lib/findbugs/findbugs.jar:/root/hama/lib/findbugs/jsr305.jar:/root/hama/lib/findbugs/plugin/coreplugin.jar:/root/hadoop-0.20.1/conf:/root/hbase-0.20.2/conf
> *
>
> *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> environment:java.library.path=/usr/lib/jvm/jdk1.6.0_17/jre/lib/i386/client:/usr/lib/jvm/jdk1.6.0_17/jre/lib/i386:/usr/lib/jvm/jdk1.6.0_17/jre/../lib/i386:/usr/java/packages/lib/i386:/lib:/usr/lib
> *
>
> *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> environment:java.io.tmpdir=/tmp*
>
> *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> environment:java.compiler=<NA>*
>
> *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client environment:os.name
> =Linux*
>
> *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client environment:os.arch=i386
> *
>
> *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> environment:os.version=2.6.31-14-generic*
>
> *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client environment:user.name
> =root*
>
> *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> environment:user.home=/root*
>
> *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Client
> environment:user.dir=/root/hama/bin*
>
> *10/01/12 13:08:22 INFO zookeeper.ZooKeeper: Initiating client connection,
> connectString=localhost:2181 sessionTimeout=60000
> watcher=org.apache.hadoop.hbase.client.HConnectionManager$ClientZKWatcher@a32b
> *
>
> *10/01/12 13:08:22 INFO zookeeper.ClientCnxn:
> zookeeper.disableAutoWatchReset is false*
>
> *10/01/12 13:08:22 INFO zookeeper.ClientCnxn: Attempting connection to
> server localhost/127.0.0.1:2181*
>
> *10/01/12 13:08:22 INFO zookeeper.ClientCnxn: Priming connection to
> java.nio.channels.SocketChannel[connected
> local=/127.0.0.1:34973remote=localhost/
> 127.0.0.1:2181]*
>
> *10/01/12 13:08:22 INFO zookeeper.ClientCnxn: Server connection successful*
>
> *10/01/12 13:08:22 INFO client.HConnectionManager$TableServers: getMaster
> attempt 0 of 10 failed; retrying after sleep of 2000*
>
> *java.io.IOException: org.apache.zookeeper.KeeperException$NoNodeException:
> KeeperErrorCode = NoNode for /hbase/master*
>
> *        at
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.readAddressOrThrow(ZooKeeperWrapper.java:331)
> *
>
> *        at
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.readMasterAddressOrThrow(ZooKeeperWrapper.java:240)
> *
>
> *        at
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getMaster(HConnectionManager.java:315)
> *
>
> *        at
> org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:72)*
>
> *        at
> org.apache.hama.matrix.AbstractMatrix.setConfiguration(AbstractMatrix.java:91)
> *
>
> *        at org.apache.hama.matrix.SparseMatrix.<init>(SparseMatrix.java:62)
> *
>
> *        at
> org.apache.hama.matrix.SparseMatrix.random_mapred(SparseMatrix.java:122)*
>
> *        at org.apache.hama.examples.RandomMatrix.main(RandomMatrix.java:49)
> *
>
> *        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)*
>
> *        at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> *
>
> *        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> *
>
> *        at java.lang.reflect.Method.invoke(Method.java:597)*
>
> *        at
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
> *
>
> *        at
> org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)*
>
> *        at
> org.apache.hama.examples.ExampleDriver.main(ExampleDriver.java:34)*
>
> *Caused by: org.apache.zookeeper.KeeperException$NoNodeException:
> KeeperErrorCode = NoNode for /hbase/master*
>
> *        at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:102)*
>
> *        at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:42)*
>
> *        at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:892)*
>
> *        at
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.readAddressOrThrow(ZooKeeperWrapper.java:327)
> *
>
> *        ... 14 more*
>
>
>
> The use of “jps” produced:
>
>
>
> *root@vcuhadoop3:~/hama/bin# jps*
>
> *3039 DataNode*
>
> *3255 JobTracker*
>
> *12264 HQuorumPeer*
>
> *15562 HamaMaster*
>
> *3395 TaskTracker*
>
> *16529 Jps*
>
> *2892 NameNode*
>
> *3185 SecondaryNameNode*
>
> *root@vcuhadoop3:~/hama/bin#*
>
>
>
> I really appreciate any help
>
>
>
>
>
> Raied
>



-- 
Best Regards, Edward J. Yoon @ NHN, corp.
edwardyoon@apache.org
http://blog.udanax.org

Mime
View raw message