whirr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mohammad Tariq <donta...@gmail.com>
Subject Re: test.jar absent
Date Tue, 20 Dec 2011 13:55:23 GMT
Thanks for the valuable reply. I'll follow the tips and let you know.

Regards,
    Mohammad Tariq



On Tue, Dec 20, 2011 at 7:21 PM, Andrei Savu <savu.andrei@gmail.com> wrote:
> Here are some quick ideas. I will investigate more later if you still have
> problems.
>
> 1. make sure you are referencing the right config files for Hive from HBase
> 2. we are not using the HBase embedded ZooKeeper server - we are running a
> standalone
> instance by default (you should see a zookeeper role in your
> whirr.instance-templates)
> 3. to be able to browse the filesystem you need to start the SOCKS proxy and
> setup
> Firefox to use that when connecting to AWS hosts.
>
> -- Andrei Savu / andreisavu.ro
>
> On Tue, Dec 20, 2011 at 2:48 PM, Mohammad Tariq <dontariq@gmail.com> wrote:
>>
>> Not really.Everything is working fine in isolation.But when I am
>> trying to integrate Hbase and Hive, I am facing some problem.Whenever
>> I am trying  to create an external table using Hive for an existing
>> Hbase table, I am getting the following error -
>>
>> hive> create external table demo(key string,name string,addr string)
>>    > STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
>>    > WITH SERDEPROPERTIES ("hbase.columns.mapping" =
>> ":key,cf1:name,cf2:addr")
>>    > TBLPROPERTIES("hbase.table.name"= "demo");
>> FAILED: Error in metadata:
>>
>> MetaException(message:org.apache.hadoop.hbase.ZooKeeperConnectionException:
>> org.apache.hadoop.hbase.ZooKeeperConnectionException:
>> org.apache.zookeeper.KeeperException$ConnectionLossException:
>> KeeperErrorCode = ConnectionLoss for /hbase
>>        at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:985)
>>        at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:301)
>>        at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:292)
>>        at
>> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:155)
>>        at
>> org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:79)
>>        at
>> org.apache.hadoop.hive.hbase.HBaseStorageHandler.getHBaseAdmin(HBaseStorageHandler.java:74)
>>        at
>> org.apache.hadoop.hive.hbase.HBaseStorageHandler.preCreateTable(HBaseStorageHandler.java:158)
>>        at
>> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:344)
>>        at
>> org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:470)
>>        at
>> org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3146)
>>        at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:213)
>>        at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130)
>>        at
>> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
>>        at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063)
>>        at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
>>        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
>>        at
>> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:164)
>>        at
>> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:241)
>>        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:456)
>>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>        at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>        at java.lang.reflect.Method.invoke(Method.java:597)
>>        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>> Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException:
>> org.apache.zookeeper.KeeperException$ConnectionLossException:
>> KeeperErrorCode = ConnectionLoss for /hbase
>>        at
>> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:147)
>>        at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:983)
>>        ... 23 more
>> Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException:
>> KeeperErrorCode = ConnectionLoss for /hbase
>>        at
>> org.apache.zookeeper.KeeperException.create(KeeperException.java:90)
>>        at
>> org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
>>        at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:637)
>>        at
>> org.apache.hadoop.hbase.zookeeper.ZKUtil.createAndFailSilent(ZKUtil.java:886)
>>        at
>> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:133)
>>        ... 24 more
>> )
>>
>> Do I need to download and configure zookeeper separately??
>> Also I am not able able to browse the filesystem through its web
>> interface.I can just see the namenode interface, and as soon as I
>> click on "Browse the filesystem", the page goes not responding.
>>
>> Regards,
>>     Mohammad Tariq
>>
>>
>>
>> On Tue, Dec 20, 2011 at 5:27 PM, Andrei Savu <savu.andrei@gmail.com>
>> wrote:
>> > It should be fine as long as you match the HBase version (and you trust
>> > them).
>> >
>> > Are things working for you now with this change in place?
>> >
>> > -- Andrei Savu
>> >
>> > On Tue, Dec 20, 2011 at 1:42 PM, Mohammad Tariq <dontariq@gmail.com>
>> > wrote:
>> >>
>> >> Hi Andrei,
>> >>
>> >>   I am using Apache's distribution.Thanks for the link.I have
>> >> downloaded the jar from the following
>> >>
>> >>
>> >> link-"http://www.java2s.com/Code/Jar/h/Downloadhbase08920100924testsjar.htm"..Is
>> >> it ok??or do I need to go to Maven central??
>> >>
>> >> Regards,
>> >>     Mohammad Tariq
>> >>
>> >>
>> >>
>> >> On Tue, Dec 20, 2011 at 3:44 PM, Andrei Savu <savu.andrei@gmail.com>
>> >> wrote:
>> >> > First of all are you deploying CDH or the Apache HBase release?
>> >> >
>> >> > I can confirm that the following tarball does not ship with the tests
>> >> > jar.
>> >> >
>> >> >
>> >> > http://archive.apache.org/dist/hbase/hbase-0.89.20100924/hbase-0.89.20100924-bin.tar.gz
>> >> >
>> >> > Have you considered fetching it from Maven Central?
>> >> >
>> >> > See the "tests.jar" on the following page:
>> >> >
>> >> >
>> >> > http://search.maven.org/#search%7Cgav%7C1%7Cg%3A%22org.apache.hbase%22%20AND%20a%3A%22hbase%22
>> >> >
>> >> > -- Andrei Savu / andreisavu.ro
>> >> >
>> >> >
>> >> > On Tue, Dec 20, 2011 at 10:00 AM, Mohammad Tariq <dontariq@gmail.com>
>> >> > wrote:
>> >> >>
>> >> >> Hello list,
>> >> >>   I have a cluster that has Hadoop and Hbase running on it. Now
I am
>> >> >> trying to integrate Hbase and Hive together, and for that I need
to
>> >> >> put the hbase-*-test.jar in hive/lib folder but the hbase-*-test.jar
>> >> >> is not present in Hbase.Has anyone tried it??Hive alone is working
>> >> >> fine..Need some help.
>> >> >>
>> >> >> Regards,
>> >> >>     Mohammad Tariq
>> >> >
>> >> >
>> >
>> >
>
>

Mime
View raw message