spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Ash <and...@andrewash.com>
Subject Re: Integration issue between Apache Shark-0.9.1 (with in-house hive-0.11) and pre-existing CDH4.6 HIVE-0.10 server
Date Wed, 28 May 2014 17:30:09 GMT
IPC version 7 vs 4 is Hadoop2 vs Hadoop1.  I'm guessing your Hadoop cluster
is on a different version than the .jars you're using in Shark.

http://stackoverflow.com/questions/16491547/pig-to-hadoop-issue-server-ipc-version-7-cannot-communicate-with-client-version

Can you try finding matching jars for your Hadoop cluster?


On Wed, May 28, 2014 at 8:47 AM, bijoy deb <bijoy.computers@gmail.com>wrote:

> Hi all,
>
> I have installed Apache Shark 0.9.1 on my machine which comes bundled with
> hive-0.11 version of hive jars.I am trying to integrate this with my
> pre-existing CDH-4.6 version of the Hive server which is of version 0.10.On
> pointing HIVE_HOME in spark-env.sh to the cloudera version of the hive
> (hive-0.10),I am getting the IPC version mismatch error as below when I try
> to execute any SELECT query on an existing Hive table:
>
> shark> select * from test_table;
> 27.828: [Full GC 61270K->21300K(1013632K), 0.1185540 secs]
> java.lang.RuntimeException: Server IPC version 7 cannot communicate with
> client version 4
>  at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:151)
>  at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(
> TaskRunner.java:57)
>  at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1362)
>
>
> It seems the Shark-0.9.1 version is incompatible with Hive-0.10
> server.Please suggest a solution if anyone has encountered this issue.
>
> Thanks
> Bijoy
>

Mime
View raw message