spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From dmpou...@gmail.com
Subject Re: Error reading HDFS file using spark 0.9.0 / hadoop 2.2.0 - incompatible protobuf 2.5 and 2.4.1
Date Tue, 18 Mar 2014 09:49:58 GMT
On Sunday, 2 March 2014 19:19:49 UTC+2, Aureliano Buendia  wrote:
> Is there a reason for spark using the older akka?
> 
> 
> 
> 
> On Sun, Mar 2, 2014 at 1:53 PM, 1esha <alexey.r...@gmail.com> wrote:
> 
> The problem is in akka remote. It contains files compiled with 2.4.*. When
> 
> you run it with 2.5.* in classpath it fails like above.
> 
> 
> 
> Looks like moving to akka 2.3 will solve this issue. Check this issue -
> 
> https://www.assembla.com/spaces/akka/tickets/3154-use-protobuf-version-2-5-0#/activity/ticket:
> 
> 
> 
> 
> 
> 
> 
> 
> --
> 
> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Error-reading-HDFS-file-using-spark-0-9-0-hadoop-2-2-0-incompatible-protobuf-2-5-and-2-4-1-tp2158p2217.html
> 
> 
> 
> 
> Sent from the Apache Spark User List mailing list archive at Nabble.com.

Is the solution to exclude the  2.4.*. dependency on protobuf or will thi produce more complications?
Mime
  • Unnamed multipart/mixed (inline, None, 0 bytes)
View raw message