spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From nelson <nelson.verd...@ysance.com>
Subject Re: maprfs and spark libraries
Date Mon, 26 May 2014 15:31:42 GMT
thanks for replying guys.

Mayur:
Indeed i tried the local mode (sparkmaster: local[5]) before and the
application runs well, no serialization problem. The problem arises as soon
as i try to run the app over the cluster.

Surendranauth:
I just double checked my spark_classpath from spark_env.sh and we have a
similar one.
Is your team running spark with the mapr rpm [1]? Or did you compile it
yourself?

[1]:  http://doc.mapr.com/display/MapR/Installing+Spark+and+Shark
<http://doc.mapr.com/display/MapR/Installing+Spark+and+Shark>  

Thanks



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/maprfs-and-spark-libraries-tp6392p6400.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Mime
View raw message