spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pierre B <pierre.borckm...@realimpactanalytics.com>
Subject Spark 0.9.0 - local mode - sc.addJar problem (bug?)
Date Sun, 02 Mar 2014 14:48:14 GMT
Hi all!

In spark 0.9.0, local mode, whenever I try to add jar(s), using either
SparkConf.addJars or SparkConfiguration.addJar, in the shell or in a
standalone mode, I observe a strange behaviour.

I investigated this because my standalone app works perfectly on my cluster
but is getting stuck in local mode.

So, as can be seen in the following screenshot, the jar file is supposedly
made available at the given http address:
<http://apache-spark-user-list.1001560.n3.nabble.com/file/n2218/Screen_Shot_2014-03-02_at_15.30.51.png>



However, when I try to get the file from http (in a browser or using wget),
the download always gets stuck after a while (usually around 66,724 bytes,
as can be seen in the next screenshot):
<http://apache-spark-user-list.1001560.n3.nabble.com/file/n2218/Screen_Shot_2014-03-02_at_15.30.39.png>


This happens for all jars I've trying, except the ones smaller than
60kbytes.

Could this be a bug or just a problem on my machine? (MacOS Mavericks)

Cheers

Pierre



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-0-9-0-local-mode-sc-addJar-problem-bug-tp2218.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Mime
View raw message