spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aureliano Buendia <>
Subject Spark context jar confusions
Date Thu, 02 Jan 2014 10:40:46 GMT

I do not understand why spark context has an option for loading jars at

As an example, consider

object BroadcastTest {
  def main(args: Array[String]) {

  val sc = new SparkContext(args(0), "Broadcast Test",
      System.getenv("SPARK_HOME"), Seq(System.getenv("SPARK_EXAMPLES_JAR")))


This is *the* example, or *the* application that we want to run, what
does SPARK_EXAMPLES_JAR supposed to be?
In this particular case, the BroadcastTest example is self-contained,
why would it want to load other unrelated example jars?

Finally, how does this help a real world spark application?

View raw message