spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Archit Thakur <archit279tha...@gmail.com>
Subject Re: java.lang.ClassNotFoundException
Date Wed, 07 May 2014 12:41:27 GMT
Hi Joe,

Your messages are going into spam folder for me.

Thx, Archit_Thakur.


On Fri, May 2, 2014 at 9:22 AM, Joe L <selmee_j@yahoo.com> wrote:

> Hi, You should include the jar file of your project. for example:
> conf.set("yourjarfilepath.jar")
>
> Joe
>   On Friday, May 2, 2014 7:39 AM, proofmoore [via Apache Spark User List]
> <[hidden email]> wrote:
>   HelIo. I followed "A Standalone App in Java" part of the tutorial
> https://spark.apache.org/docs/0.8.1/quick-start.html
>
> Spark standalone cluster looks it's running without a problem :
> http://i.stack.imgur.com/7bFv8.png
>
> I have built a fat jar for running this JavaApp on the cluster. Before
> maven package:
>
>     find .
>
>     ./pom.xml
>     ./src
>     ./src/main
>     ./src/main/java
>     ./src/main/java/SimpleApp.java
>
>
> content of SimpleApp.java is :
>
>      import org.apache.spark.api.java.*;
>      import org.apache.spark.api.java.function.Function;
>      import org.apache.spark.SparkConf;
>      import org.apache.spark.SparkContext;
>
>
>      public class SimpleApp {
>      public static void main(String[] args) {
>
>      SparkConf conf =  new SparkConf()
>                        .setMaster("spark://10.35.23.13:7077")
>                        .setAppName("My app")
>                        .set("spark.executor.memory", "1g");
>
>      JavaSparkContext   sc = new JavaSparkContext (conf);
>      String logFile = "/home/ubuntu/spark-0.9.1/test_data";
>      JavaRDD<String> logData = sc.textFile(logFile).cache();
>
>      long numAs = logData.filter(new Function<String, Boolean>() {
>       public Boolean call(String s) { return s.contains("a"); }
>      }).count();
>
>      System.out.println("Lines with a: " + numAs);
>      }
>      }
>
> This program only works when master is set as setMaster("local").
> Otherwise I get this error : http://i.stack.imgur.com/doRSn.png
>
> Thanks,
> Ibrahim
>
>
> ------------------------------
>  If you reply to this email, your message will be added to the discussion
> below:
>
> http://apache-spark-user-list.1001560.n3.nabble.com/java-lang-ClassNotFoundException-tp5191.html
>  To start a new topic under Apache Spark User List, email [hidden email]
> To unsubscribe from Apache Spark User List, click here.
> NAML
>
>
>
> ------------------------------
> View this message in context: Re: java.lang.ClassNotFoundException
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>

Mime
View raw message