spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-5483) java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;
Date Fri, 30 Jan 2015 12:59:35 GMT

    [ https://issues.apache.org/jira/browse/SPARK-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14298600#comment-14298600
] 

Sean Owen commented on SPARK-5483:
----------------------------------

The examples don't set a master on purpose, as I understand. Like other Spark apps, they're
supposed to be run with spark-submit, which sets the master. Your declaration should set the
Spark dependencies as "provided". However, more importantly, you're mixing MLlib for Scala
2.11 with Scala 2.10 and Core for 2.10. This has to be the problem, right?

> java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;
> -------------------------------------------------------------------------------------------
>
>                 Key: SPARK-5483
>                 URL: https://issues.apache.org/jira/browse/SPARK-5483
>             Project: Spark
>          Issue Type: Bug
>          Components: MLlib
>    Affects Versions: 1.2.0
>         Environment: Maven
> Spark 1.2
>            Reporter: DeepakVohra
>
> Naive Bayes classifier generates following error.
> ERROR Executor: Exception in task 0.0 in stage 0.0 (TID 0)
> java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;
> 	at breeze.generic.MMRegistry2$class.register(Multimethod.scala:188)
> 	at breeze.linalg.VectorOps$$anon$1.breeze$linalg$operators$BinaryRegistry$$super$register(Vector.scala:303)
> 	at breeze.linalg.operators.BinaryRegistry$class.register(BinaryOp.scala:87)
> 	at breeze.linalg.VectorOps$$anon$1.register(Vector.scala:303)
> 	at breeze.linalg.operators.DenseVectorOps$$anon$1.<init>(DenseVectorOps.scala:38)
> 	at breeze.linalg.operators.DenseVectorOps$class.$init$(DenseVectorOps.scala:22)
> 	at breeze.linalg.DenseVector$.<init>(DenseVector.scala:225)
> 	at breeze.linalg.DenseVector$.<clinit>(DenseVector.scala)
> 	at breeze.linalg.DenseVector.<init>(DenseVector.scala:63)
> 	at breeze.linalg.DenseVector$mcD$sp.<init>(DenseVector.scala:50)
> 	at breeze.linalg.DenseVector$mcD$sp.<init>(DenseVector.scala:55)
> 	at org.apache.spark.mllib.linalg.DenseVector.toBreeze(Vectors.scala:329)
> 	at org.apache.spark.mllib.classification.NaiveBayes$$anonfun$3.apply(NaiveBayes.scala:112)
> 	at org.apache.spark.mllib.classification.NaiveBayes$$anonfun$3.apply(NaiveBayes.scala:110)
> 	at org.apache.spark.util.collection.ExternalSorter$$anonfun$5.apply(ExternalSorter.scala:200)
> 	at org.apache.spark.util.collection.ExternalSorter$$anonfun$5.apply(ExternalSorter.scala:199)
> 	at org.apache.spark.util.collection.AppendOnlyMap.changeValue(AppendOnlyMap.scala:142)
> 	at org.apache.spark.util.collection.SizeTrackingAppendOnlyMap.changeValue(SizeTrackingAppendOnlyMap.scala:32)
> 	at org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:205)
> 	at org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:58)
> 	at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:68)
> 	at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41)
> 	at org.apache.spark.scheduler.Task.run(Task.scala:56)
> 	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:196)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 	at java.lang.Thread.run(Thread.java:745)
> 15/01/28 21:50:06 ERROR SparkUncaughtExceptionHandler: Uncaught exception in thread Thread[Executor
task launch worker-0,5,main]
> java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;
> 	at breeze.generic.MMRegistry2$class.register(Multimethod.scala:188)
> 	at breeze.linalg.VectorOps$$anon$1.breeze$linalg$operators$BinaryRegistry$$super$register(Vector.scala:303)
> 	at breeze.linalg.operators.BinaryRegistry$class.register(BinaryOp.scala:87)
> 	at breeze.linalg.VectorOps$$anon$1.register(Vector.scala:303)
> 	at breeze.linalg.operators.DenseVectorOps$$anon$1.<init>(DenseVectorOps.scala:38)
> 	at breeze.linalg.operators.DenseVectorOps$class.$init$(DenseVectorOps.scala:22)
> 	at breeze.linalg.DenseVector$.<init>(DenseVector.scala:225)
> 	at breeze.linalg.DenseVector$.<clinit>(DenseVector.scala)
> 	at breeze.linalg.DenseVector.<init>(DenseVector.scala:63)
> 	at breeze.linalg.DenseVector$mcD$sp.<init>(DenseVector.scala:50)
> 	at breeze.linalg.DenseVector$mcD$sp.<init>(DenseVector.scala:55)
> 	at org.apache.spark.mllib.linalg.DenseVector.toBreeze(Vectors.scala:329)
> 	at org.apache.spark.mllib.classification.NaiveBayes$$anonfun$3.apply(NaiveBayes.scala:112)
> 	at org.apache.spark.mllib.classification.NaiveBayes$$anonfun$3.apply(NaiveBayes.scala:110)
> 	at org.apache.spark.util.collection.ExternalSorter$$anonfun$5.apply(ExternalSorter.scala:200)
> 	at org.apache.spark.util.collection.ExternalSorter$$anonfun$5.apply(ExternalSorter.scala:199)
> 	at org.apache.spark.util.collection.AppendOnlyMap.changeValue(AppendOnlyMap.scala:142)
> 	at org.apache.spark.util.collection.SizeTrackingAppendOnlyMap.changeValue(SizeTrackingAppendOnlyMap.scala:32)
> 	at org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:205)
> 	at org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:58)
> 	at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:68)
> 	at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41)
> 	at org.apache.spark.scheduler.Task.run(Task.scala:56)
> 	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:196)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 	at java.lang.Thread.run(Thread.java:745)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message