spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sandy Ryza <sandy.r...@cloudera.com>
Subject Re: exception while running pi example on yarn cluster
Date Sat, 08 Mar 2014 19:11:37 GMT
I think this is caused by not setting yarn.application.classpath in your
yarn-site.xml.

-Sandy


On Sat, Mar 8, 2014 at 2:24 AM, Venkata siva kamesh Bhallamudi <
kam.iitkgp@gmail.com> wrote:

> Hi All,
>  I am new to Spark and running pi example on Yarn Cluster. I am getting
> the following exception
>
> Exception in thread "main" java.lang.NullPointerException
>     at
> scala.collection.mutable.ArrayOps$ofRef$.length$extension(ArrayOps.scala:114)
>     at scala.collection.mutable.ArrayOps$ofRef.length(ArrayOps.scala:114)
>     at
> scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:32)
>     at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:108)
>     at
> org.apache.spark.deploy.yarn.Client$.populateClasspath(Client.scala:518)
>     at org.apache.spark.deploy.yarn.Client.setupLaunchEnv(Client.scala:333)
>     at org.apache.spark.deploy.yarn.Client.runApp(Client.scala:94)
>     at org.apache.spark.deploy.yarn.Client.run(Client.scala:115)
>     at org.apache.spark.deploy.yarn.Client$.main(Client.scala:492)
>     at org.apache.spark.deploy.yarn.Client.main(Client.scala)
>
> I am using
> Spark Version : 0.9.0
> Yarn Version : 2.3.0
>
> Please help me where am I doing wrong.
>
> Thanks & Regards
> Kamesh.
>

Mime
View raw message