spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Debasish Das <debasish.da...@gmail.com>
Subject Re: Spark deployed by Cloudera Manager
Date Wed, 23 Jul 2014 07:28:03 GMT
I found the issue...

If you use spark git and generate the assembly jar then
org.apache.hadoop.io.Writable.class is packaged with it....

If you use the assembly jar that ships with CDH in
/opt/cloudera/parcels/CDH/lib/spark/assembly/lib/spark-assembly_2.10-0.9.0-cdh5.0.2-hadoop2.3.0-cdh5.0.2.jar,
they don't put org.apache.hadoop.io.Writable.class in it..

That's weird...

If I can run the spark app using bare bone java I am sure it will run with
Ooyala's job server as well...



On Wed, Jul 23, 2014 at 12:15 AM, buntu <buntudev@gmail.com> wrote:

> If you need to run Spark apps through Hue, see if Ooyala's job server
> helps:
>
>
>
> http://gethue.com/get-started-with-spark-deploy-spark-server-and-compute-pi-from-your-web-browser/
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-deployed-by-Cloudera-Manager-tp10472p10474.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>

Mime
View raw message