spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Or <and...@databricks.com>
Subject Re: Spark sql with hive table running on Yarn-cluster mode
Date Tue, 22 Jul 2014 17:42:17 GMT
Hi Jenny,

It won't work for yarn-cluster simply because this part of the code is
missing. For now, you will have to manually add them using `--jars`. Thanks
for letting us know; we will fix this by 1.1.

Andrew


2014-07-22 10:19 GMT-07:00 Jenny Zhao <linlin200605@gmail.com>:

> Hi,
>
> For running spark sql, the dataneuclus*.jar are automatically added in
> classpath, this works fine for spark standalone mode and yarn-client mode,
> however, for Yarn-cluster mode, I have to explicitly put these jars using
> --jars option when submitting this job, otherwise, the job will fail, why
> it won't  work for yarn-cluster mode?
>
> Thank you for your help!
>
> Jenny
>

Mime
View raw message