spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vikash Pareek <vikash.par...@infoobjects.com>
Subject Re: Setting spark.yarn.stagingDir in 1.6
Date Wed, 15 Mar 2017 15:12:56 GMT
++ Sudhir

On Wed, 15 Mar 2017 at 4:06 PM, Saurav Sinha <sauravsinha76@gmail.com>
wrote:

> Hi Users,
>
>
> I am running spark job in yarn.
>
> I want to set staging directory to some other location which is by default
> hdfs://host:port/home/$User/
>
> In spark 2.0.0, it can be done by setting spark.yarn.stagingDir.
>
> But in production, we have spark 1.6. Can anyone please suggest how it can
> be done in spark 1.6.
>
> --
> Thanks and Regards,
>
> Saurav Sinha
>
> Contact: 9742879062
>
-- 

Best Regards,


[image: InfoObjects Inc.] <http://www.infoobjects.com/>
Vikash Pareek
Team Lead  *InfoObjects Inc.*
Big Data Analytics

m: +91 8800206898 a: E5, Jhalana Institutionall Area, Jaipur, Rajasthan
302004
w: www.linkedin.com/in/pvikash e: vikash.pareek@infoobjects.com

Mime
View raw message