spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jacek Laskowski <ja...@japila.pl>
Subject Re: Spark (on Windows) not picking up HADOOP_CONF_DIR
Date Sun, 17 Jul 2016 12:22:26 GMT
Hi,

How did you set it? How do you run the app? Use sys.env to know whether it
was set or not.

Jacek

On 17 Jul 2016 11:33 a.m., "Daniel Haviv" <daniel.haviv@veracity-group.com>
wrote:

> Hi,
> I'm running Spark using IntelliJ on Windows and even though I set
> HADOOP_CONF_DIR it does not affect the contents of sc.hadoopConfiguration.
>
> Anybody encountered it ?
>
> Thanks,
> Daniel
>

Mime
View raw message