spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "gaurav.dasgupta" <gaurav.d...@gmail.com>
Subject Re: Yarn configuration file doesn't work when run with yarn-client mode
Date Tue, 20 May 2014 07:40:51 GMT
 Hi,

Even I am encountering the same problem and exactly the same console logs
while running custom Spark programs using YARN. I have checked all the
information provided elsewhere and confirmed the same in my system:
 *- Set HADOOP_CONF_DIR=/etc/hadoop/conf
 - Set YARN_CONF_DIR=/etc/hadoop/conf
 - Set SPARK_YARN_USER_ENV="CLASSPATH=/etc/hadoop/conf/"*

I have set the above in the *spark-env.sh* as well as exported them in the
file */etc/profile* on all machines in the cluster. Still I am getting the
same problem.

However, the Spark example programs are running fine on YARN. Please provide
suggestions in order to resolve this issue.

Regards,
Gaurav



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Yarn-configuration-file-doesn-t-work-when-run-with-yarn-client-mode-tp1418p6088.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Mime
View raw message