spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "gaurav.dasgupta" <>
Subject Re: Yarn configuration file doesn't work when run with yarn-client mode
Date Tue, 20 May 2014 07:40:51 GMT

Even I am encountering the same problem and exactly the same console logs
while running custom Spark programs using YARN. I have checked all the
information provided elsewhere and confirmed the same in my system:
 *- Set HADOOP_CONF_DIR=/etc/hadoop/conf
 - Set YARN_CONF_DIR=/etc/hadoop/conf
 - Set SPARK_YARN_USER_ENV="CLASSPATH=/etc/hadoop/conf/"*

I have set the above in the ** as well as exported them in the
file */etc/profile* on all machines in the cluster. Still I am getting the
same problem.

However, the Spark example programs are running fine on YARN. Please provide
suggestions in order to resolve this issue.


View this message in context:
Sent from the Apache Spark User List mailing list archive at

View raw message