spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arun Ahuja <aahuj...@gmail.com>
Subject Re: Yarn configuration file doesn't work when run with yarn-client mode
Date Mon, 19 May 2014 16:07:05 GMT
I am encountering the same thing.  Basic yarn apps work as does the SparkPi
example, but my custom application gives this result.  I am using
compute-classpath to create the proper classpath for my application, same
with SparkPi - was there a resolution to this issue?

Thanks,
Arun


On Wed, Feb 12, 2014 at 1:28 AM, Nan Zhu <zhunanmcgill@gmail.com> wrote:

>  Hi, all
>
> When I run my application with  yarn-client mode, it seems that the system
> didn’t load my configuration file correctly, because the local app master
> always tries to register with RM via a default IP
>
> 14/02/12 05:00:23 INFO SparkContext: Added JAR
> target/scala-2.10/rec_system_2.10-1.0.jar at
> http://172.31.37.160:51750/jars/rec_system_2.10-1.0.jar with timestamp
> 1392181223818
>
> 14/02/12 05:00:24 INFO RMProxy: Connecting to ResourceManager at /
> 0.0.0.0:8032
>
> 14/02/12 05:00:25 INFO Client: Retrying connect to server:
> 0.0.0.0/0.0.0.0:8032. Already tried 0 time(s); retry policy is
> RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
>
> 14/02/12 05:00:26 INFO Client: Retrying connect to server:
> 0.0.0.0/0.0.0.0:8032. Already tried 1 time(s); retry policy is
> RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
>
> 14/02/12 05:00:27 INFO Client: Retrying connect to server:
> 0.0.0.0/0.0.0.0:8032. Already tried 2 time(s); retry policy is
> RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
>
>
> However, if I run in a standalone mode, everything works fine
>  (YARN_CONF_DIR, SPARK_APP, SPARK_YARN_APP_JAR are all set correctly)
>
> is it a bug?
>
> Best,
>
> --
> Nan Zhu
>
>
>

Mime
View raw message