spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tao Xiao <xiaotao.cs....@gmail.com>
Subject Re: What does "appMasterRpcPort: -1" indicate ?
Date Mon, 01 Sep 2014 00:47:47 GMT
Thanks Yi, I think your answers make sense.

We can see a series of messages with "appMasterRpcPort: -1" followed by a
message with "appMasterRpcPort: 0", perhaps that means we were waiting for
the application master to be started ("appMasterRpcPort: -1"), and later
the application master got started ("appMasterRpcPort: 0").


2014-08-31 23:10 GMT+08:00 Yi Tian <tianyi.asiainfo@gmail.com>:

> I think -1 means your application master has not been started yet.
>
>
> 在 2014年8月31日,23:02,Tao Xiao <xiaotao.cs.nju@gmail.com> 写道:
>
> I'm using CDH 5.1.0, which bundles Spark 1.0.0 with it.
>
> Following How-to: Run a Simple Apache Spark App in CDH 5 , I tried to
> submit my job in local mode, Spark Standalone mode and YARN mode. I
> successfully submitted my job in local mode and Standalone mode, however, I
> noticed the following messages printed on console when I submitted my job
> in YARN mode:
>
>
> 14/08/29 22:27:29 INFO Client: Submitting application to ASM
>
> 14/08/29 22:27:29 INFO YarnClientImpl: Submitted application
> application_1406949333981_0015
>
> 14/08/29 22:27:29 INFO YarnClientSchedulerBackend: Application report from
> ASM:
>
>   appMasterRpcPort: -1
>
>   appStartTime: 1409365649836
>
>   yarnAppState: ACCEPTED
>
>
> 14/08/29 22:27:30 INFO YarnClientSchedulerBackend: Application report from
> ASM:
>
>   appMasterRpcPort: -1
>
>   appStartTime: 1409365649836
>
>   yarnAppState: ACCEPTED
>
>
> 14/08/29 22:27:31 INFO YarnClientSchedulerBackend: Application report from
> ASM:
>
>   appMasterRpcPort: -1
>
>   appStartTime: 1409365649836
>
>   yarnAppState: ACCEPTED
>
>
> 14/08/29 22:27:32 INFO YarnClientSchedulerBackend: Application report from
> ASM:
>
>   appMasterRpcPort: -1
>
>   appStartTime: 1409365649836
>
>   yarnAppState: ACCEPTED
>
>
> 14/08/29 22:27:33 INFO YarnClientSchedulerBackend: Application report from
> ASM:
>
>   appMasterRpcPort: -1
>
>   appStartTime: 1409365649836
>
>   yarnAppState: ACCEPTED
>
>
> 14/08/29 22:27:34 INFO YarnClientSchedulerBackend: Application report from
> ASM:
>
>   appMasterRpcPort: -1
>
>   appStartTime: 1409365649836
>
>   yarnAppState: ACCEPTED
>
>
> 14/08/29 22:27:35 INFO YarnClientSchedulerBackend: Application report from
> ASM:
>
>   appMasterRpcPort: -1
>
>   appStartTime: 1409365649836
>
>   yarnAppState: ACCEPTED
>
>
> 14/08/29 22:27:36 INFO YarnClientSchedulerBackend: Application report from
> ASM:
>
>   appMasterRpcPort: -1
>
>   appStartTime: 1409365649836
>
>   yarnAppState: ACCEPTED
>
>
> 14/08/29 22:27:37 INFO YarnClientSchedulerBackend: Application report from
> ASM:
>
>   appMasterRpcPort: -1
>
>   appStartTime: 1409365649836
>
>   yarnAppState: ACCEPTED
>
>
> 14/08/29 22:27:38 INFO YarnClientSchedulerBackend: Application report from
> ASM:
>
>   appMasterRpcPort: -1
>
>   appStartTime: 1409365649836
>
>   yarnAppState: ACCEPTED
>
>
> 14/08/29 22:27:39 INFO YarnClientSchedulerBackend: Application report from
> ASM:
>
>   appMasterRpcPort: 0
>
>   appStartTime: 1409365649836
>
>   yarnAppState: RUNNING
>
>
> The job finished successfully and produced correct results.
> But I'm not sure what those messages mean? Does "appMasterRpcPort: -1"
> indicate an error or exception ?
>
>
>

Mime
View raw message