spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tsuyoshi OZAWA <ozawa.tsuyo...@gmail.com>
Subject Job doesn't start when external shuffle service enabled
Date Fri, 12 Dec 2014 03:25:27 GMT
Job doesn't start when external shuffle service enabled with following messages.


14/12/12 03:12:34 INFO util.RackResolver: Resolved
hadoop-slave1.c.gcp-samples.internal to /default-rack
14/12/12 03:12:49 WARN cluster.YarnClientClusterScheduler: Initial job
has not accepted any resources; check your cluster UI to ensure that
workers are registered and have sufficient memory
14/12/12 03:13:04 WARN cluster.YarnClientClusterScheduler: Initial job
has not accepted any resources; check your cluster UI to ensure that
workers are registered and have sufficient memory
14/12/12 03:13:19 WARN cluster.YarnClientClusterScheduler: Initial job
has not accepted any resources; check your cluster UI to ensure that
workers are registered and have sufficient memory

I confirmed Spark on YARN work without  external shuffle service and
the memory is enough to launch tasks. Do you have any suggestions to
work this well?

-- 
- Tsuyoshi

Mime
View raw message