spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From KhajaAsmath Mohammed <mdkhajaasm...@gmail.com>
Subject Spark Submit --> Unable to reach cluster manager to request executors
Date Thu, 17 Nov 2016 20:15:52 GMT
Hello Everyone,

Could you please let me know if there any optimal way to request executors
while submitting job in yarn mode.

My job is running slow by printing out following statements. Is there a way
to speed up process?


16/11/17 14:03:49 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:49 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 2 total executors!
16/11/17 14:03:50 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:50 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 3 total executors!
16/11/17 14:03:51 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:51 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 4 total executors!
16/11/17 14:03:52 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:52 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 5 total executors!
16/11/17 14:03:53 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:53 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 6 total executors!
16/11/17 14:03:54 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:54 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 7 total executors!
16/11/17 14:03:55 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:55 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 8 total executors!
16/11/17 14:03:56 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:56 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 9 total executors!
16/11/17 14:03:57 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:57 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 10 total executors!
16/11/17 14:03:58 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:58 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 11 total executors!
16/11/17 14:03:59 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:59 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 12 total executors!
16/11/17 14:04:00 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode

Thanks,
Asmath.

Mime
View raw message