spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From satish saley <satishsale...@gmail.com>
Subject mesos cluster mode
Date Thu, 05 May 2016 17:32:59 GMT
Hi,
Spark documentation says that "cluster mode is currently not supported for
Mesos clusters."But below we can see mesos example with cluster mode. I
don't have mesos cluster to try it out. Which one is true? Shall I
interpret it as "cluster mode is currently not supported for Mesos clusters*
for Python applications*" ?

"Alternatively, if your application is submitted from a machine far from
the worker machines (e.g. locally on your laptop), it is common to use
cluster mode to minimize network latency between the drivers and the
executors. Note that cluster mode is currently not supported for Mesos
clusters. Currently only YARN supports cluster mode for Python
applications."



# Run on a Mesos cluster in cluster deploy mode with supervise
./bin/spark-submit \
  --class org.apache.spark.examples.SparkPi \
  --master mesos://207.184.161.138:7077 \
  --deploy-mode cluster
  --supervise
  --executor-memory 20G \
  --total-executor-cores 100 \
  http://path/to/examples.jar \
  1000

Mime
View raw message