spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 9000revs <>
Subject Spark 1.0.0 Standalone mode config
Date Wed, 10 Dec 2014 19:59:40 GMT
I am using CDH5.1 and Spark 1.0.0.

Trying to configure resources to be allocated to each application. How do I
do this? For example, I would each app to use 2 cores and 8G of RAM. I have
tried using the pyspark commandline paramaters for --driver-memory,
--driver-cores and see no effect of those changes in the Spark Master web UI
when the app is started.

Is there anyway to do this from inside Cloudera Manager also?


View this message in context:
Sent from the Apache Spark User List mailing list archive at

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message