spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From rival95 <riva...@hotmail.com>
Subject Why is a Spark job faster through Eclipse than Standalone Cluster
Date Mon, 30 Mar 2015 21:10:49 GMT
When I run my code in Eclipse with the following parameters,

VM Args: -Xmx4g
OS: Windows
Time: 4.4 minutes

It is faster than submitting to a cluster with these parameters:

SPARK_EXECUTOR_MEMORY=4G
OS: Ubuntu
Time: 5.2 minutes

They are equivalent options are they not? Both environments run on the same
CPU/SSD (dual boot Windows/Ubuntu).

Thanks,
Justin



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Why-is-a-Spark-job-faster-through-Eclipse-than-Standalone-Cluster-tp22305.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message