spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh Rathi <coolharshra...@gmail.com>
Subject Inconsistent performance across multiple iterations of same application
Date Wed, 02 Mar 2016 10:51:43 GMT
Hi,

I am doing spark-submit with same resources from a bash script on EC2
Cluster. But, the time taken in running this application is varying a lot
from 5 mins to 60 mins across multiple iterations.
I am restarting spark cluster with stop-all.sh and start-all.sh scripts
after every run of application.
What else I need to do so that app runs as fresh ?


Harsh Rathi

Mime
View raw message