spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chandu <chandra.vedant...@gmail.com>
Subject Re: Spark Standalone Mode, application runs, but executor is killed
Date Fri, 26 Jan 2018 14:34:46 GMT
/Reply from Marco in another post/

Re: Best active groups, forums or contacts for Spark ?
Posted by Marco Mistroni on Jan 26, 2018; 9:08am 
URL:
http://apache-spark-user-list.1001560.n3.nabble.com/Best-active-groups-forums-or-contacts-for-Spark-tp30744p30748.html

Hi
 From personal experience....and I might be asking u obvious question
1. Does it work in standalone (no cluster)
2. Can u break down app in pieces and try to see at which step the code gets
killed?
3. Have u had a look at spark gui to see if we executors go oom?

I might be oversimplifying what spark does. But if ur logic works standalone
and does not work in cluster....the cluster might b ur problem..(apart from
modules not being serializable)
If it breaks in no cluster mode then it's easier to debug
I am no way an expert, just talking from my little personal experience.
I m sure someone here can give more hints on how to debug properly a spark
app
Hth



--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message