Thank you all, Madhu, Gerard and Ryan. All your suggestions work. Personally I prefer running Spark locally in Eclipse for debugging purpose.

Best regards,

Wei Tan, PhD
Research Staff Member
IBM T. J. Watson Research Center

From:        Madhu <>
Date:        06/07/2014 05:21 PM
Subject:        Re: best practice: write and debug Spark application in scala-ide and maven

For debugging, I run locally inside Eclipse without maven.
I just add the Spark assembly jar to my Eclipse project build path and click
'Run As... Scala Application'.
I have done the same with Java and Scala Test, it's quick and easy.
I didn't see any third party jar dependencies in your code, so that should
be sufficient for your example.

View this message in context:
Sent from the Apache Spark User List mailing list archive at