When I referred to interactive shells, I was referring the the Scala & Python interactive language shells. Both Python & Scala come with respective interacive shells. By just typing “python” or “scala” (assume the installation bin directory is in your $PATH), it will put fire up the shell.

As for the “pyspark” and “spark-shell”, they both come with the Spark installation and are in $spark_install_dir/bin directory.

Have a go at them. Best way to learn the language.


“Language is the palate from which we draw all colors of our life.”
Jules Damji

On Feb 28, 2016, at 4:08 PM, Suhaas Lang <> wrote:


Could you please post links to these interactive shells for Python and Scala?

On Feb 28, 2016 5:32 PM, "Jules Damji" <> wrote:
Hello Ashoka,

"Learning Spark," from O'Reilly, is certainly a good start, and all basic video tutorials from Spark Summit Training, "Spark Essentials", are excellent supplementary materials.

And the best (and most effective) way to teach yourself is really firing up the spark-shell or pyspark and doing it yourself—immersing yourself by trying all basic transformations and actions on RDDs, with contrived small data sets.

I've discovered that learning Scala & Python through their interactive shell, where feedback is immediate and response is quick, as the best learning experience. 

Same is true for Scala or Python Notebooks interacting with a Spark, running in local or cluster mode. 



Sent from my iPhone
Pardon the dumb thumb typos :)

On Feb 28, 2016, at 1:48 PM, Ashok Kumar <> wrote:

  Hi Gurus,

Appreciate if you recommend me a good book on Spark or documentation for beginner to moderate knowledge

I very much like to skill myself on transformation and action methods.

FYI, I have already looked at examples on net. However, some of them not clear at least to me.

Warmest regards