spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tobias Pfeiffer <>
Subject Re: I think I am almost lost in the internals of Spark
Date Wed, 07 Jan 2015 01:24:44 GMT

On Tue, Jan 6, 2015 at 11:24 PM, Todd <> wrote:

> I am a bit new to Spark, except that I tried simple things like word
> count, and the examples given in the spark sql programming guide.
> Now, I am investigating the internals of Spark, but I think I am almost
> lost, because I could not grasp a whole picture what spark does when it
> executes the word count.

I recommend understanding what an RDD is and how it is processed, using
and probably also
  (once the server is back).
Understanding how an RDD is processed is probably most helpful to
understand the whole of Spark.


View raw message