spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gerard Maas <>
Subject Re: A new resource for getting examples of Spark RDD API calls
Date Tue, 13 May 2014 12:14:42 GMT
Hi Zhen,

Thanks a lot for sharing. I'm sure it will be useful for new users.

A small note: On the 'checkpoint' explanation:
it would be useful to specify that 'my_directory_name' should exist in all
slaves. As an alternative you could use an HDFS directory URL as well.
I've seen people tripping on that few times.

-kr, Gerard.

On Fri, May 9, 2014 at 11:54 PM, zhen <> wrote:

> Hi Everyone,
> I found it quite difficult to find good examples for Spark RDD API calls.
> So
> my student and I decided to go through the entire API and write examples
> for
> the vast majority of API calls (basically examples for anything that is
> remotely interesting). I think these examples maybe useful to other people.
> Hence I have put them up on my web site. There is also a pdf version that
> you can download from the web site.
> Please let me know if you find any errors in them. Or any better examples
> you would like me to add into it.
> Hope you find it useful.
> Zhen
> --
> View this message in context:
> Sent from the Apache Spark User List mailing list archive at

View raw message