spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From wallacemann <>
Subject How to create RDD from Java in-memory data?
Date Tue, 11 Mar 2014 00:26:51 GMT
I would like to construct an RDD from data I already have in memory as POJO
objects.  Is this possible?  For example, is it possible to create an RDD
from Iterable<String>?

I'm running Spark from Java as a stand-alone application.  The JavaWordCount
example runs fine.  In the example, the initial RDD is populated from a text
file.  In my use case, I'm streaming data from a database, but even this is
hidden behind an interface which is essentially Iterable<String>.

What I am doing is so basic that I must not understand something obvious. 
Thanks for any suggestions.

View this message in context:
Sent from the Apache Spark User List mailing list archive at

View raw message