spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From wallacemann <wall...@bandpage.com>
Subject How to create RDD from Java in-memory data?
Date Tue, 11 Mar 2014 00:26:51 GMT
I would like to construct an RDD from data I already have in memory as POJO
objects.  Is this possible?  For example, is it possible to create an RDD
from Iterable<String>?

I'm running Spark from Java as a stand-alone application.  The JavaWordCount
example runs fine.  In the example, the initial RDD is populated from a text
file.  In my use case, I'm streaming data from a database, but even this is
hidden behind an interface which is essentially Iterable<String>.

What I am doing is so basic that I must not understand something obvious. 
Thanks for any suggestions.




--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-create-RDD-from-Java-in-memory-data-tp2486.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Mime
View raw message