spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Evo Eftimov" <evo.efti...@isecc.com>
Subject RE: Map one RDD into two RDD
Date Wed, 06 May 2015 09:49:59 GMT
RDD1 = RDD.filter()

RDD2 = RDD.filter()

 

From: Bill Q [mailto:bill.q.hdp@gmail.com] 
Sent: Tuesday, May 5, 2015 10:42 PM
To: user@spark.apache.org
Subject: Map one RDD into two RDD

 

Hi all,

I have a large RDD that I map a function to it. Based on the nature of each record in the
input RDD, I will generate two types of data. I would like to save each type into its own
RDD. But I can't seem to find an efficient way to do it. Any suggestions?

 

Many thanks.

 

 

Bill



-- 

Many thanks.



Bill

 


Mime
View raw message