spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From yh18190 <>
Subject Regarding Successive operation on elements and recursively
Date Tue, 18 Mar 2014 22:11:50 GMT
 Hi ,
>I am new to Spark scala environment.Currently I am working on Discrete
wavelet transformation algos on time series data.
> I  have to perform recursive additions on successive elements in RDDs.
> for example
> List of elements(RDDS) --a1 a2 a3 a4.....
> level1 Tranformation --a1+a2  a3+a4  a1-a2  a3-a4
> level 2---(a1+a2)+(a3+a4) (a1+a2)-(a3+a4)

Is their a way to provide indexing to elements in distributed environment
across nodes so that I know that i am referring to a2 after a1 ..I want to
perform successive addition of only two elements and in a recursive manner

Could you please help me in this aspect..I would be really thankful to you..

View this message in context:
Sent from the Apache Spark User List mailing list archive at

View raw message