spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nirmal Fernando <nir...@wso2.com>
Subject Re: Applying transformations on a JavaRDD using reflection
Date Wed, 09 Sep 2015 03:45:10 GMT
Any thoughts?

On Tue, Sep 8, 2015 at 3:37 PM, Nirmal Fernando <nirmal@wso2.com> wrote:

> Hi All,
>
> I'd like to apply a chain of Spark transformations (map/filter) on a given
> JavaRDD. I'll have the set of Spark transformations as Function<T,A>, and
> even though I can determine the classes of T and A at the runtime, due to
> the type erasure, I cannot call JavaRDD's transformations as they expect
> generics. Any idea on how to resolve this?
>
> --
>
> Thanks & regards,
> Nirmal
>
> Team Lead - WSO2 Machine Learner
> Associate Technical Lead - Data Technologies Team, WSO2 Inc.
> Mobile: +94715779733
> Blog: http://nirmalfdo.blogspot.com/
>
>
>


-- 

Thanks & regards,
Nirmal

Team Lead - WSO2 Machine Learner
Associate Technical Lead - Data Technologies Team, WSO2 Inc.
Mobile: +94715779733
Blog: http://nirmalfdo.blogspot.com/

Mime
View raw message