spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jaonary Rabarisoa <jaon...@gmail.com>
Subject Re: Data Frame types
Date Fri, 06 Mar 2015 16:25:58 GMT
Hi Cesar,

Yes, you can define an UDT with the new DataFrame, the same way that
SchemaRDD did.

Jaonary

On Fri, Mar 6, 2015 at 4:22 PM, Cesar Flores <cesar7@gmail.com> wrote:

>
> The SchemaRDD supports the storage of user defined classes. However, in
> order to do that, the user class needs to extends the UserDefinedType interface
> (see for example VectorUDT in org.apache.spark.mllib.linalg).
>
> My question is: Do the new Data Frame Structure (to be released in spark
> 1.3) will be able to handle user defined classes too? Do user classes will
> need to extend they will need to define the same approach?
>
>
> --
> Cesar Flores
>

Mime
View raw message