spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alexander (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-7768) Make user-defined type (UDT) API public
Date Wed, 22 Aug 2018 17:25:01 GMT

    [ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16589146#comment-16589146
] 

Alexander commented on SPARK-7768:
----------------------------------

Thanks [~eje] and [~metasim] for the awesome examples! I haven't even considered writing custom
struct-types for my UDTs yet but this is completely doable! This UDTRegistration API is not
friendly enough to be used by Spark beginners (having to use InternalRow!) but there's absolutely
no reason it should still be private! TDigest and Tile are a bit complex for in introductory
Scala users to understand so maybe it makes sense to put together a simpler example. I made
an SO post talking about very basic usage of UDTRegistration here: https://stackoverflow.com/questions/36648128/how-to-store-custom-objects-in-dataset/51957666#51957666

> Make user-defined type (UDT) API public
> ---------------------------------------
>
>                 Key: SPARK-7768
>                 URL: https://issues.apache.org/jira/browse/SPARK-7768
>             Project: Spark
>          Issue Type: New Feature
>          Components: SQL
>            Reporter: Xiangrui Meng
>            Priority: Critical
>
> As the demand for UDTs increases beyond sparse/dense vectors in MLlib, it would be nice
to make the UDT API public in 1.5.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message