spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kazuaki Ishizaki (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-25178) Directly ship the StructType objects of the keySchema / valueSchema for xxxHashMapGenerator
Date Thu, 23 Aug 2018 01:39:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-25178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Kazuaki Ishizaki updated SPARK-25178:
-------------------------------------
    Summary: Directly ship the StructType objects of the keySchema / valueSchema for xxxHashMapGenerator
 (was: Use dummy name for xxxHashMapGenerator key/value schema field)

> Directly ship the StructType objects of the keySchema / valueSchema for xxxHashMapGenerator
> -------------------------------------------------------------------------------------------
>
>                 Key: SPARK-25178
>                 URL: https://issues.apache.org/jira/browse/SPARK-25178
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 2.4.0
>            Reporter: Kris Mok
>            Priority: Minor
>
> Following SPARK-18952 and SPARK-22273, this ticket proposes to change the generated field
name of the keySchema / valueSchema to a dummy name instead of using {{key.name}}.
> In previous discussion from SPARK-18952's PR [1], it was already suggested that the field
names were being used, so it's not worth capturing the strings as reference objects here.
Josh suggested merging the original fix as-is due to backportability / pickability concerns.
Now that we're coming up to a new release, this can be revisited.
> [1]: https://github.com/apache/spark/pull/16361#issuecomment-270253719



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message