spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-22192) An RDD of nested POJO objects cannot be converted into a DataFrame using SQLContext.createDataFrame API
Date Mon, 09 Oct 2017 09:44:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-22192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sean Owen updated SPARK-22192:
------------------------------
    Target Version/s:   (was: 2.2.0)

> An RDD of nested POJO objects cannot be converted into a DataFrame using SQLContext.createDataFrame
API
> -------------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-22192
>                 URL: https://issues.apache.org/jira/browse/SPARK-22192
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 2.2.0
>         Environment: Independent of OS / platform
>            Reporter: Asif Hussain Shahid
>            Priority: Minor
>
> If an RDD contains nested POJO objects, then SQLContext.createDataFrame(RDD, Class) api
only handles the top level POJO object. It throws ScalaMatchError exception when handling
the nested POJO object as the code does not recursively handle the nested POJOs.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message