spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yin Huai (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-6123) Parquet reader should use the schema of every file to create converter
Date Mon, 02 Mar 2015 23:38:06 GMT
Yin Huai created SPARK-6123:
-------------------------------

             Summary: Parquet reader should use the schema of every file to create converter
                 Key: SPARK-6123
                 URL: https://issues.apache.org/jira/browse/SPARK-6123
             Project: Spark
          Issue Type: Bug
          Components: SQL
            Reporter: Yin Huai


For two parquet files for the same table having an array column, if values of the array in
one file was created when containsNull was true and those in another file was created when
containsNull was false, the containsNull in the merged schema will be true and we cannot correctly
read data from the table created with containsNull=false. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message