drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lee, David" <David....@blackrock.com>
Subject RE: Problem wit nulls in parquet file for int_16 in parquet
Date Mon, 18 Jun 2018 14:01:52 GMT
It looks like tickets has been opened for this but the fix isn't working..

https://jira.apache.org/jira/browse/DRILL-5983

Unsupported nullable converted type INT_8 for primitive type INT32 error

https://jira.apache.org/jira/browse/DRILL-4764

Parquet file with INT_16, etc. logical types not supported by simple SELECT


-----Original Message-----
From: Lee, David 
Sent: Monday, June 18, 2018 6:16 AM
To: user@drill.apache.org
Subject: Problem wit nulls in parquet file for int_16 in parquet

Here's the list of all the datatypes for Parquet file metadata..

https://github.com/apache/parquet-format/blob/master/LogicalTypes.md

I recently started using PyArrow to generate parquet files and it looks like Drill can't convert
a primitive INT32 in the file to a logical INT_16 if it is NULL..

Query Failed: An Error Occurred
org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: ExecutionSetupException:
Unsupported nullable converted type INT_16 for primitive type INT32 Fragment 1:3



This message may contain information that is confidential or privileged. If you are not the
intended recipient, please advise the sender immediately and delete this message. See http://www.blackrock.com/corporate/en-us/compliance/email-disclaimers
for further information.  Please refer to http://www.blackrock.com/corporate/en-us/compliance/privacy-policy
for more information about BlackRock’s Privacy Policy.

For a list of BlackRock's office addresses worldwide, see http://www.blackrock.com/corporate/en-us/about-us/contacts-locations.

© 2018 BlackRock, Inc. All rights reserved.
Mime
View raw message