It looks like tickets has been opened for this but the fix isn't working..
https://jira.apache.org/jira/browse/DRILL-5983
Unsupported nullable converted type INT_8 for primitive type INT32 error
https://jira.apache.org/jira/browse/DRILL-4764
Parquet file with INT_16, etc. logical types not supported by simple SELECT
-----Original Message-----
From: Lee, David
Sent: Monday, June 18, 2018 6:16 AM
To: user@drill.apache.org
Subject: Problem wit nulls in parquet file for int_16 in parquet
Here's the list of all the datatypes for Parquet file metadata..
https://github.com/apache/parquet-format/blob/master/LogicalTypes.md
I recently started using PyArrow to generate parquet files and it looks like Drill can't convert
a primitive INT32 in the file to a logical INT_16 if it is NULL..
Query Failed: An Error Occurred
org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: ExecutionSetupException:
Unsupported nullable converted type INT_16 for primitive type INT32 Fragment 1:3
This message may contain information that is confidential or privileged. If you are not the
intended recipient, please advise the sender immediately and delete this message. See http://www.blackrock.com/corporate/en-us/compliance/email-disclaimers
for further information. Please refer to http://www.blackrock.com/corporate/en-us/compliance/privacy-policy
for more information about BlackRock’s Privacy Policy.
For a list of BlackRock's office addresses worldwide, see http://www.blackrock.com/corporate/en-us/about-us/contacts-locations.
© 2018 BlackRock, Inc. All rights reserved.
|