drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Deneche A. Hakim (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-4247) Parquet statistics are ignored for tables created with partitioning
Date Tue, 05 Jan 2016 19:32:40 GMT
Deneche A. Hakim created DRILL-4247:

             Summary: Parquet statistics are ignored for tables created with partitioning
                 Key: DRILL-4247
                 URL: https://issues.apache.org/jira/browse/DRILL-4247
             Project: Apache Drill
          Issue Type: Bug
            Reporter: Deneche A. Hakim
            Assignee: Jason Altekruse

I am running all queries in embedded mode, using the latest master:
* e4372f2 2015-12-17 | DRILL-4242: Updates to storage-mongo (HEAD -> master, origin/master,
origin/HEAD, origin/DRILL-3478) [Ross Lawley]

First run the following query:
create table dfs.tmp.test partition by (l_moddate) as select l.*, l_shipdate - extract(day
from l_shipdate) + 1 l_moddate from cp.`tpch/lineitem.parquet` l;

then query the table just created:
select * from dfs.tmp.test order by l_orderkey;

after you close sqlline you should see the following warning
Jan 5, 2016 11:25:55 AM WARNING: org.apache.parquet.CorruptStatistics: Ignoring statistics
because created_by is null or empty! See PARQUET-251 and PARQUET-297

To make sure the warning was not generated by the ctas, I closed sqlline between the queries.

I tried some variations of the query and I don't see the warning when there is no partitioning
or if I partition on a column other than date (didn't try all types though).

This message was sent by Atlassian JIRA

View raw message