drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jacques Nadeau (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-1386) Enable Partition Pruning for filesystem queries
Date Mon, 08 Sep 2014 17:59:29 GMT
Jacques Nadeau created DRILL-1386:
-------------------------------------

             Summary: Enable Partition Pruning for filesystem queries
                 Key: DRILL-1386
                 URL: https://issues.apache.org/jira/browse/DRILL-1386
             Project: Apache Drill
          Issue Type: Improvement
          Components: Query Planning & Optimization, Storage - JSON, Storage - Parquet,
Storage - Text & CSV
    Affects Versions: 0.5.0
            Reporter: Jacques Nadeau
            Assignee: Aman Sinha
             Fix For: 0.6.0


If you have files:

/files/2012/Jan/log.csv
/files/2013/Jan/log.csv

And write the query "select * from `/files/` where dir0 = 2012 and dir1='Jan' "

Drill will read both files and then filter out all of the second file.  Drill should recognize
that dir0=2012 and dir1='Jan' can be pushed down into the storage layer to prune the files
read as part of the query.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message