drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arjun (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-6640) Drill takes long time in planning when there are large number of files in views/tables DFS parent directory
Date Thu, 26 Jul 2018 18:26:00 GMT
Arjun created DRILL-6640:
----------------------------

             Summary: Drill takes long time in planning when there are large number of files
in  views/tables DFS parent directory
                 Key: DRILL-6640
                 URL: https://issues.apache.org/jira/browse/DRILL-6640
             Project: Apache Drill
          Issue Type: Improvement
          Components: Query Planning &amp; Optimization
            Reporter: Arjun


When Drill is usedĀ for querying views/ tables, the query planning time increases as the number
of files in views/tables parent directory increases. This becomes unacceptably long with complex
queries that involve multiple joins between such views/tables.

This is caused by globStatus operation on view files using GLOB to retrieve view file status.
This can be improved by avoiding the usage of GLOB pattern for Drill metadata files like view
files.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message