lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Atri Sharma (JIRA)" <j...@apache.org>
Subject [jira] [Created] (LUCENE-8675) Divide Segment Search Amongst Multiple Threads
Date Thu, 31 Jan 2019 17:27:00 GMT
Atri Sharma created LUCENE-8675:
-----------------------------------

             Summary: Divide Segment Search Amongst Multiple Threads
                 Key: LUCENE-8675
                 URL: https://issues.apache.org/jira/browse/LUCENE-8675
             Project: Lucene - Core
          Issue Type: Improvement
          Components: core/search
            Reporter: Atri Sharma


Segment search is a single threaded operation today, which can be a bottleneck for large analytical
queries which index a lot of data and have complex queries which touch multiple segments (imagine
a composite query with range query and filters on top). This ticket is for discussing the
idea of splitting a single segment into multiple threads based on mutually exclusive document
ID ranges.

This will be a two phase effort, the first phase targeting queries returning all matching
documents (collectors not terminating early). The second phase patch will introduce staged
execution and will build on top of this patch.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message