lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adrien Grand (JIRA)" <>
Subject [jira] [Commented] (LUCENE-7834) BlockTree's terms index should be loaded into memory lazily
Date Fri, 02 Jun 2017 07:52:04 GMT


Adrien Grand commented on LUCENE-7834:

I agree with Mike that we should not make lazy loading possible. I don't think this change
improves NRT delays, and if memory is a concern I'd rather increase the block sizes, which
effectively improves the worst-case scenario, than enable lazy-loading, which only helps if
not all fields are used. Also delaying to search-time a problem that should have occurred
at open-time sounds wrong to me.

> BlockTree's terms index should be loaded into memory lazily
> -----------------------------------------------------------
>                 Key: LUCENE-7834
>                 URL:
>             Project: Lucene - Core
>          Issue Type: Improvement
>          Components: core/codecs
>            Reporter: David Smiley
>            Assignee: David Smiley
>         Attachments: LUCENE_7834_BlockTreeLazyFST.patch
> I propose that BlockTree delay loading the FST prefix terms index into memory until {{terms(String)}}
is first called.  This seems like how it should work since if someone wants to eager load
then they can use {{IndexReaderWarmer}}.  By making the FST lazy load, we can be more NRT
friendly (if some fields are rarely used), and also save memory (if some fields are rarely

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message