lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael McCandless (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (LUCENE-8671) Add setting for moving FST offheap/onheap
Date Fri, 22 Feb 2019 14:27:00 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16775190#comment-16775190
] 

Michael McCandless commented on LUCENE-8671:
--------------------------------------------

[~akjain] that's true, maybe we don't need per-field control and a single boolean option
would work?  We could maybe add a setter on {{BlockTreeTermsWriter}}?  And it'd write that
setting into the index, and {{BlockTreeTermsReader}} would read that and then load FSTs on
or off heap.

> Add setting for moving FST offheap/onheap
> -----------------------------------------
>
>                 Key: LUCENE-8671
>                 URL: https://issues.apache.org/jira/browse/LUCENE-8671
>             Project: Lucene - Core
>          Issue Type: New Feature
>          Components: core/FSTs, core/store
>            Reporter: Ankit Jain
>            Priority: Minor
>         Attachments: offheap_generic_settings.patch, offheap_settings.patch
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> While LUCENE-8635, adds support for loading FST offheap using mmap, users do not have
the  flexibility to specify fields for which FST needs to be offheap. This allows users to
tune heap usage as per their workload.
> Ideal way will be to add an attribute to FieldInfo, where we have put/getAttribute. Then
FieldReader can inspect the FieldInfo and pass the appropriate On/OffHeapStore when creating
its FST. It can support special keywords like ALL/NONE.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message