lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephen Bochinski (JIRA)" <>
Subject [jira] Updated: (SOLR-1961) Use Lucene's Field Cache To Retrieve Stored Fields From Memory
Date Fri, 09 Jul 2010 00:24:52 GMT


Stephen Bochinski updated SOLR-1961:

    Attachment: field_cache.patch

I removed the cases where printing was being done to stdout. I also bubbled up the IOExceptions
to a consolidated section. Added a little to the test case as well to test more realistic
versions of fields with Strings in them.

> Use Lucene's Field Cache To Retrieve Stored Fields From Memory
> --------------------------------------------------------------
>                 Key: SOLR-1961
>                 URL:
>             Project: Solr
>          Issue Type: New Feature
>          Components: search
>    Affects Versions: 1.4
>            Reporter: Stephen Bochinski
>         Attachments: field_cache.patch, field_cache.patch, patch.txt
>   Original Estimate: 101.5h
>  Remaining Estimate: 101.5h
> This allows the user to configure which fields should be field cached in the schema.xml
file by adding the following attribute:
> fieldCached="true"
> Enabling this on a field greatly decreases the time needed to retrieve stored fields.
This works on fields containing Bytes, Strings, Integers, Longs, and Floats. Enabling field
cache is applicable in many scenarios. For instance, if you have a bunch of text that is indexed
and not stored and you only need to retrieve a string or number associated with a document.
Its applicable in any case where there are many indexed fields and not too many stored fields
being retrieved. The memory consumption is not very high compared to the performance gains
field cache brings.
> Memory consumption is governed by: Number of fields cached * Number of documents *  8
bytes per reference +
> 	SUM(Number of unique values of the field  * average length of term)  * 2 (chars use
2 bytes) * String overhead (40 bytes)

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message