lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Simon Willnauer (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (LUCENE-3216) Store DocValues per segment instead of per field
Date Tue, 28 Jun 2011 15:43:16 GMT

     [ https://issues.apache.org/jira/browse/LUCENE-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Simon Willnauer updated LUCENE-3216:
------------------------------------

    Attachment: LUCENE-3216.patch

next iteration. this patch also includes FixedStraightBytes converted to use an in memory
ByteBlockPool for indexing and straight disk access for merging. Yet, I tend to leave out
the VarStraightBytes variant and open a follow up issue that converts the VarStraight case
to use a skip list. 

A review would be cool otherwise I will commit in a day or two if nobody objects.

> Store DocValues per segment instead of per field
> ------------------------------------------------
>
>                 Key: LUCENE-3216
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3216
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: core/index
>    Affects Versions: 4.0
>            Reporter: Simon Willnauer
>            Assignee: Simon Willnauer
>             Fix For: 4.0
>
>         Attachments: LUCENE-3216.patch, LUCENE-3216.patch, LUCENE-3216_floats.patch
>
>
> currently we are storing docvalues per field which results in at least one file per field
that uses docvalues (or at most two per field per segment depending on the impl.). Yet, we
should try to by default pack docvalues into a single file if possible. To enable this we
need to hold all docvalues in memory during indexing and write them to disk once we flush
a segment. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message