lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Simon Willnauer (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (LUCENE-3216) Store DocValues per segment instead of per field
Date Wed, 29 Jun 2011 15:43:28 GMT

     [ https://issues.apache.org/jira/browse/LUCENE-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Simon Willnauer updated LUCENE-3216:
------------------------------------

    Attachment: LUCENE-3216.patch

I committed the latest patch, this patch is a first sketch using the CFS separately in DocValuesConsumer
/ Producer to reduce the number of files created by DocValues. Yet, this is currently two
files per codec in a segment (.cfs & .cfe) which is not too bad though but we could go
even further and have a global CFS for all docValues that could be pulled on demand

the patch still has some nocommits but all tests pass.

> Store DocValues per segment instead of per field
> ------------------------------------------------
>
>                 Key: LUCENE-3216
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3216
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: core/index
>    Affects Versions: 4.0
>            Reporter: Simon Willnauer
>            Assignee: Simon Willnauer
>             Fix For: 4.0
>
>         Attachments: LUCENE-3216.patch, LUCENE-3216.patch, LUCENE-3216.patch, LUCENE-3216.patch,
LUCENE-3216_floats.patch
>
>
> currently we are storing docvalues per field which results in at least one file per field
that uses docvalues (or at most two per field per segment depending on the impl.). Yet, we
should try to by default pack docvalues into a single file if possible. To enable this we
need to hold all docvalues in memory during indexing and write them to disk once we flush
a segment. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message