lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Muir (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (LUCENE-5720) Optimize on disk packed integers part 2
Date Mon, 02 Jun 2014 10:45:02 GMT

     [ https://issues.apache.org/jira/browse/LUCENE-5720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Robert Muir updated LUCENE-5720:
--------------------------------

    Attachment: LUCENE-5720.patch

Updated patch: since we are using these for numerics (and in those cases high BPV is common,
e.g. floats/doubles/etc), i added 'byte' cases for bpv > 32 (40,48,56,64). I changed the
upgrade logic, to try to go to byte first, then nibble. 

This means it also works like the in-ram one: if you pass FASTEST it always goes to some multiple
of a byte.


> Optimize on disk packed integers part 2
> ---------------------------------------
>
>                 Key: LUCENE-5720
>                 URL: https://issues.apache.org/jira/browse/LUCENE-5720
>             Project: Lucene - Core
>          Issue Type: Improvement
>            Reporter: Robert Muir
>             Fix For: 4.9, 5.0
>
>         Attachments: LUCENE-5720.patch, LUCENE-5720.patch, LUCENE-5720.patch
>
>
> These are heavily optimized for the in-RAM case (for example FieldCache uses PackedInts.FAST
to make it even faster so), but for the docvalues case they are not: we always essentially
use COMPACT, we have only one decoder that must solve all the cases, even the complicated
ones, we use BlockPackedWriter for all integers (even if they are ordinals), etc.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message