lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nigel <>
Subject Re: Will doc ids ever change if nothing is deleted?
Date Fri, 14 May 2010 20:20:03 GMT
Right, but my question was whether merging segments will renumber docs *if
no documents are deleted*.  Empirically, the answer is no.  I've written
test code that indexes documents with a field equal to each document's
current id, and verified that the ids still match the field values even
after merges and optimizes are done, if no docs are deleted.  This seems to
indicate that merging always preserves the current id order, which
is perhaps the obvious way to implement merging.  (Though of course an
alternative reasonable implementation, for example. might have been to add
everything from one segment to the merged segment, then add everything from
the next segment, etc., thus renumbering everything.)

Given all the misinformation or ambiguous information on this topic that
I've found, I was hoping to clear this up definitively.  My test case
doesn't prove that there's not some way for ids to change in certain
circumstances (apart from deletions, which is documented clearly).  But
right now I don't see any reason not to believe the FAQ entry mentioned in
my original email.


On Fri, May 14, 2010 at 2:04 PM, Chris Lu <> wrote:

> The doc id will get changed if the segments are merged. The doc id is more
> depending on the order of documents being added.
> Just think about it. The doc ids are starting from 0 to N. And when some
> documents are deleted, they are marked deleted on .del file. So no change
> there. When some documents are added, the id is N+1.
> Of course, if some documents from other segments are merged. The documents
> in one segment will "lose" its doc id.
> --
> Chris Lu
> -------------------------
> Instant Scalable Full-Text Search On Any Database/Application
> site:
> demo:
> Lucene Database Search in 3 minutes:
> DBSight customer, a shopping comparison site, (anonymous per request) got
> 2.6 Million Euro funding!
> On 05/13/2010 06:38 PM, Nigel wrote:
>> The FAQ clearly states that document IDs will not be re-assigned unless
>> something was deleted.
>> However, a number of other emails and posts I've read mention that
>> renumbering occurs when segments are merged.  Maybe what people mean
>> is simply that when something is deleted, nothing is immediately
>> renumbered,
>> and it's not until merge time that the renumbering happens.  (This is my
>> understanding of how it works.)
>> Just so I'm 100% clear, if I never delete anything, will the IDs ever
>> change?
>> Thanks,
>> Chris
>  ---------------------------------------------------------------------
> To unsubscribe, e-mail:
> For additional commands, e-mail:

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message