lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From John Wilson <sami.hailu...@gmail.com>
Subject Re: Three quick questions
Date Tue, 15 Jan 2019 22:11:46 GMT
Got it, thanks.

On Mon, Jan 14, 2019 at 6:01 AM Michael McCandless <
lucene@mikemccandless.com> wrote:

> Hi John,
>
> 1. When the total size across all in memory segments crosses 100 MB, then
> IW will pick the largest segment(s) to move to disk
> 2. There are in memory segments; when an indexing thread comes in, it will
> write to one segment and no other thread can write to that segment while
> that thread is indexing the one document.  We used to have some thread
> affinity so a given thread would prefer to write to the same in-memory
> segment but I think we don't do that anymore.  If an indexing thread
> arrives to index a doc, but all in memory segments are already handling
> other documents, then we will create a new in-memory segment for that
> thread to write to.
> 3. Should be .del files
>
> Mike McCandless
>
> http://blog.mikemccandless.com
>
>
> On Mon, Jan 7, 2019 at 7:08 PM John Wilson <sami.hailu.15@gmail.com>
> wrote:
>
>> Hi,
>>
>>
>>    1. Assume I have two index writer threads using an IndexWriter object
>>    (IndexWriter is thread safe) and my ramBufferSizeMB is set to 100M, then
>>    are segments created when each thread writes 100M or when the total size
>>    written in the buffers is 100M?
>>    2. Does each index writer thread writes its own segment or the two
>>    writers can write to the same segment (requiring synchronization)?
>>    3. When a document is deleted/updated, the document is marked and
>>    this info is stored in a separate file so that the next merge deletes the
>>    document. What would be a typical name (or extension) of the file in my
>>    index directory?
>>
>> Thanks,
>> John
>>
>

Mime
View raw message