lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alexey Shakov <alexey.sha...@menta.de>
Subject Re: too many open files
Date Mon, 14 Jul 2008 14:39:10 GMT
Yonik Seeley schrieb:
> On Mon, Jul 14, 2008 at 10:17 AM, Alexey Shakov <alexey.shakov@menta.de> wrote:
>   
>> Yonik Seeley schrieb:
>>     
>>> On Mon, Jul 14, 2008 at 5:14 AM, Alexey Shakov <alexey.shakov@menta.de>
>>>       
>>>> now we have set the limt to ~10000 files
>>>> but this is not the solution - the amount of open files increases
>>>> permanantly.
>>>> Earlier or later, this limit will be exhausted.
>>>>
>>>>         
>>> How can you tell? Are you seeing descriptor use continually growing?
>>>
>>> -Yonik
>>>       
>> 'deleted' index files, listed with lsof-command today, was listed (also as
>> deleted)
>> several days ago...
>>
>> But the amount of this 'deleted' files increases. So, I make a conclusion,
>> that this is the question of time, when the limit of 10000 will be reached.
>>     
>
> You are probably just seeing growth in the number of segments in the
> index... which means that any IndexReader will be holding open a
> larger number of files at any one time (and become deleted when the
> IndexWriter removes old segments).
>
> This growth in the number of segments isn't unbounded though (because
> of segment merges).  Your 10,000 descriptors should be sufficient.
>
> -Yonik
>
>
>   

Ok, thank you for the explanation. I will observ the open files amount 
over the time - hopefully it remains stable.

Best regards,
Alexey


>> Fortunately, the check-ins of new documents are seldom. The server (Tomcat)
>> was restarted (due to different software updates) relatively oft in the last
>> weeks...  So, we had no yet the possibility to reach this limit. But the
>> default open file limit (1024) was already reached several times (before we
>> increase it)…
>>
>> Thanks for your help !
>> Alexey
>>     


-- 
Alexey Shakov (Senior Software Entwickler/Architekt)
menta AG - The Information E-volution
<http://www.menta.de/>
Bodenseestraße 4, D-81241 München
Telefon: +49-89/87130-142
Telefax: +49-89/87130-146
Mobil: +49-177/3200615
E-Mail: <Alexey.Shakov@menta.de>
Eintrag: Amtsgericht München, HRB 125132
Vorstand: Reinhold Müller
Aufsichtsrat: Thomas N. Pieper (Vors.)



Mime
View raw message