lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jack Krupansky" <j...@basetechnology.com>
Subject Re: Expunge deleting using excessive transient disk space
Date Sun, 08 Sep 2013 12:58:26 GMT
You're in the wrong room! (Lucene/Java-user) Move the discussion over to the 
Solr user list.

-- Jack Krupansky

-----Original Message----- 
From: Erick Erickson
Sent: Sunday, September 08, 2013 7:56 AM
To: java-user
Subject: Re: Expunge deleting using excessive transient disk space

How much free disk space do you have when you
try the merge?

Is this a typo?

<int name=|maxMergeAtOnce">2</int>
Note name=|

Best
Erick


On Sun, Sep 8, 2013 at 7:26 AM, Manuel Le Normand <
manuel.lenormand@gmail.com> wrote:

> Hi again,
> In order to delete part of my index I run a delete by query that intends 
> to
> erase 15% of the docs.
> I added this params to the solrconfig.xml
> <mergePolicy class="org.apache.lucene.index.TieredMergePolicy">
>    <int name=|maxMergeAtOnce">2</int>
>    <int name="maxMergeAtOnceExplicit">2</int>
>    <double name="maxMergedSegmentMB">5000.0</double>
>    <double name="reclaimDeletesWeight">10.0</double>
>    <double name="segmentsPerTier">15.0</double>
> </mergePolicy>
>
> The extra params were added in order to promote merge of old segments but
> with restriction on the transient disk that can be used (as I have only
> 15GB per shard).
>
> This procedure failed on a no space left on device exception, although
> proper calculations show that these params should cause no usage excess of
> the transient free disk space I have.
>  Looking on the infostream I can see that the first merges do succeed but
> older segments are kept in reference thus cannot be deleted until all the
> merging are done.
>
> Is there anyway of overcoming this?
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message