lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Manuel Le Normand <manuel.lenorm...@gmail.com>
Subject Re: Expunge deleting using excessive transient disk space
Date Sun, 08 Sep 2013 13:57:21 GMT
My fault for the typo, it slipped in while I wrote the mail.

Each server has 290GB mounted on /opt/solr, contains 2 different replicas
and has a total of 30GB free space.

This is why I wrote 15GB per shard


On Sun, Sep 8, 2013 at 2:56 PM, Erick Erickson <erickerickson@gmail.com>wrote:

> How much free disk space do you have when you
> try the merge?
>
> Is this a typo?
>
>  <int name=|maxMergeAtOnce">2</int>
> Note name=|
>
> Best
> Erick
>
>
> On Sun, Sep 8, 2013 at 7:26 AM, Manuel Le Normand <
> manuel.lenormand@gmail.com> wrote:
>
> > Hi again,
> > In order to delete part of my index I run a delete by query that intends
> to
> > erase 15% of the docs.
> > I added this params to the solrconfig.xml
> > <mergePolicy class="org.apache.lucene.index.TieredMergePolicy">
> >    <int name=|maxMergeAtOnce">2</int>
> >    <int name="maxMergeAtOnceExplicit">2</int>
> >    <double name="maxMergedSegmentMB">5000.0</double>
> >    <double name="reclaimDeletesWeight">10.0</double>
> >    <double name="segmentsPerTier">15.0</double>
> > </mergePolicy>
> >
> > The extra params were added in order to promote merge of old segments but
> > with restriction on the transient disk that can be used (as I have only
> > 15GB per shard).
> >
> > This procedure failed on a no space left on device exception, although
> > proper calculations show that these params should cause no usage excess
> of
> > the transient free disk space I have.
> >  Looking on the infostream I can see that the first merges do succeed but
> > older segments are kept in reference thus cannot be deleted until all the
> > merging are done.
> >
> > Is there anyway of overcoming this?
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message