lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bill Au <bill.w...@gmail.com>
Subject Re: frequency of commit when building index from scratch
Date Tue, 25 Aug 2009 21:41:06 GMT
That's my gut feeling (start big and go lower if OOM occurs) too.

Bill

On Tue, Aug 25, 2009 at 5:34 PM, Edward Capriolo <edlinuxguru@gmail.com>wrote:

> On Tue, Aug 25, 2009 at 5:29 PM, Bill Au<bill.w.au@gmail.com> wrote:
> > Just curious, how often do folks commit when building their Solr/Lucene
> > index from scratch for index with millions of documents?  Should I just
> wait
> > and do a single commit at the end after adding all the documents to the
> > index?
> >
> > Bill
> >
>
> Bill in most cases you probably cannot do one large commit as you will
> hit OOM. How many documents can be uncommitted is based on the size of
> the documents. Committing every document is slow. I have done a commit
> every 10,000 mostly. Results may vary. Someone might have a better
> answer then me.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message