lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "William Pierce" <evalsi...@hotmail.com>
Subject DIH out of memory exception
Date Tue, 27 Oct 2009 18:32:54 GMT
Folks:

My db contains approx 6M records -- on average each is approx 1K bytes.   When I use the DIH,
 I reliably get an OOM exception.   The machine has 4 GB ram,  my tomcat is set to use max
heap of 2G.  

The option of increasing memory is not tenable coz as the number of documents grows I will
be back in this situation.  

Is there a way to batch the documents?  I tried setting the batchsize parameter to 500 on
the <dataSource> tag where I specify the jdbc parameters.   This had no effect.

Best,

- Bill
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message