lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Earwin Burrfoot (JIRA)" <>
Subject [jira] Commented: (LUCENE-2361) OutOfMemoryException while Indexing
Date Sat, 03 Apr 2010 00:22:27 GMT


Earwin Burrfoot commented on LUCENE-2361:

Basically, my bet is you're using a truckload of unique field names. Lucene interns them for
speed, as it does quite a lot of field name comparisons, and the whole thing explodes.
Unless you fill up your PermGen in some other manner, and Lucene just happens to hit the consequences.

The strange thing is - last time I tested String.intern(), it failed to cause OOMs being bombarded
by random strings, like it did in java 1.4.something.

> OutOfMemoryException while Indexing
> -----------------------------------
>                 Key: LUCENE-2361
>                 URL:
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: Index
>    Affects Versions: 2.9.1
>         Environment: Windows
>            Reporter: Shivender Devarakonda
> Hi,
> We use lucene 2.9.1 version.
> We see the following OutOfMemory error in our environment, I think This is happening
at a significant high load. Have you observed this anytime? Please let me know your thoughts
on this.
> org.apache.lucene.index.MergePolicy$MergeException: java.lang.OutOfMemoryError: PermGen
> 	at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(
> 	at org.apache.lucene.index.ConcurrentMergeScheduler$
> Caused by: java.lang.OutOfMemoryError: PermGen space
> 	at java.lang.String.$$YJP$$intern(Native Method)
> 	at java.lang.String.intern(Unknown Source)
> 	at org.apache.lucene.util.SimpleStringInterner.intern(
> 	at org.apache.lucene.util.StringHelper.intern(
> 	at
> 	at org.apache.lucene.index.FieldInfos.<init>(
> 	at org.apache.lucene.index.SegmentReader$CoreReaders.<init>(
> 	at org.apache.lucene.index.SegmentReader.get(
> 	at org.apache.lucene.index.SegmentReader.get(
> 	at org.apache.lucene.index.IndexWriter$ReaderPool.get(
> 	at org.apache.lucene.index.IndexWriter.mergeMiddle(
> 	at org.apache.lucene.index.IndexWriter.merge(
> 	at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(
> 	at org.apache.lucene.index.ConcurrentMergeScheduler$

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message