lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron Simmons (JIRA)" <>
Subject [jira] [Commented] (SOLR-3484) LogUpdateProcessor throws ConcurrentModificationException under multi-threading calls
Date Wed, 06 Jun 2012 19:34:23 GMT


Aaron Simmons commented on SOLR-3484:

I have read the related tickets [SOLR-2694, SOLR-2804, SOLR-2694] .. and I still think this
is a bug in LogUpdateProcessor, or maybe SolrWriter's usage of LogUpdateProcessor?!?

My environment is a Solr Cloud instance with 21 nodes.  (solr-spec-version=

When we kicked off a regular full-import of a data source (~5 million rows) .. it starts off
fine, but then the import crashes.  Looking over the log files, I find this on one of the

INFO: [core_NAME_slice11_shard1] webapp=/solr path=/select params={command=status&qt=/dataimport}
status=0 QTime=1
Jun 5, 2012 7:24:22 PM org.apache.solr.handler.dataimport.SolrWriter upload

WARNING: Error creating document : SolrInputDocument[{ --LOTS OF DATA HERE-- }]
        at java.util.HashMap$HashIterator.nextEntry(
        at java.util.HashMap$
        at org.apache.solr.common.params.ModifiableSolrParams.add(
        at org.apache.solr.common.params.ModifiableSolrParams.<init>(
        at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(
        at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(
        at org.apache.solr.handler.dataimport.SolrWriter.upload(
        at org.apache.solr.handler.dataimport.DataImportHandler$1.upload(
        at org.apache.solr.handler.dataimport.DocBuilder.buildDocument(
        at org.apache.solr.handler.dataimport.DocBuilder.buildDocument(
        at org.apache.solr.handler.dataimport.DocBuilder.doFullDump(
        at org.apache.solr.handler.dataimport.DocBuilder.execute(
        at org.apache.solr.handler.dataimport.DataImporter.doFullImport(
        at org.apache.solr.handler.dataimport.DataImporter.runCmd(
        at org.apache.solr.handler.dataimport.DataImporter$

We are using the 'out of the box' DataImportHandler, connecting to a SQL Server, etc.  This
seems like a real issue/bug that in org.apache.solr.update.processor.LogUpdateProcessor.

I saw the patch from SOLR-2804 on 1/1/2012 ... and this seems like a valid fix.  But some
people made comments and indicated it was not a valid fix, perhaps communicating that it's
not a real problem?  And SOLR-2804 was closed with "Won't Fix" ... and this bug report is
marked as "Not a Problem".

I see this as a very real problem .. but maybe I'm not understanding something.  Thoughts
> LogUpdateProcessor throws ConcurrentModificationException under multi-threading calls

> --------------------------------------------------------------------------------------
>                 Key: SOLR-3484
>                 URL:
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>    Affects Versions: 4.0
>         Environment: linux
>            Reporter: Ethan Tao
> Using the LogUpdateProcessor in a singleton chain for concurrent processing throws exception.
The issue has been reported in SOLR-2694 (closed), and an unoffical patch can be found in
related bug-id SOLR-2804 patch dated 1/1/12.
> If the patch won't become official for LogUpdateProcessor, suggested to have new class
"ConcurrentLogUpdateProcessorFactory" to address the thread safe issue.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message