lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yashveer Rana <captainjackr...@gmail.com>
Subject Inconsistent document addition
Date Fri, 02 Jan 2015 14:43:34 GMT
I have a solr cloud setup with two collections A & B with different schemas (
although majority of fields are identical ). 
Collection A has ~ 3.6 million documents
Using *solrj 4.7.0 *

As per a requirement, my application 
- reads documents from collection A in batches of 10k
- Creates docs of type B, populates fields from the A type docs
- Calls addBeans() on collection A in batches of 500 and invokes commit

However, this operation does not add all documents to collection B and falls
short by about 80-90k. On re-executing the operation, there is an increment
in the doc count, but it still does not reach the desired number. On
multiple executions, eventually the count reaches the 3.6 figure

Just wondering if anyone has encountered such a behaviour before. Havent
seen any errors in solr logs generated either.





--
View this message in context: http://lucene.472066.n3.nabble.com/Inconsistent-document-addition-tp4177013.html
Sent from the Solr - User mailing list archive at Nabble.com.

Mime
View raw message