lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jack Krupansky" <j...@basetechnology.com>
Subject Re: index copy omits documents
Date Wed, 02 Jan 2013 14:03:16 GMT
Do you have any soft commits (or commitWithin that is a soft commit) that 
show up in queries but haven't yet been committed to disk? You have to do a 
hard commit to flush those to disk.

-- Jack Krupansky

-----Original Message----- 
From: UnConundrum
Sent: Wednesday, January 02, 2013 8:42 AM
To: solr-user@lucene.apache.org
Subject: index copy omits documents

I replicate from a live server to a backup server.  That backup server is
also used for development, so every night by cron, and sometimes manually, I
execute the following script to update a development core on the backup
server:


date
echo "stopping mysql slave"
mysqladmin -u intranet -ppassword stop-slave
echo "stopping solr replication"
curl
http://my_live_server.com:8983/solr/production/admin/replication?command=disablereplication/
echo "copying and uploading mysql tables"
mysqldump -u intranet -ppassword intranet_beta | mysql -u intranet
-ppassword intranet_beta_dev
echo copying production solr index to development
rm -rf /solr/test_site/development/data/*
cp -rf  /solr/test_site/production/data/* /solr/test_site/development/data/
echo "restarting solr replication"
curl
http://my_live_server.com:8983/solr/production/admin/replication?command=enablereplication/
echo "restarting mysql replication/slave"
mysqladmin -u intranet -ppassword start-slave
echo "finished"
date


I noticed last night that many documents are being omitted.  On the
production core, numDocs is 2476185, while on the development core numDocs
is 2357785, about 5% less.  The live server reports 2476192 docs (diff is
due to delay on my part).

Does anyone have any idea why a copy of the directory doesn't result in the
same number of documents?
(FYI, this is affecting my development as queries are missing documents).

Thanks in advance.




--
View this message in context: 
http://lucene.472066.n3.nabble.com/index-copy-omits-documents-tp4030043.html
Sent from the Solr - User mailing list archive at Nabble.com. 


Mime
View raw message