lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jack Krupansky" <>
Subject Re: index copy omits documents
Date Wed, 02 Jan 2013 14:03:16 GMT
Do you have any soft commits (or commitWithin that is a soft commit) that 
show up in queries but haven't yet been committed to disk? You have to do a 
hard commit to flush those to disk.

-- Jack Krupansky

-----Original Message----- 
From: UnConundrum
Sent: Wednesday, January 02, 2013 8:42 AM
Subject: index copy omits documents

I replicate from a live server to a backup server.  That backup server is
also used for development, so every night by cron, and sometimes manually, I
execute the following script to update a development core on the backup

echo "stopping mysql slave"
mysqladmin -u intranet -ppassword stop-slave
echo "stopping solr replication"
echo "copying and uploading mysql tables"
mysqldump -u intranet -ppassword intranet_beta | mysql -u intranet
-ppassword intranet_beta_dev
echo copying production solr index to development
rm -rf /solr/test_site/development/data/*
cp -rf  /solr/test_site/production/data/* /solr/test_site/development/data/
echo "restarting solr replication"
echo "restarting mysql replication/slave"
mysqladmin -u intranet -ppassword start-slave
echo "finished"

I noticed last night that many documents are being omitted.  On the
production core, numDocs is 2476185, while on the development core numDocs
is 2357785, about 5% less.  The live server reports 2476192 docs (diff is
due to delay on my part).

Does anyone have any idea why a copy of the directory doesn't result in the
same number of documents?
(FYI, this is affecting my development as queries are missing documents).

Thanks in advance.

View this message in context:
Sent from the Solr - User mailing list archive at 

View raw message