lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From michael8 <mich...@saracatech.com>
Subject Re: dih.last_index_time - exacty what time is this capturing?
Date Mon, 12 Oct 2009 04:45:43 GMT

That's perfect.  Reimporting and reindexing some redundantly because of the
slight time overlap is worth the risk of losing docs.  Thanks Shalin.  

Michael


Shalin Shekhar Mangar wrote:
> 
> On Sun, Oct 11, 2009 at 9:46 PM, michael8 <michael@saracatech.com> wrote:
> 
>>
>> Thanks for your clarification Shalin.
>>
>> Given your explanation, would you agree that there is still a small
>> window
>> (how ever small this may be) where some documents could be missed in the
>> next delta using dih.last_index_time if the data source adds or updates
>> documents very frequently?  i.e. the time between the SQL done executing
>> and
>> data received by Solr to start indexing, some new/updated documents may
>> have
>> been written in the DB such that the timestamps for those documents are
>> slightly before the captured last_index_time when indexing starts?
>>
>>
> The last_index_time is recorded before any SQL queries are fired so I
> don't
> think any rows could be missed. Some could be imported more than once
> though.
> 
> -- 
> Regards,
> Shalin Shekhar Mangar.
> 
> 

-- 
View this message in context: http://www.nabble.com/dih.last_index_time---exacty-what-time-is-this-capturing--tp25827228p25850464.html
Sent from the Solr - User mailing list archive at Nabble.com.


Mime
View raw message