lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joel Bernstein (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SOLR-8709) Account for out-of-order version numbers in the TopicStream
Date Sun, 21 Feb 2016 17:52:18 GMT

     [ https://issues.apache.org/jira/browse/SOLR-8709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Joel Bernstein updated SOLR-8709:
---------------------------------
    Description: 
Currently the TopicStream can miss documents if version numbers are received out-of-order.
The TopicStream sorts on version number so it will only miss out-of-order versions that span
commit boundaries.

In order to resolve this issue we can adopt an approach that keeps a set of the last N version
numbers sent for each Topic.  As the documents are scanned we can check for documents within
this time window that do not appear in the sent set. These documents can then be sent.

  was:
Currently the TopicStream can miss documents if version numbers are received out-of-order.
The TopicStream sorts on version number so it will only miss out-of-order versions that span
commit boundaries.

In order to resolve this issue we can adopt an approach that keep a set of the last N version
numbers sent for each Topic.  As the documents are scanned we can check for documents within
this time window that do not appear in the sent set. These documents can then be sent.


> Account for out-of-order version numbers in the TopicStream
> -----------------------------------------------------------
>
>                 Key: SOLR-8709
>                 URL: https://issues.apache.org/jira/browse/SOLR-8709
>             Project: Solr
>          Issue Type: Bug
>            Reporter: Joel Bernstein
>
> Currently the TopicStream can miss documents if version numbers are received out-of-order.
The TopicStream sorts on version number so it will only miss out-of-order versions that span
commit boundaries.
> In order to resolve this issue we can adopt an approach that keeps a set of the last
N version numbers sent for each Topic.  As the documents are scanned we can check for documents
within this time window that do not appear in the sent set. These documents can then be sent.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message