lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joel Bernstein (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (SOLR-8588) Add TopicStream to the streaming API
Date Sun, 31 Jan 2016 19:25:39 GMT

    [ https://issues.apache.org/jira/browse/SOLR-8588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15125455#comment-15125455
] 

Joel Bernstein edited comment on SOLR-8588 at 1/31/16 7:24 PM:
---------------------------------------------------------------

I think this ticket is the one I'm most excited about at the moment because it leverages so
many of Solr's strengths. Topics can be arbitrary queries so they don't have to be registered
in advance. It leverages Solr's transaction log and version number. SolrCloud replication
provides scale and redundancy. Combined with DaemonStreams, topics can "live" inside Solr
and continually push data, or can be embedded in client apps to provide continuous streaming.


was (Author: joel.bernstein):
I think this ticket is the one I'm most excited about at the moment because it leverages so
many of the Solr's strengths. Topics can be arbitrary queries so they don't have to be registered
in advance. It leverages Solr's transaction log and version number. SolrCloud replication
provides scale and redundancy. Combined with DaemonStreams, topics can "live" inside Solr
and continually push data, or can be embedded in client apps to provide continuous streaming.

> Add TopicStream to the streaming API
> ------------------------------------
>
>                 Key: SOLR-8588
>                 URL: https://issues.apache.org/jira/browse/SOLR-8588
>             Project: Solr
>          Issue Type: New Feature
>            Reporter: Joel Bernstein
>            Assignee: Joel Bernstein
>
> Topics are similar to Alerts (SOLR-8577) in that they return only new content. But Topics
return *all* new documents for a query, where Alerts return the top N results. So where Alerts
are designed to notify of very specific new content, Topics are primarily a syndication tool.
> When combined with the DaemonStream (SOLR-8550), Topics can provide continuous streaming.
Sample syntax:
> {code}
> topic(checkpointCollection, dataCollection, q="awesome stuff")
> {code}
> The checkpoint collection will be used to persist the topic checkpoints.
> Example combined with the DaemonStream:
> {code}
> daemon(topic(...)...)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message