lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joel Bernstein (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SOLR-6398) Add IterativeMergeStrategy to support Parallel Iterative Algorithms
Date Tue, 10 Feb 2015 17:45:14 GMT

     [ https://issues.apache.org/jira/browse/SOLR-6398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Joel Bernstein updated SOLR-6398:
---------------------------------
    Description: 
This ticket builds on the existing AnalyticsQuery / MergeStrategy framework by adding the
abstract class IterativeMergeStrategy,  which has built-in support for call-backs to the shards.
By extending this class you can plugin Parallel iterative Algorithms, such as Gradient Descent,
that will run efficiently inside Solr. 




  was:
The main inspiration for this ticket came from this presentation:

http://www.slideshare.net/jpatanooga/hadoop-summit-eu-2013-parallel-linear-regression-iterativereduce-and-yarn

This ticket builds on the existing AnalyticsQuery / MergeStrategy framework by adding the
abstract class IterativeMergeStrategy,  which has built-in support for call-backs to the shards.
By extending this class you can plugin parallel iterative algorithms that will run efficiently
inside Solr.

I will update this ticket with more information about the design soon.




> Add IterativeMergeStrategy to support Parallel Iterative Algorithms
> -------------------------------------------------------------------
>
>                 Key: SOLR-6398
>                 URL: https://issues.apache.org/jira/browse/SOLR-6398
>             Project: Solr
>          Issue Type: Improvement
>            Reporter: Joel Bernstein
>            Priority: Minor
>         Attachments: SOLR-6398.patch, SOLR-6398.patch, SOLR-6398.patch
>
>
> This ticket builds on the existing AnalyticsQuery / MergeStrategy framework by adding
the abstract class IterativeMergeStrategy,  which has built-in support for call-backs to the
shards. By extending this class you can plugin Parallel iterative Algorithms, such as Gradient
Descent, that will run efficiently inside Solr. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message