nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-1480) SolrIndexer to write to multiple servers.
Date Mon, 28 Aug 2017 17:21:01 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144081#comment-16144081
] 

ASF GitHub Bot commented on NUTCH-1480:
---------------------------------------

r0ann3l opened a new pull request #218: fix for NUTCH-1480 contributed by r0ann3l
URL: https://github.com/apache/nutch/pull/218
 
 
   With this patch now we can have many instances of the same IndexWriter class, but with
different configurations. Also, we can copy, rename or remove fields of documents for every
index writer individually. Besides, the parameters needed by the index writers will be into
separated XML files, so them will be not into nutch-site.xml anymore.
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> SolrIndexer to write to multiple servers.
> -----------------------------------------
>
>                 Key: NUTCH-1480
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1480
>             Project: Nutch
>          Issue Type: Improvement
>          Components: indexer
>            Reporter: Markus Jelsma
>            Assignee: Markus Jelsma
>            Priority: Minor
>         Attachments: adding-support-for-sharding-indexer-for-solr.patch, NUTCH-1480-1.6.1.patch
>
>
> SolrUtils should return an array of SolrServers and read the SolrUrl as a comma delimited
list of URL's using Configuration.getString(). SolrWriter should be able to handle this list
of SolrServers.
> This is useful if you want to send documents to multiple servers if no replication is
available or if you want to send documents to multiple NOCs.
> edit:
> This does not replace NUTCH-1377 but complements it. With NUTCH-1377 this issue allows
you to index to multiple SolrCloud clusters at the same time.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message