nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Julien Nioche (JIRA)" <>
Subject [jira] [Commented] (NUTCH-1517) CloudSearch indexer
Date Thu, 19 Sep 2013 09:41:56 GMT


Julien Nioche commented on NUTCH-1517:


I had a quick look at your plugin. Here are a few things I found : 

* serious bug : the batch doesn't get cleared in the CloudSearchBatcher. The batch gets larger
and larger as a result with the same docs sent multiple times
* build your patch against the trunk - not a released version - some things might have moved
* move the README file to the src/plugin/indexer-cloudsearch dir
* populate the language field from the value generated by the LanguageIndexingFilter with
a default to 'en' if it's not there
* in the readme and in your comments above maybe explain where to find the doc for CloudSearch,
how to create a domain and declare the fields etc... People usually know how to apply a patch
and run Nutch, but not how to deal with CloudSearch
* use the generic indexer - not the solr command 



> CloudSearch indexer
> -------------------
>                 Key: NUTCH-1517
>                 URL:
>             Project: Nutch
>          Issue Type: New Feature
>          Components: indexer
>            Reporter: Julien Nioche
>             Fix For: 1.9
>         Attachments: 0023883254_1377197869_indexer-cloudsearch.patch
> Once we have made the indexers pluggable, we should add a plugin for Amazon CloudSearch.
See Apparently it uses a JSON based representation Search
Data Format (SDF), which we could reuse for a file based indexer.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message