nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Ciborowski (JIRA)" <>
Subject [jira] [Commented] (NUTCH-1517) CloudSearch indexer
Date Tue, 10 Sep 2013 13:02:52 GMT


Daniel Ciborowski commented on NUTCH-1517:

git clone
cd nutch/
git checkout -t origin/branch-1.7
patch -p0 -i ~/0023883254_1377197869_indexer-cloudsearch.patch 
vi conf/nutch-default.xml
cd runtime/local/
mkdir -p urls
echo "" > ./urls/seeds.txt 
bin/nutch crawl urls -dir crawl -depth 3 -topN 5
bin/nutch solrindex crawl/crawldb -linkdb crawl/linkdb crawl/segments/*

the vi step is where I add my crawler name, change solr to cloudsearch and add my endpoint
url. Tried to do this with sed to replace lines but couldn't figure it out. 
> CloudSearch indexer
> -------------------
>                 Key: NUTCH-1517
>                 URL:
>             Project: Nutch
>          Issue Type: New Feature
>          Components: indexer
>            Reporter: Julien Nioche
>             Fix For: 1.9
>         Attachments: 0023883254_1377197869_indexer-cloudsearch.patch
> Once we have made the indexers pluggable, we should add a plugin for Amazon CloudSearch.
See Apparently it uses a JSON based representation Search
Data Format (SDF), which we could reuse for a file based indexer.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message