nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Ciborowski (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (NUTCH-1517) CloudSearch indexer
Date Mon, 09 Sep 2013 18:25:52 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762115#comment-13762115
] 

Daniel Ciborowski edited comment on NUTCH-1517 at 9/9/13 6:24 PM:
------------------------------------------------------------------

Okay so it that issue of no segments being placed in hdfs was because I was using runtime/deploy/
instead of runtime/local/ so I'll worry about that later. Got it to run and all, but now I
am running into this error: 

CloudSearchIndexWriter
	cloudsearch.endpoint : URL of the CloudSearch domain's document endpoint. (mandatory)

I have set my value in the conf/nutch-default.xml like

<value>http://doc-placesearch-BLAHBLAHBLAH.us-east-1.cloudsearch.amazonaws.com/2011-02-01/documents/batch</value>

My cloudsearch access policy is set to 0.0.0.0/0

                
      was (Author: djc391):
    Okay so it that issue of no segments being placed in hdfs was because I was using runtime/deploy/
instead of runtime/local/ so I'll worry about that later. Got it to run and all, but now I
am running into this error: 

CloudSearchIndexWriter
	cloudsearch.endpoint : URL of the CloudSearch domain's document endpoint. (mandatory)

I have set my value in the conf/nutch-default.xml like

<value>http://doc-placesearch-BLAHBLAHBLAH.us-east-1.cloudsearch.amazonaws.com/2011-02-01/documents/batch</value>

                  
> CloudSearch indexer
> -------------------
>
>                 Key: NUTCH-1517
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1517
>             Project: Nutch
>          Issue Type: New Feature
>          Components: indexer
>            Reporter: Julien Nioche
>             Fix For: 1.9
>
>         Attachments: 0023883254_1377197869_indexer-cloudsearch.patch
>
>
> Once we have made the indexers pluggable, we should add a plugin for Amazon CloudSearch.
See http://aws.amazon.com/cloudsearch/. Apparently it uses a JSON based representation Search
Data Format (SDF), which we could reuse for a file based indexer.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message