nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Ciborowski (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-1517) CloudSearch indexer
Date Fri, 06 Sep 2013 18:07:59 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13760448#comment-13760448
] 

Daniel Ciborowski commented on NUTCH-1517:
------------------------------------------

I have followed the above process, but am getting errors are trying to do "bin/nutch solrindex
http://127.0.0.1:8983/solr/ crawl/crawldb -linkdb crawl/linkdb crawl/segments/*"

13/09/06 18:03:19 ERROR security.UserGroupInformation: PriviledgedActionException as:hadoop
cause:org.apache.hadoop.mapred.InvalidInputException: Input Pattern hdfs://10.148.178.153:9000/user/hadoop/crawl/segments/*/crawl_fetch
matches 0 files
Input Pattern hdfs://10.148.178.153:9000/user/hadoop/crawl/segments/*/crawl_parse matches
0 files
Input Pattern hdfs://10.148.178.153:9000/user/hadoop/crawl/segments/*/parse_data matches 0
files
Input Pattern hdfs://10.148.178.153:9000/user/hadoop/crawl/segments/*/parse_text matches 0
files
Input path does not exist: hdfs://10.148.178.153:9000/user/hadoop/crawl/linkdb/current
13/09/06 18:03:19 ERROR indexer.IndexingJob: Indexer: org.apache.hadoop.mapred.InvalidInputException:
Input Pattern hdfs://10.148.178.153:9000/user/hadoop/crawl/segments/*/crawl_fetch matches
0 files
Input Pattern hdfs://10.148.178.153:9000/user/hadoop/crawl/segments/*/crawl_parse matches
0 files
Input Pattern hdfs://10.148.178.153:9000/user/hadoop/crawl/segments/*/parse_data matches 0
files
Input Pattern hdfs://10.148.178.153:9000/user/hadoop/crawl/segments/*/parse_text matches 0
files
Input path does not exist: hdfs://10.148.178.153:9000/user/hadoop/crawl/linkdb/current

Any suggestions?
                
> CloudSearch indexer
> -------------------
>
>                 Key: NUTCH-1517
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1517
>             Project: Nutch
>          Issue Type: New Feature
>          Components: indexer
>            Reporter: Julien Nioche
>             Fix For: 1.9
>
>         Attachments: 0023883254_1377197869_indexer-cloudsearch.patch
>
>
> Once we have made the indexers pluggable, we should add a plugin for Amazon CloudSearch.
See http://aws.amazon.com/cloudsearch/. Apparently it uses a JSON based representation Search
Data Format (SDF), which we could reuse for a file based indexer.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message