nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron Nall (JIRA)" <j...@apache.org>
Subject [jira] Created: (NUTCH-638) Launching Distributed Searchers with URI indicating filesystem to use rather than relying on hadoop config files.
Date Mon, 28 Jul 2008 19:33:31 GMT
Launching Distributed Searchers with URI indicating filesystem to use rather than relying on
hadoop config files.
-----------------------------------------------------------------------------------------------------------------

                 Key: NUTCH-638
                 URL: https://issues.apache.org/jira/browse/NUTCH-638
             Project: Nutch
          Issue Type: Improvement
          Components: searcher
    Affects Versions: 1.0.0
            Reporter: Aaron Nall
            Priority: Minor


I wanted to conduct all index creation operations in hdfs but search from the local file system
using the same cluster of machines.  I believe that this is a common use case.  

This required either a parallel nutch install or edits (scripted or manual) to hadoop-site.xml
to change the file system from hdfs to local when starting a distributed searcher service.
 This minor patch makes IndexSearcher and NutchBean honor URIs as supported by hadoop 0.17
without altering existing functionality if simple paths are entered.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message