nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Omkar Reddy (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-2383) Wrong FS exception in Fetcher
Date Wed, 08 Nov 2017 14:27:00 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16244019#comment-16244019
] 

Omkar Reddy commented on NUTCH-2383:
------------------------------------

I recently faced this issue, we need to set the property: mapreduce.framework.name in mapred-site.xml
as mentioned here [0] while configuring the cluster. 

[0] https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-common/SingleCluster.html

> Wrong FS exception in Fetcher
> -----------------------------
>
>                 Key: NUTCH-2383
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2383
>             Project: Nutch
>          Issue Type: Bug
>          Components: fetcher
>    Affects Versions: 1.13
>         Environment: Hadoop 2.8 and Hadoop 2.7.2
>            Reporter: Yossi Tamari
>         Attachments: crawl output.txt
>
>
> Running bin/crawl on either Hadoop 2.7.2 or Hadoop 2.8, the Injector and Generator succeed,
but the Fetcher throws: {code}java.lang.IllegalArgumentException: Wrong FS: hdfs://localhost:9000/user/root/crawl/segments/20170430084337/crawl_fetch,
expected: file:///{code}.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message