nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mike Baranczak (JIRA)" <j...@apache.org>
Subject [jira] Created: (NUTCH-755) DomainURLFilter crashes on malformed URL
Date Thu, 17 Sep 2009 02:40:57 GMT
DomainURLFilter crashes on malformed URL
----------------------------------------

                 Key: NUTCH-755
                 URL: https://issues.apache.org/jira/browse/NUTCH-755
             Project: Nutch
          Issue Type: Bug
          Components: fetcher
    Affects Versions: 1.0.0
         Environment: Tomcat 6.0.14
Java 1.6.0_14
Linux
            Reporter: Mike Baranczak



2009-09-16 21:54:17,001 ERROR [Thread-156] DomainURLFilter - Could not apply filter on url:
http:/comments.php
java.lang.NullPointerException
        at org.apache.nutch.urlfilter.domain.DomainURLFilter.filter(DomainURLFilter.java:173)
        at org.apache.nutch.net.URLFilters.filter(URLFilters.java:88)
        at org.apache.nutch.parse.ParseOutputFormat$1.write(ParseOutputFormat.java:200)
        at org.apache.nutch.parse.ParseOutputFormat$1.write(ParseOutputFormat.java:113)
        at org.apache.nutch.fetcher.FetcherOutputFormat$1.write(FetcherOutputFormat.java:96)
        at org.apache.nutch.fetcher.FetcherOutputFormat$1.write(FetcherOutputFormat.java:70)
        at org.apache.hadoop.mapred.ReduceTask$3.collect(ReduceTask.java:410)
        at org.apache.hadoop.mapred.lib.IdentityReducer.reduce(IdentityReducer.java:39)
        at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:436)
        at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:170)


Expected behavior would be to recognize the URL as malformed, and reject it.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message