nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-2461) Generate passes the data to when maxCount == 0
Date Mon, 15 Jan 2018 17:54:00 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-2461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16326474#comment-16326474
] 

Hudson commented on NUTCH-2461:
-------------------------------

SUCCESS: Integrated in Jenkins build Nutch-trunk #3496 (See [https://builds.apache.org/job/Nutch-trunk/3496/])
fix for NUTCH-2461 generate with maxcount equals 0 (semyon.semyonov: [https://github.com/apache/nutch/commit/cad81a5d47ccc0f2e6f16cdc32f2321ea1f3b543])
* (edit) src/java/org/apache/nutch/crawl/Generator.java


> Generate passes the data to when maxCount  == 0
> -----------------------------------------------
>
>                 Key: NUTCH-2461
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2461
>             Project: Nutch
>          Issue Type: Bug
>          Components: generator
>    Affects Versions: 1.14
>            Reporter: Semyon Semyonov
>            Priority: Critical
>             Fix For: 1.15
>
>
> The generator checks condition 
> if (maxCount > 0) : line 421 and stop the generation when amount per host exceeds
maxCount( continue : line 455)
> but when  maxCount == 0 it goes directly to line 465 :output.collect(key, entry);
> It is obviously not correct, the correct solution would be to add 
> if(maxCount == 0){
>         	continue;
> }
> at line 380.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message