nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (Jira)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-2785) FreeGenerator: command-line option to define number of generated fetch lists
Date Tue, 05 May 2020 14:55:00 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099976#comment-17099976
] 

Hudson commented on NUTCH-2785:
-------------------------------

SUCCESS: Integrated in Jenkins build Nutch-trunk #3681 (See [https://builds.apache.org/job/Nutch-trunk/3681/])
NUTCH-2785 FreeGenerator: command-line option to define number of (snagel: [https://github.com/apache/nutch/commit/72f3ff20d28f2e19281a5d1c83139b152acac1e1])
* (edit) src/java/org/apache/nutch/tools/FreeGenerator.java


> FreeGenerator: command-line option to define number of generated fetch lists
> ----------------------------------------------------------------------------
>
>                 Key: NUTCH-2785
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2785
>             Project: Nutch
>          Issue Type: Improvement
>          Components: generator
>    Affects Versions: 1.16
>            Reporter: Sebastian Nagel
>            Assignee: Sebastian Nagel
>            Priority: Major
>             Fix For: 1.17
>
>
> While Generator allows to specify the number of generated fetch lists using the "-numFetchers"
command-line option, FreeGenerator does not provide such an option. It uses the value of "mapreduce.job.maps"
(2 by default), also in local mode where Generator always creates only one single fetch list.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message