sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gwen Shapira (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-1411) The number of tasks is not set properly in PGBulkloadExportManager
Date Sun, 03 Aug 2014 18:56:11 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084086#comment-14084086

Gwen Shapira commented on SQOOP-1411:

Thanks for submitting an issue and a patch [~iwasakims].

Some questions I have:

* Why rename a parameter? What was wrong with the existing name?
* The change to configureNumTasks is very confusing. Are you trying to set both number of
mappers and reducers in same function? This makes sense, but the code no longer calls setJobNumMappers
and removes an important validation and warning.

Can you resolve these issues and add a bit of documentation to your logic in configureNumTasks?

> The number of tasks is not set properly in PGBulkloadExportManager
> ------------------------------------------------------------------
>                 Key: SQOOP-1411
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1411
>             Project: Sqoop
>          Issue Type: Bug
>          Components: connectors
>    Affects Versions: 1.4.5
>            Reporter: Masatake Iwasaki
>            Assignee: Masatake Iwasaki
>         Attachments: SQOOP-1411-0.patch
> The '-m' option does not work and the number of reduce tasks is always set to 0. 
> The cause seems to be the changes of configureNumTasks in ExportJobBase and JobBase.

This message was sent by Atlassian JIRA

View raw message