sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Masatake Iwasaki (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-1411) The number of tasks is not set properly in PGBulkloadExportManager
Date Mon, 04 Aug 2014 19:34:12 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085164#comment-14085164
] 

Masatake Iwasaki commented on SQOOP-1411:
-----------------------------------------

I thinkd the logic of configureNumTasks is confusing as
* export job uses different property from import job in order to specify the number of map
tasks,
* it returns the number of map tasks though the comment of JobBase#configureNumTasks says
"Configure the number of map/reduce tasks to use in the job.".

Should I split configureNumTasks to configureNumMapTasks and configureNumReduceTasks and override
them?

> The number of tasks is not set properly in PGBulkloadExportManager
> ------------------------------------------------------------------
>
>                 Key: SQOOP-1411
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1411
>             Project: Sqoop
>          Issue Type: Bug
>          Components: connectors
>    Affects Versions: 1.4.5
>            Reporter: Masatake Iwasaki
>            Assignee: Masatake Iwasaki
>         Attachments: SQOOP-1411-0.patch
>
>
> The '-m' option does not work and the number of reduce tasks is always set to 0. 
> The cause seems to be the changes of configureNumTasks in ExportJobBase and JobBase.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message