hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-9084) TotalOrderPartitioner fails on hadoop running on top of gpfs (or any parallel or distributed filesystem)
Date Sun, 01 Mar 2015 07:40:04 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Allen Wittenauer updated HADOOP-9084:
-------------------------------------
    Fix Version/s:     (was: 1.0.4)
                       (was: 1.0.3)
           Status: Open  (was: Patch Available)

Cancelling patch:

a) this change will almost certainly break HDFS.
b) Hadoop 1.x is dead and this patch doesn't apply to trunk.

There's a good chance this issue should just be closed, but I'll leave it open for now.

> TotalOrderPartitioner fails on hadoop running on top of gpfs (or any parallel or distributed
filesystem)
> --------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-9084
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9084
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: filecache, fs
>    Affects Versions: 1.0.4, 1.0.3
>            Reporter: giovanni delussu
>            Assignee: giovanni delussu
>            Priority: Critical
>         Attachments: PATCH-HADOOP-9084-origin-branch-1.0.patch
>
>
> When running a job who uses TotalOrderPartitioner (like TeraSort or BulkImport of HBase)
on hadoop running on top of gpfs (instead of hdfs) the program fails to find the file _partition.lst
because is looking for it in the wrong directory. The confusion is between local fs meaning
not hdfs and local meaning distributed fs. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message