tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Eagles (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (TEZ-3361) Fetch Multiple Partitions from the Shuffle Handler
Date Tue, 06 Dec 2016 17:35:58 GMT

     [ https://issues.apache.org/jira/browse/TEZ-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jonathan Eagles resolved TEZ-3361.
----------------------------------
       Resolution: Fixed
    Fix Version/s: TEZ-3334

Thanks, [~kshukla]. Rebased patch 5 on latest TEZ-3334 branch with only merge changes from
patch 4, but posting for historical purposes. Committing TEZ-3361 to feature branch TEZ-3334
now that its dependency TEZ-3222 is committed to master and merged to feature branch TEZ-3334.


> Fetch Multiple Partitions from the Shuffle Handler
> --------------------------------------------------
>
>                 Key: TEZ-3361
>                 URL: https://issues.apache.org/jira/browse/TEZ-3361
>             Project: Apache Tez
>          Issue Type: Sub-task
>            Reporter: Jonathan Eagles
>            Assignee: Jonathan Eagles
>             Fix For: TEZ-3334
>
>         Attachments: TEZ-3361.1.patch, TEZ-3361.2.patch, TEZ-3361.3.patch, TEZ-3361.4.patch,
TEZ-3361.5.patch
>
>
> Provide an API that allows for fetching multiple partitions at once from a single upstream
task. This is to better support auto-reduce parallelism where a single downstream task is
impersonating several (possibly?) consecutive downstream tasks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message