tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Siddharth Seth <ss...@apache.org>
Subject Re: why are two Fetcher classes in Tez
Date Mon, 09 Jun 2014 17:27:03 GMT
Chen, There's a jira open somewhere to merge the Fetchers and Shuffle
managers. It does need to be done at some point.


On Fri, Jun 6, 2014 at 3:20 PM, Chen He <airbots@gmail.com> wrote:

> one in in org.apache.tez.runtime.library.common.shuffle.impl
> the other is in org.apache.tez.runtime.library.shuffle.common
>
> Why don't we merge them together?
>
> Looks like the second one is used in broadcastShuffleManager
> but the first one is used in other shuffleManager.
>
> There should be a way to merge them together, reuse some code,
>  and avoid confusion.
>
> Regards!
>
> Chen
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message