tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Adrian Nicoara <adn...@microsoft.com.INVALID>
Subject RE: TEZ-1190 status
Date Mon, 13 Aug 2018 20:43:01 GMT
> -----Original Message-----
> From: Gopal Vijayaraghavan <gopalv@apache.org>
> Sent: Friday, August 10, 2018 2:20 PM
> To: dev@tez.apache.org; Hitesh Sharma <hitesh@microsoft.com>; . Anupam
> <anupam@microsoft.com>
> Subject: Re: TEZ-1190 status
> 
> As far as I know, that patch + design has been abandoned.
> 
> There was a discussion about adding it without fundamentally changing the
> DAGImpl (and task recovery etc).
> 
> The VertexManager already allows you to have a vertex without a task in it,
> without giving up on being a participant in the data movement events.

This sounds very promising. Can you point me to any tests, or sample code, or the implementation
code I should be looking at?

> However, there are no immediate takers for the new approach (which is
> additive, so needs no significant refactoring changes) and this feature did not
> have anyone waiting for it.

If it can be done with the above suggestion, I can pick up this work, if it is OK.
Mime
View raw message