tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Cheolsoo Park <piaozhe...@gmail.com>
Subject Re: [DISCUSS] What versions of hadoop should we support?
Date Thu, 11 Dec 2014 02:02:21 GMT
We're using EMR 2.4 in production, and it will take a while to upgrade to
2.6 depending on how fast EMR can provide us 2.6 AMI. But if that's what we
need to fully use Tez-8, we will upgrade our cluster.

On Wed, Dec 10, 2014 at 1:44 PM, Siddharth Seth <sseth@apache.org> wrote:

> +1 for changing the default to 2.6.0.
>
> Publishing multiple jars - do you mean per hadoop version supported ?
> That'll likely be very difficult to use - what would the dependency be ?
> Will there be binary compatibility issues if someone builds against tez
> jars built against Hadoop-2.6, and then deployed against 2.2 ?
>
> On Mon, Dec 8, 2014 at 10:02 AM, Hitesh Shah <hitesh@apache.org> wrote:
>
>> Thanks for the info, Douglas. We will not be dropping support for 2.4 for
>> sure at the moment.
>>
>> Anyone else have any comments in this regard?
>>
>> @Bikas/@Sid - what do we do about publishing jars for a release? We would
>> need to publish 2 or 3 sets?
>>
>> thanks
>> — Hitesh
>>
>> On Dec 4, 2014, at 12:51 PM, Moore, Douglas <
>> Douglas.Moore@thinkbiganalytics.com> wrote:
>>
>> > 2.4.x and beyond for the customers we have
>> >
>> > Sent from my iPhone
>> >
>> >> On Dec 4, 2014, at 12:36 PM, Hitesh Shah <hitesh@apache.org> wrote:
>> >>
>> >> Hello folks
>> >>
>> >> Could folks who are following these mailing lists do a raise of hands
>> on which versions of Hadoop you are trying to run Tez on?
>> >>
>> >> 1) 2.2.x
>> >> 2) 2.3.x
>> >> 3) 2.4.x
>> >> 4) 2.5.x
>> >> 5) 2.6.x
>> >>
>> >> Given that we are building out the UI and for the large part, the
>> History UI ( i.e. the one which will display DAG details after an app has
>> disappeared ) will be dependent on YARN Timeline, the UI will not be
>> supported for Hadoop versions 2.2.x and 2.3.x given that they do not
>> support Timeline.
>> >> Likewise, ACLs support in Timeline was introduced in Hadoop 2.6.x -
>> this means ACLs will not be enforceable on Hadoop 2.4.x and 2.5.x
>> >>
>> >> Also, as part of TEZ-1696, I also propose changing the default version
>> to 2.6.0 given that secure Timeline is only available as of 2.6.0.
>> >>
>> >> Thoughts/concerns?
>> >>
>> >> thanks
>> >> — Hitesh
>> >>
>>
>>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message