hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 牛兆捷 <nzjem...@gmail.com>
Subject Re: In memory shuffle phase
Date Thu, 20 Jun 2013 09:30:50 GMT
*import* *org**.apache.tez.dag.api.records*.DAGProtos.DAGPlan;
why this import errors in tez trunk ?

2013/6/14 Arun C Murthy <acm@hortonworks.com>

> https://issues.apache.org/jira/browse/TEZ-65
>
> Arun
>
> On Jun 12, 2013, at 12:28 AM, 牛兆捷 wrote:
>
> > Is there any design document about tez?
> >
> > 2013/6/12 Arun C Murthy <acm@hortonworks.com>
> >
> >> Take a look at Apache Tez (
> http://incubator.apache.org/projects/tez.html).
> >>
> >> I'll warn you that it's a little rough, but works.
> >>
> >> Arun
> >>
> >> On Jun 10, 2013, at 5:46 PM, Grandl Robert wrote:
> >>
> >>> Hi,
> >>>
> >>>
> >>> It is possible to run shuffle phase in memory ? I mean, the mapper to
> >> write the intermediate output in memory only and the reducer to read it
> >> from there. So no disk involved for intermediate output.
> >>>
> >>>
> >>> If so, what are the configuration parameters I need to tune ?
> >>>
> >>> Thanks,
> >>> Robert
> >>
> >> --
> >> Arun C. Murthy
> >> Hortonworks Inc.
> >> http://hortonworks.com/
> >>
> >>
> >>
> >
> >
> > --
> > *Sincerely,*
> > *Zhaojie*
> > *
> > *
>
> --
> Arun C. Murthy
> Hortonworks Inc.
> http://hortonworks.com/
>
>
>


-- 
*Sincerely,*
*Zhaojie*
*
*

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message