drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Catrinel Petre <kape...@gmail.com>
Subject Re: YARN support for Drill
Date Thu, 26 Oct 2017 17:40:23 GMT
Really glad to see this. Might have some challenges with yarn node labels,
but that's how we all get better :-)
Cheers!
Kat

On Oct 26, 2017 10:30, "Paul Rogers" <progers@mapr.com> wrote:

> Hi Saurabh,
>
> Thanks for the note. This is a big hunk of code; it will take the team
> some time to review. Arina is busy herding cats to get 1.12 finished up.
> So, it seems more likely that DoY will find its way into the following
> release (Drill 1.13?).
>
> That said, as noted, the code works and has been used by several shops.
> Until the code finds its way into a release, users can download the PR and
> build DoY themselves. They can use the custom-built DoY to launch any
> production version of Drill from 1.8 onwards, including Drill 1.12.
>
> Thanks,
>
> - Paul
>
> > On Oct 26, 2017, at 10:26 AM, Saurabh Mahapatra <
> saurabhmahapatra94@gmail.com> wrote:
> >
> > This is absolutely great news for the community!! Thanks for letting us
> > know.
> >
> > Will this be available in the 1.12 release due in November/December?
> >
> > Best,
> >
> > Saurabh
> >
> > On Thu, Oct 26, 2017 at 10:23 AM, Paul Rogers <progers@mapr.com> wrote:
> >
> >> Hi All,
> >>
> >> We just issued a PR #1011 [1] to run Drill as a YARN task. Drill-on-YARN
> >> (DoY) provides a simple command-line tool to launch a Drill cluster
> under
> >> YARN. Command line and web UI tools let you monitor, resize and stop
> your
> >> cluster. DoY monitors your cluster, watching for any Drillbit failures,
> and
> >> restarts replacement Drillbits automatically.
> >>
> >> DoY has been in use by several shops over the last year on MapR’s
> version
> >> of YARN; we are now making it available for Apache YARN users. We hope
> to
> >> get feedback on any operational differences between the two YARN
> versions;
> >> though we foresee few problems.
> >>
> >> If you have a need to run Drill under YARN, give DoY a try. The code
> >> itself is built with the current version of Drill, but it can launch any
> >> version of Drill from 1.8 onwards.
> >>
> >> To try DoY, simply download the PR then build Drill as per the
> >> instructions on the Apache Drill website [2]. A USAGE.md file provides a
> >> complete user’s guide. For those who want to know how DoY works, a
> >> README.md file explains the internals.
> >>
> >> Thanks,
> >>
> >> - Paul
> >>
> >> [1] https://github.com/apache/drill/pull/1011
> >> [2] http://drill.apache.org/docs/compiling-drill-from-source/
> >>
> >>
> >>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message