drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <ted.dunn...@gmail.com>
Subject Re: report of off-line conversations and develpments
Date Thu, 10 Jan 2013 19:40:02 GMT
Thanks.

The project itself will have an open wiki shortly.

INFRA-5747

On Thu, Jan 10, 2013 at 11:33 AM, Jason <jasong@apache.org> wrote:

> Reports as 'immutable page' and if i try to upload says 'access not
> allowed'.
>
> I think we need a true open wiki. I can email the sheperd to upload.
>
> - J
>
>
> On Thu, Jan 10, 2013 at 2:30 PM, Ted Dunning <ted.dunning@gmail.com>
> wrote:
>
> > Should be relatively open access moin-moin wiki.  Can you login?
> >
> > On Thu, Jan 10, 2013 at 11:26 AM, Jason <jason.giedymin@gmail.com>
> wrote:
> >
> > > This is svn access only correct?
> > > http://wiki.apache.org/incubator/January2013
> > >
> > >
> > > On Thu, Jan 10, 2013 at 2:11 PM, Ted Dunning <ted.dunning@gmail.com>
> > > wrote:
> > >
> > > > Jason,
> > > >
> > > > Go ahead and throw that into the wiki.  We can edit it there.
> > > >
> > > > It looks good so far (and quick!)
> > > >
> > > > I think that we should mention as a risk factor the problem that lots
> > of
> > > > development is happening off-list.  We need to shepherd that back
> onto
> > > the
> > > > list.
> > > >
> > > > Also, I have requested a wiki instance for Drill so that we can have
> > > people
> > > > contribute textually even before they have become committers.  That
> > > should
> > > > help with unblocking participation.
> > > >
> > > > I think that availability of the reference interpreter will also
> > unblock
> > > > lots of contributions.
> > > >
> > > > On Thu, Jan 10, 2013 at 11:08 AM, Jason <jasong@apache.org> wrote:
> > > >
> > > > > (sorry if this got sent twice)
> > > > >
> > > > > Needs some fill-in and review:
> > > > >
> > > > >
> > > > > <begin>
> > > > >
> > > > > January 2013
> > > > >
> > > > > Project Name: Apache Drill
> > > > >
> > > > > Project Summary:
> > > > >
> > > > >
> > > > > Issues:
> > > > >
> > > > > Discussions on these key areas were __very focused__ and productive
> > > > toward
> > > > > this project's graduation goals:
> > > > > Healthy discussion of target use cases from the community
> > > > > New Syntax Interpreter
> > > > > Continued Logical Plan Syntax discussion & development (with
focus
> on
> > > > JSON)
> > > > > Leveraging existing ideas/lessons learned from Optiq, LucidDB,
> > > DynamoBI,
> > > > > Eigenbase and Saffron
> > > > >
> > > > >
> > > > > How has the community & project developed since the last report:
> > > > >
> > > > > User interest has slowed due to the Holiday season but discussion
> on
> > > the
> > > > > the above topics is healthy. Commit and list activity are
> consistent
> > > with
> > > > > the above. Development is continuing onward.
> > > > >
> > > > > An addition of employer supported contributor to the project.
> > > > >
> > > > > New users continue to ask to be formally part of this project.
> > > > >
> > > > > On going discussion with schema-less data scanners amongst the
> > project
> > > > > members.
> > > > >
> > > > >
> > > > > List Summary:
> > > > >   * http://mail-archives.apache.org/mod_mbox/incubator-drill-dev/
> > > > >   * Jan 2013, ? subscribers
> > > > >   * Dec 2012, 264 subscribers
> > > > >   * Nov 2012, 73 (jira, focused discussions)
> > > > >
> > > > >   * Oct 2012, 214 (svn, discussions, jira)
> > > > >   * Sep 2012, 413
> > > > >   * Aug 2012, 85
> > > > >
> > > > >
> > > > > </end>
> > > > >
> > > > >
> > > > > On Thu, Jan 10, 2013 at 1:59 PM, Ted Dunning <
> ted.dunning@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > There have been several meat-space developments for Drill lately.
> > >  Here
> > > > > is
> > > > > > a quick summary:
> > > > > >
> > > > > > - There have been several proposals for syntax conventions for
> the
> > > > > logical
> > > > > > plan language.  Three versions have been built.  I built a
> version
> > > > along
> > > > > > the lines of LLVM and a JSON based version that used a
> constructor
> > > > > > convention along with tight binding of classes to operator types.
> > > > >  Jacques
> > > > > > built a version on Jackson which used much looser binding and
> > > supported
> > > > > DAG
> > > > > > structuring much more easily.  Overall, I feel that Jacques
> > > > > implementation
> > > > > > dominates the ones that I have done in essentially every way.
 I
> > > think
> > > > we
> > > > > > should go with his style.
> > > > > >
> > > > > > - Jacques has been following up his logical syntax work with
a
> > > > reference
> > > > > > interpreter.  I have been encouraging him to move to a
> > > > > > commit-early/commit-often style, but I think he is going to
have
> a
> > > > > working
> > > > > > implementation very shortly.  This should give Drill the ability
> to
> > > > take
> > > > > a
> > > > > > logical plan in JSON format and execute that plan directly,
> without
> > > > > > optimization on a single machine.  It will make it possible
to
> > query
> > > > real
> > > > > > data sets and start experimenting with the logical plan language.
> >  It
> > > > > will
> > > > > > also allow people to start developing translators from query
> syntax
> > > to
> > > > > > logical plan and to start developing scanners.  It will also
> > provide
> > > a
> > > > > > functional reference that will guide the development of high
> > > > performance
> > > > > > execution systems.
> > > > > >
> > > > > > - Michael Hausenblas now has employer support for focusing on
> Drill
> > > at
> > > > > > least part-time.  He has been visiting from Ireland at MapR
> > > > headquarters
> > > > > to
> > > > > > talk with Jacques and myself and has committed to building out
> use
> > > > cases
> > > > > > with sample data sets and queries.
> > > > > >
> > > > > > - Timothy Chen has been working with Jacques to develop scanners,
> > > > > > particularly with a view towards dealing with schema-less data
in
> > an
> > > > > > efficient fashion.  Timothy seems a bit shy about participating
> > > > on-list,
> > > > > > but encouragement for doing that is on-going.
> > > > > >
> > > > >
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message