drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kasper Sørensen <i.am.kasper.soren...@gmail.com>
Subject Re: Apache MetaModel - an interesting future integration target
Date Thu, 01 Oct 2015 11:10:58 GMT
Hi Jacques,

I think we can best answer that together. I didn't yet dive into all the
details of Drill, but from a high level it seems that we could maybe
provide connectivity to a wide set of databases and file formats, which you
could leverage. The query syntax for all MetaModel connectors is exactly
the same, only the schema/table model may differ. But that means to me that
if you plug in one connector, you probably have them all. The main
complication as I see it is how to mediate the Drill queries to MetaModel
queries. Your query language seems to be richer than MetaModel's,
containing more functions and operators. So how can we best ensure that the
maximum amount of the query gets passed on to MetaModel, without passing on
stuff that MetaModel wouldn't support.

Best regards,

2015-09-30 13:43 GMT+02:00 Jacques Nadeau <jacques@dremio.com>:

> I think I can speak for everyone here that the Drill community is also
> interested in working with other projects, especially Apache products.
> There definitely seems to be some overlap. When we discussed this on the
> list here a couple weeks ago, I think the question was what would be a good
> first step. Do you have any ideas on that front?
> --
> Jacques Nadeau
> CTO and Co-Founder, Dremio
> On Wed, Sep 30, 2015 at 6:57 AM, Kasper Sørensen <
> i.am.kasper.sorensen@gmail.com> wrote:
> > Hi guys,
> >
> > I'm PMC of Apache MetaModel and was just watching Tugdual Grall's talk
> here
> > at Apache: Big Data Europe. I have the feeling that we should try to work
> > together, or at least explore some cooperation, since the way I see it
> > there's a big overlap with what MetaModel tries to archieve and what
> Drill.
> > And some differences of course. It seems MetaModel is "metadata first"
> > while Drill allows for a lot more dynamic querying capabilities.
> >
> > Either way, some way of integrating the two projects would be very
> > interesting I think. I'm very open for helping out and giving my input.
> >
> > Someone noticed the lower activity-level we have. Yes, MetaModel isn't
> the
> > biggest project. Basically this conference (Apache: Big Data) is the
> first
> > "PR move" we ever did. I did get a lot of interesting feedback from my
> talk
> > here and I expect that we will attract more people as the word spreads.
> > Integrating with other projects such as Drill is also instrumental for us
> > in doing that, obviously. The other reason might be that Apache MetaModel
> > actually has a pretty long history already, first being founded in
> > 2010-2011 outside of Apache, it's certainly already quite mature and is
> > powering both other open source products (such as DataCleaner) and
> > commercial ones (Stratio Datavis, Human Inference DataHub). Probably more
> > that I don't know of.
> >
> > Anyways... Hope you guys might be interested to do some experimentation
> > here. I think both projects could benefit.
> >
> > Best regards,
> > Kasper Sørensen
> >

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message