drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Neeraja Rentachintala <nrentachint...@maprtech.com>
Subject Drill & Caravel
Date Fri, 13 May 2016 18:03:48 GMT
Great, thanks John. I wil look forward for an update on how drill queuing
part goes : )
Btw with regards to metadata queries, Drill already supports metadata (both
the limit 0 form and also show tables/show schemas which are served from
the Information_schema).

On Friday, May 13, 2016, John Omernik <john@omernik.com> wrote:

> So with that Docker file, I got caravel working easily with test data (no
> drill yet) that will be weekend fun (and the pyodbc is already installed in
> the container, so now it's time to play!)
>
> So I started my docker image with:
>
> sudo docker run -it --rm --net=host
> -v=/mapr/brewpot/apps/prod/caravel/working:/app/working:rw
> -v=/mapr/brewpot/apps/prod/caravel/cache:/app/cache:rw zeta/caravel
> /bin/bash
>
>
> Now, I passed through a couple of volumes that I am not sure I will need, I
> want to play so that my "State" and initialization is saved in those
> directories in the running container (this is just early testing) I just
> run bash, and then run the commands below and it works. I was lazy here and
> just did net host, it would likely work with bridged mode, but I am in an
> airport and wanted to see if I could get it working... the fun part will be
> working with Drill over the weekend. Thanks again Neeraja for sharing this!
>
>
>
>
> Then I ran these commands(per the docs)  and could explore... pretty easy
> actually!
>
> # Create an admin userfabmanager create-admin --app caravel
> # Initialize the databasecaravel db upgrade
> # Create default roles and permissionscaravel init
> # Load some data to play withcaravel load_examples
> # Start the development web servercaravel runserver -d
>
>
>
>
> On Fri, May 13, 2016 at 11:27 AM, John Omernik <john@omernik.com> wrote:
>
> > So, without running this, but having it build successfully, this seems
> > like a good place to start, it has caravel, and pyodbc all installed
> here.
> > I will be playing more this weekend....
> >
> > FROM ubuntu
> >
> > RUN apt-get update && apt-get install -y build-essential libssl-dev
> > libffi-dev python-dev python-pip
> >
> > RUN apt-get install -y unixodbc-dev unixodbc-bin
> >
> > RUN pip install pyodbc
> >
> > RUN pip install caravel
> >
> > CMD ["python -v"]
> >
> > On Fri, May 13, 2016 at 10:44 AM, John Omernik <john@omernik.com> wrote:
> >
> >> A little more googling and I found the pyodbc, that looks promising.
> >>
> >> On Fri, May 13, 2016 at 10:41 AM, John Omernik <john@omernik.com>
> wrote:
> >>
> >>> "SQL Alchemy already understands Drill" I was just looking for that, is
> >>> there already some docs/blogs on that? I was going to start there as
> well
> >>> to determine how it worked and then look into the dialect writing and
> see
> >>> how big that project was.  I didn't find much on the Drill + Alchemy,
> but I
> >>> am in an airport and I blame wifi gremlins.
> >>>
> >>>
> >>>
> >>> On Fri, May 13, 2016 at 10:25 AM, Ted Dunning <ted.dunning@gmail.com>
> >>> wrote:
> >>>
> >>>> SQLAlchemy generates SQL queries and passes them on to Drill. Since
> >>>> SQLAlchemy already understands Drill, most of what will be needed is
> >>>> slight
> >>>> tuning for SQL dialect and providing a mechanism for SQLAlchemy to get
> >>>> meta-data from views.  Tableau does the meta-data discovery using
> limit
> >>>> 0
> >>>> queries to get column names. We would hope that similar methods would
> >>>> work.
> >>>>
> >>>>
> >>>> On Fri, May 13, 2016 at 6:13 AM, Erik Antelman <eantelman@gmail.com>
> >>>> wrote:
> >>>>
> >>>> > Isn't this a matter of Drill<->SQLAlchemy. Such a support
could
> likely
> >>>> > enable other frameworks.
> >>>> >
> >>>> > Would one think that adaptation of SQLAlchemy to Drill is specific
> to
> >>>> > Caravel? What subset of features from a RDBMS ORM is meaningfull,
> >>>> feasable
> >>>> > and usefull to map to Drill. This sounds like a broad general
> >>>> question. I
> >>>> > am sure there are orms from other language camps that might want
> Drill
> >>>> > backends.
> >>>> > On May 13, 2016 7:33 AM, "John Omernik" <john@omernik.com>
wrote:
> >>>> >
> >>>> > > I will be looking into this as well, thanks for sharing!
> >>>> > > On May 13, 2016 2:01 AM, "Nirav Shah" <nirav.shah@games24x7.com>
> >>>> wrote:
> >>>> > >
> >>>> > > > I Hi Neeraja,
> >>>> > > >
> >>>> > > > I am interested in contributing if integration is not
available.
> >>>> > > > Kindly let me know
> >>>> > > >
> >>>> > > > Regards,
> >>>> > > > Nirav
> >>>> > > >
> >>>> > > > On Thu, May 12, 2016 at 9:19 PM, Neeraja Rentachintala
<
> >>>> > > > nrentachintala@maprtech.com> wrote:
> >>>> > > >
> >>>> > > > > Hi Folks
> >>>> > > > >
> >>>> > > > > Caravel is nice visualization tool recently open
sourced by
> >>>> airbnb.
> >>>> > Did
> >>>> > > > > anyone try to integrate Drill and/or interested
in
> contributing
> >>>> to
> >>>> > > making
> >>>> > > > > this work with Drill.
> >>>> > > > >
> >>>> > > > > https://github.com/airbnb/caravel
> >>>> > > > >
> >>>> > > > >
> >>>> > > > > -Thanks
> >>>> > > > > Neeraja
> >>>> > > > >
> >>>> > > >
> >>>> > >
> >>>> >
> >>>>
> >>>
> >>>
> >>
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message