drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jesse Yates <jesse.k.ya...@gmail.com>
Subject Re: dynamodb storage plugin
Date Mon, 05 Sep 2016 22:15:32 GMT
Hey Navin,

I actually wrote a Drill adapter a little while back for my company but
have been too busy to open source it (startup life). Took a little time and
did a code dump of what we have here:

https://github.com/jyates/drill-dynamo-adapter

Its apache licensed, so feel free to give it a whirl. I'd love to get it
contributed upstream to Drill at some point too :).

Features:

   - Filter/Projection push-down
   - Sharding requests across drill endpoints
   - "Compound Key" support for compound Hash/Range keys
      - Not supported in the filtering, but makes it easier when reading
      back out again
   - DynamoDBLocal (for testing)

Needed Work:

   - Date storage
   - Conversion of numbers
      - Currently we just return strings b/c I couldn't figure out how to
      convert to Decimal38. You can then cast them in Drill to get the correct
      types.
      - Skip queries

The Drill/Calcite adapter translation is somewhat straight forward, if you
want to do take a crack at that.

--Jesse
Founder/CEO Fineo.io <http://fineo.io/>

On Sun, Sep 4, 2016 at 2:20 PM Julian Hyde <jhyde@apache.org> wrote:

> Forwarding to Calcite dev. I have heard that people are working on a
> Calcite adapter for DynamoDB and Calcite adapters can often be used in
> Drill.
>
> Julian
>
> > On Sep 4, 2016, at 12:03 PM, Navin Viswanath <navin.vish@gmail.com>
> wrote:
> >
> > Hi,
> >
> > I'm currently working on a tool that provides a SQL interface for
> Amazon's
> > DynamoDB. While working on it, I noticed that Drill does not seem to
> have a
> > storage plugin for DynamoDB.
> >
> > Is there any interest in this group to build the plugin? If so, I'd be
> very
> > interested in contributing. Any pointers on starting on this, or opinions
> > the group has on this are much appreciated.
> >
> > Thanks!
> > - Navin
>
> --
Jesse Yates
Founder/CEO Fineo.io

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message