Hey Navin,
I actually wrote a Drill adapter a little while back for my company but
have been too busy to open source it (startup life). Took a little time and
did a code dump of what we have here:
https://github.com/jyates/drill-dynamo-adapter
Its apache licensed, so feel free to give it a whirl. I'd love to get it
contributed upstream to Drill at some point too :).
Features:
- Filter/Projection push-down
- Sharding requests across drill endpoints
- "Compound Key" support for compound Hash/Range keys
- Not supported in the filtering, but makes it easier when reading
back out again
- DynamoDBLocal (for testing)
Needed Work:
- Date storage
- Conversion of numbers
- Currently we just return strings b/c I couldn't figure out how to
convert to Decimal38. You can then cast them in Drill to get the correct
types.
- Skip queries
The Drill/Calcite adapter translation is somewhat straight forward, if you
want to do take a crack at that.
--Jesse
Founder/CEO Fineo.io <http://fineo.io/>
On Sun, Sep 4, 2016 at 2:20 PM Julian Hyde <jhyde@apache.org> wrote:
> Forwarding to Calcite dev. I have heard that people are working on a
> Calcite adapter for DynamoDB and Calcite adapters can often be used in
> Drill.
>
> Julian
>
> > On Sep 4, 2016, at 12:03 PM, Navin Viswanath <navin.vish@gmail.com>
> wrote:
> >
> > Hi,
> >
> > I'm currently working on a tool that provides a SQL interface for
> Amazon's
> > DynamoDB. While working on it, I noticed that Drill does not seem to
> have a
> > storage plugin for DynamoDB.
> >
> > Is there any interest in this group to build the plugin? If so, I'd be
> very
> > interested in contributing. Any pointers on starting on this, or opinions
> > the group has on this are much appreciated.
> >
> > Thanks!
> > - Navin
>
> --
Jesse Yates
Founder/CEO Fineo.io
|