drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Brust <andrew.br...@bluebadgeinsights.com>
Subject RE: Benchmarks for Apache Drill
Date Tue, 18 Aug 2015 03:30:53 GMT
Thanks!  Amazing how much that reminds me of writing .NET CLR functions and aggregates for
SQL Server, something I've covered in our SQL Server book for the last 10 years.

Meanwhile, and forgive me if I'm being thick, but how does that architecture lend itself to
vectorization of the code?

-----Original Message-----
From: Ted Dunning [mailto:ted.dunning@gmail.com] 
Sent: Monday, August 17, 2015 3:37 AM
To: user <user@drill.apache.org>
Subject: Re: Benchmarks for Apache Drill

Docs:

https://drill.apache.org/docs/develop-custom-functions-introduction/

Some usable examples:

https://github.com/mapr-demos/simple-drill-functions


On Sun, Aug 16, 2015 at 11:06 PM, Andrew Brust <
andrew.brust@bluebadgeinsights.com> wrote:

> >> the unusual code-embedding UDF system that Drill has <<
> Have a good link where I could read more about that?
>
> -----Original Message-----
> From: Ted Dunning [mailto:ted.dunning@gmail.com]
> Sent: Monday, August 17, 2015 1:52 AM
> To: user
> Subject: Re: Benchmarks for Apache Drill
>
> On Sun, Aug 16, 2015 at 10:22 PM, Andrew Brust <
> andrew.brust@bluebadgeinsights.com> wrote:
>
> > I have to admit, I didn't realize columnar was such a big part of Drill.
> > I guess that's consistent with Dremel, so it makes sense.  I always
> > thought the emphasis was on heterogenous data access, not on perf.  Cool!
> >
>
> The focus of Drill is to combine polymorphic heterogenous data with
> performance.  Some systems have polymorphism, some have performance.
> Essentially none have both.
>
>
>
> >
> > So with that in mind, does drill do much with vector processing/SIMD
> > operation?
> >
>
> Actually, a number of basic operations in Drill do get vectorized to use
> the SIMD instructions of the underlying processor.  Enabling that is the
> rationale behind the unusual code-embedding UDF system that Drill has.
>
Mime
View raw message