My query is generic
What I am asking is that does drill fire query on target data store and only fetch result
or does it fetch data and then fire query ?
Regards
Chetan
-----Original Message-----
From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Sent: Monday, February 20, 2017 8:14 PM
To: user@drill.apache.org
Subject: RE: Query on performance using Drill and Amazon s3.
Hi chetan,
Projjwal has the issue. Me too asked the same question
On Feb 20, 2017 7:56 PM, "Chetan Kothari" <HYPERLINK "mailto:chetan.kothari@oracle.com"chetan.kothari@oracle.com>
wrote:
> Hi Nitin
>
>
>
> Where does the query execute?
>
> Does Drill execute query on AWS and fetch results to be displayed?
>
>
>
> Regards
>
> Chetan
>
>
>
> -----Original Message-----
> From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
> Sent: Monday, February 20, 2017 6:19 PM
> To: HYPERLINK "mailto:user@drill.apache.org"user@drill.apache.org
> Subject: Re: Query on performance using Drill and Amazon s3.
>
>
>
> how are you doing select * .. using drill UI or sqlline?
>
> where are you running it from ?
>
> is the drill hosted in aws or on your local machine?
>
>
>
> I think majority of the time is spent on displaying the result set
> instead of querying the file if the drill server is on aws.
>
> If the drill server is local then it might be your network which might
> take a lot of time based on s3 bucket location and where your drill
> server is
>
>
>
> On Mon, Feb 20, 2017 at 5:37 PM, PROJJWAL SAHA <HYPERLINK "mailto:
> HYPERLINK "mailto:proj.saha@gmail.com%22proj.saha@gmail.com"proj.saha@gmail.com"proj.saha@gmail.com>
wrote:
>
>
>
> > Hello all,
>
> >
>
> > I am using 1GB data in the form of .tsv file, stored in Amazon S3
>
> > using Drill 1.8. I am using default configurations of Drill using S3
>
> > storage plugin coming out of the box. The drill bits are configured
> > on
>
> > a 5 node cluster with 32GB RAM and 4VCPU.
>
> >
>
> > I see that select * from xxx; query takes 23 mins to fetch 1,040,000
> rows.
>
> >
>
> > Is this the expected behaviour ?
>
> > I am looking for any quick tuning that can improve the performance
> > or
>
> > any other suggestions.
>
> >
>
> > Attaching is the JSON profile for this query.
>
> >
>
> > Regards,
>
> > Projjwal
>
> >
>
>
>
>
>
>
>
> --
>
> Nitin Pawar
>
>
>
|