Hi Mufeed,
I ran select count(*) from source;
It came back with the count after 20 mins. There were 12 million json doc. I definitely got
to improve the performance. But not sure where to look at. I am looking at the video https://www.youtube.com/watch?v=kG6vzsk8T7E&list=UUKmI-fBjvKexRlBBeVTwrrg
. Do you have any other option documentation to speed up the query?
Thanks
Tridib
From: tridib.samanta@live.com
To: drill-user@incubator.apache.org
Subject: RE: Apache Drill stuck for long time
Date: Wed, 29 Oct 2014 10:24:11 -0700
Hi Mufeed,
I am using apache-drill-0.5.0-incubating. It's setup in our private cloud. Drillbit's log
shows
2014-10-29 13:18:56,784 [f997d3d6-f163-4a64-a157-301a153f52f5:frag:0:0] DEBUG o.a.d.exec.compile.ClassTransformer
- Done compiling (bytecode size=3.9 KiB, time:51 millis).
After this I do not see anything.
Thanks
Tridib
> Date: Wed, 29 Oct 2014 22:36:07 +0530
> Subject: Re: Apache Drill stuck for long time
> From: mufeed.usman@gmail.com
> To: drill-user@incubator.apache.org
>
> Hello Tribid,
>
> What version of Drill are you using? Where is the cluster setup - physical
> servers, cloud, etc? Do you see anything in the drillbit.log?
>
>
> ---
> Mufeed Usman
> My LinkedIn <http://www.linkedin.com/pub/mufeed-usman/28/254/400> | My
> Social Cause <http://www.vision2016.org.in/> | My Blogs : LiveJournal
> <http://mufeed.livejournal.com>
>
>
>
>
> On Wed, Oct 29, 2014 at 10:15 PM, Tridib Samanta <tridib.samanta@live.com>
> wrote:
>
> >
> >
> >
> > Hello Experts,
> > I have recently started exploring drill. I was able to setup a drill
> > cluster of two drillbits and query flat json structure of 50 records. When
> > I started same query on 10 million json record, it never returned even
> > after 30 mins.
> >
> > What is the way to debug this scenario?
> > Also is there a way to check how much memory it's using and increase it?
> >
> >
> > Thanks & Regards
> > Tridib
> >
> >
|