drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Divya Gehlot <divya.htco...@gmail.com>
Subject Re: Performance issue while fetching the latest data in multi directory hierarchy env
Date Thu, 11 Oct 2018 07:42:06 GMT
apologies on MAXDIR syntax
The correct syntax is MAXDIR( 'schema_name','./path/to/directory/')



On Thu, 11 Oct 2018 at 15:40, Divya Gehlot <divya.htconex@gmail.com> wrote:

> Hi,
> I have data in below hierarchy
> Date\
>    Hour of the day \
>           04
>           08
>           12
>            .....
>           60
>
> I used the query like below
> Select * from `schema_name`.`./path/to/directory/` where
> dir0 = MAXDIR( `schema_name`.`./path/to/directory/`)
> and its taking 3-5 minutes while fetching the data .
>
> Then I tried another solution as below :
> WITH t1 AS
> (SELECT * FROM `schema_name`.`. ./path/to/directory/`
> where dir0 = CURRENT_DATE )
> SELECT *
>    FROM t1  where dir1 = MAXDIR(`schema_name`.`. ./path/to/directory/`  ')
> But this gives me empty result set and MAXDIR can pick up data only one
> level deep.
>
> Appreciate the advise/solution for it !
>
> Thanks,
> Divya
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message