drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Divya Gehlot <divya.htco...@gmail.com>
Subject Performance issue while fetching the latest data in multi directory hierarchy env
Date Thu, 11 Oct 2018 07:40:12 GMT
Hi,
I have data in below hierarchy
Date\
   Hour of the day \
          04
          08
          12
           .....
          60

I used the query like below
Select * from `schema_name`.`./path/to/directory/` where
dir0 = MAXDIR( `schema_name`.`./path/to/directory/`)
and its taking 3-5 minutes while fetching the data .

Then I tried another solution as below :
WITH t1 AS
(SELECT * FROM `schema_name`.`. ./path/to/directory/`
where dir0 = CURRENT_DATE )
SELECT *
   FROM t1  where dir1 = MAXDIR(`schema_name`.`. ./path/to/directory/`  ')
But this gives me empty result set and MAXDIR can pick up data only one
level deep.

Appreciate the advise/solution for it !

Thanks,
Divya

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message