tajo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hyunsik Choi <hyun...@apache.org>
Subject Re: TPC-DS docs for Tajo Wiki
Date Mon, 09 Mar 2015 06:36:46 GMT
Thank you for your comment. Sounds nice to me. Please go head!

On Sun, Mar 8, 2015 at 11:31 PM, Dongjoon Hyun <dongjoon@apache.org> wrote:
> Thank you, Hyunsik and Jihoon.
>
> For your suggestion, I totally agree with you. Tajo must handle the
> original queries of TPC-DS.
> Fortunately, I generated those queries from TPC-DS by myself.
> (I studied and referred Cloudera and Hortonworks, but I do not use their
> modified queries)
>
> I used the following commands with official TPC-DS tools in
> "TPCDSVersion1.3.1/dbgen2" folder,
>
> for i in {1..99}; do ./dsqgen -template query$i.tpl -directory
> ../query_templates -dialect netezza -scale 1 -verbose; mv query_0.sql
> query$i.sql; done;
>
> I used 'netezza' dialect for 'limit' clause. It has no other side effects.
> Sorry for missing the above details.
>
> If I missed anything else, please talk to me anytime. I welcome any
> feedback.
>
> Regards,
> Dongjoon.
>
>
> On Mon, Mar 9, 2015 at 2:55 PM, Hyunsik Choi <hyunsik.choi@gmail.com> wrote:
>
>> It's a great start for TPC-DS benchmark.
>>
>> I have one suggestion. Your seem to refer impala's TPC-DS queries.
>> But, some of them are modified too much.  Later, we need to
>> investigate how many original queries work in Tajo, and we need to
>> reflect the original queries rather than modified ones to the wiki
>> page.
>>
>> Warm regards,
>> Hyunsik
>>
>> On Sun, Mar 8, 2015 at 10:47 PM, Jihoon Son <jihoonson@apache.org> wrote:
>> > Looks great!
>> > Thanks Dongjoon
>> >
>> > Best,
>> > Jihoon
>> > 2015년 3월 9일 (월) 오후 2:38, Dongjoon Hyun <dongjoon@apache.org>님이
작성:
>> >
>> >> I created and filled the following page according to my file.
>> >>
>> >> https://cwiki.apache.org/confluence/display/TAJO/TPC-DS+Benchmark+Set
>> >>
>> >> Thank you, Hyunsik.
>> >>
>> >> Best regards,
>> >> Dongjoon.
>> >>
>> >> On Mon, Mar 9, 2015 at 1:51 PM, Hyunsik Choi <hyunsik@apache.org
>> >> <javascript:_e(%7B%7D,'cvml','hyunsik@apache.org');>> wrote:
>> >>
>> >> > I just gave your account the privileges. You can create or edit wiki
>> >> pages
>> >> > now.
>> >> >
>> >> > Best regards,
>> >> > Hyunsik
>> >> >
>> >> > On Sun, Mar 8, 2015 at 9:49 PM, Dongjoon Hyun <dongjoon@apache.org
>> >> > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org');>> wrote:
>> >> > > Thanks, Jihoon. :)
>> >> > >
>> >> > > Regards,
>> >> > > Dongjoon.
>> >> > >
>> >> > > 2015년 3월 9일 월요일, Jihoon Son<jihoonson@apache.org
>> >> > <javascript:_e(%7B%7D,'cvml','jihoonson@apache.org');>>님이
작성한 메시지:
>> >> > >
>> >> > >> Thanks Hyunsik.
>> >> > >> That's the best way I think.
>> >> > >>
>> >> > >> Dongjoon,
>> >> > >> I read your document carefully, and looks good.
>> >> > >> Currently, I don't have any comments.
>> >> > >> Please go ahead!
>> >> > >>
>> >> > >> Regards,
>> >> > >> Jihoon
>> >> > >>
>> >> > >> On Mon, Mar 9, 2015 at 1:30 PM Dongjoon Hyun <dongjoon@apache.org
>> >> > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org');>
>> >> > >> <javascript:;>> wrote:
>> >> > >>
>> >> > >> > Hi, Hyunsik.
>> >> > >> >
>> >> > >> > Thank you. If you do so, I will create and update TPC-DS
page.
>> My id
>> >> > is
>> >> > >> > dongjoon.
>> >> > >> >
>> >> > >> > Regards,
>> >> > >> > Dongjoon.
>> >> > >> >
>> >> > >> > On Mon, Mar 9, 2015 at 1:18 PM, Hyunsik Choi <hyunsik@apache.org
>> >> > <javascript:_e(%7B%7D,'cvml','hyunsik@apache.org');>
>> >> > >> <javascript:;>
>> >> > >> > <javascript:_e(%7B%7D,'cvml','hyunsik@apache.org
>> >> > <javascript:_e(%7B%7D,'cvml','hyunsik@apache.org');>
>> <javascript:;>');>>
>> >> > >> wrote:
>> >> > >> >
>> >> > >> > > Hi Dongjoon,
>> >> > >> > >
>> >> > >> > > Thank you for your work. The work looks nice. Do
you have a
>> wiki
>> >> > >> > > account? If so, please let me know your account.
I'll give
>> proper
>> >> > >> > > privileges to your account, allowing you to edit
the wiki
>> pages.
>> >> It
>> >> > >> > > would be great if you continue to update the TPC-DS
pages.
>> >> > >> > >
>> >> > >> > > If you don't have a wiki account, you can easily
create the
>> >> account
>> >> > at
>> >> > >> > > https://cwiki.apache.org/confluence/signup.action
>> >> > >> > >
>> >> > >> > > Best regards,
>> >> > >> > > Hyunsik
>> >> > >> > >
>> >> > >> > > On Sun, Mar 8, 2015 at 5:54 PM, Jihoon Son <
>> jihoonson@apache.org
>> >> > <javascript:_e(%7B%7D,'cvml','jihoonson@apache.org');>
>> >> > >> <javascript:;>
>> >> > >> > > <javascript:_e(%7B%7D,'cvml','jihoonson@apache.org
>> >> > <javascript:_e(%7B%7D,'cvml','jihoonson@apache.org');>
>> >> <javascript:;>');>>
>> >> > >> wrote:
>> >> > >> > > > Thanks for sharing.
>> >> > >> > > > It doesn't matter via whatever sharing tools
you use.
>> >> > >> > > > I just think that Jira can be a good candidate
for sharing.
>> >> > >> > > >
>> >> > >> > > > Anyway, it looks good in overall. I'll left
some comments.
>> >> > >> > > >
>> >> > >> > > > Regards,
>> >> > >> > > > Jihoon
>> >> > >> > > >
>> >> > >> > > > 2015년 3월 9일 (월) 오전 9:16, Dongjoon
Hyun
>> >> > >> > > > dongjoon@apache.org
>> >> > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org');> <javascript:;>
>> >> > >> > > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org
>> >> > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org');>
>> >> > <javascript:;>');>>님이
>> >> > >> 작성:
>> >> > >> > > >
>> >> > >> > > > Thank you, Jihoon.
>> >> > >> > > >>
>> >> > >> > > >> By the way, Tajo wiki is not managed by
Git. I thought this
>> is
>> >> > not a
>> >> > >> > > patch.
>> >> > >> > > >> Here is the file.
>> >> > >> > > >>
>> >> > >> > > >> Google Drive
>> >> > >> > > >>
>> >> > >> > > >> tpcds.rst
>> >> > >> > > >> <
>> https://docs.google.com/file/d/0B6ZxA8hLu4UIUVAtbE5maTVjWFk/
>> >> > >> > > >> edit?usp=drivesdk>
>> >> > >> > > >>
>> >> > >> > > >>
>> >> > >> > > >> Box (tpcds.txt, the same file with the
above)
>> >> > >> > > >>
>> >> > >> > > >> https://app.box.com/s/g0w051zgh09wsa982klp6nqgow709ssk
>> >> > >> > > >>
>> >> > >> > > >> TPC-DS is very heavy benchmark including
updating the DW
>> tables
>> >> > from
>> >> > >> > > >> original source tables. This file does
not cover that kind
>> >> > updating
>> >> > >> > > part.
>> >> > >> > > >> It's a beginning of Tajo for official supporting
TPC-DS.
>> >> > >> > > >>
>> >> > >> > > >> I have a plan to focus TPC-DS with Tajo
for a while. I
>> >> appreciate
>> >> > >> any
>> >> > >> > > >> comments.
>> >> > >> > > >>
>> >> > >> > > >> Thank you again, Jihoon.
>> >> > >> > > >>
>> >> > >> > > >> Regards,
>> >> > >> > > >> Dongjoon.
>> >> > >> > > >>
>> >> > >> > > >> 2015년 3월 9일 월요일,
>> >> > >> > > >> Jihoon Son<jihoonson@apache.org
>> >> > <javascript:_e(%7B%7D,'cvml','jihoonson@apache.org');> <javascript:;>
>> >> > >> > > <javascript:_e(%7B%7D,'cvml','jihoonson@apache.org
>> >> > <javascript:_e(%7B%7D,'cvml','jihoonson@apache.org');>
>> >> > <javascript:;>');>>님이
>> >> > >> 작성한 메시지:
>> >> > >> > > >>
>> >> > >> > > >> > Good idea.
>> >> > >> > > >> > I can help you to reflect your patch.
>> >> > >> > > >> > Would you share it with us?
>> >> > >> > > >> > I think Jira is good for sharing.
>> >> > >> > > >> >
>> >> > >> > > >> > Best regards,
>> >> > >> > > >> > Jihoon
>> >> > >> > > >> > 2015년 3월 9일 (월) 오전 8:05,
Dongjoon Hyun <
>> dongjoon@apache.org
>> >> > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org');>
>> >> > >> <javascript:;>
>> >> > >> > > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org
>> >> > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org');>
>> <javascript:;>');>
>> >> > >> > > >> <javascript:;>>님이
>> >> > >> > > >> > 작성:
>> >> > >> > > >> >
>> >> > >> > > >> > > Hi,
>> >> > >> > > >> > >
>> >> > >> > > >> > > TPC-DS is becoming more popular.
It is in the Tajo
>> Roadmap
>> >> > also
>> >> > >> > and
>> >> > >> > > >> > > several related issues are already
created and closed in
>> >> Tajo
>> >> > >> > Jira.
>> >> > >> > > >> So, I
>> >> > >> > > >> > > made TPC-DS rst file for Tajo
wiki during last weekend.
>> I
>> >> > think
>> >> > >> it
>> >> > >> > > will
>> >> > >> > > >> > be
>> >> > >> > > >> > > helpful for other Tajo users
preparing TPC-DS in the
>> >> future.
>> >> > >> > > >> > >
>> >> > >> > > >> > > Could anyone review this and
update Tajo wiki (maybe,
>> >> > benchmark
>> >> > >> > > >> section)?
>> >> > >> > > >> > > I prepared this file in the same
style with TPC-H in
>> Tajo
>> >> > wiki.
>> >> > >> > > >> > >
>> >> > >> > > >> > > Warmly,
>> >> > >> > > >> > > Dongjoon.
>> >> > >> > > >> > >
>> >> > >> > > >> >
>> >> > >> > > >>
>> >> > >> > >
>> >> > >> >
>> >> > >>
>> >> >
>> >>
>>

Mime
View raw message