kylin-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "wangxianbin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KYLIN-1082) Hive dependencies should be add to tmpjars
Date Mon, 25 Jan 2016 09:49:39 GMT

    [ https://issues.apache.org/jira/browse/KYLIN-1082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114973#comment-15114973
] 

wangxianbin commented on KYLIN-1082:
------------------------------------

I see your point, and yes, your implementation is clear and nice, there is just one flaw,
it will broadcast hive dependencies anyway, however, in KYLIN-1021 agreement, for some case
like cluster which have consistent binary and configs across all nodes, we do not need to
broadcast hive dependencies, so we can add one flag to disable it, check KYLIN-1021.

> Hive dependencies should be add to tmpjars
> ------------------------------------------
>
>                 Key: KYLIN-1082
>                 URL: https://issues.apache.org/jira/browse/KYLIN-1082
>             Project: Kylin
>          Issue Type: Bug
>          Components: Environment , Job Engine
>            Reporter: liyang
>            Assignee: Zhong Yanghong
>              Labels: newbie
>             Fix For: v2.1, v1.3
>
>         Attachments: auto_hive_tmpjars_1_x_staging.patch, auto_hive_tmpjars_2_x_staging.patch
>
>
> Currently kylin assume all data nodes have hive deployment at exact same FS location.
However, a better position is to think hive as a client side app. Then we need to ship hive
jar with MR job every time.
> This make deploy kylin a lot easier in cluster that does not have hive on all data nodes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message