kylin-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "wangxianbin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KYLIN-1082) Hive dependencies should be add to tmpjars
Date Fri, 08 Jan 2016 09:15:40 GMT

    [ https://issues.apache.org/jira/browse/KYLIN-1082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088945#comment-15088945
] 

wangxianbin commented on KYLIN-1082:
------------------------------------

hi yang, after investigation, I found that your guys have merged fengyu patch for KYLIN-1021,
except that users need to upload hive dependencies jar into hdfs manually and set "kylin.job.mr.lib.dir"
in kylin.properties, and seem like you guys already have an agreement on this, however, there
is another patch from fengyu in KYLIN-1021, in this patch, he make jar upload automatically,
all you need to do is just enable "kylin.job.upload.jars.enabled" in kylin.properties, however,
this patch is not merged into kylin, so your guys prefer upload jar automatically now?, that's
why you create this ticket?

> Hive dependencies should be add to tmpjars
> ------------------------------------------
>
>                 Key: KYLIN-1082
>                 URL: https://issues.apache.org/jira/browse/KYLIN-1082
>             Project: Kylin
>          Issue Type: Bug
>            Reporter: liyang
>            Assignee: liyang
>              Labels: newbie
>
> Currently kylin assume all data nodes have hive deployment at exact same FS location.
However, a better position is to think hive as a client side app. Then we need to ship hive
jar with MR job every time.
> This make deploy kylin a lot easier in cluster that does not have hive on all data nodes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message