kylin-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "zhangwei (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KYLIN-3811) Support the standalone HBase cluster using HDFS HA
Date Tue, 26 Feb 2019 07:50:00 GMT

    [ https://issues.apache.org/jira/browse/KYLIN-3811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16777689#comment-16777689
] 

zhangwei commented on KYLIN-3811:
---------------------------------

because LoadIncrementalHfile is hbase class and we don't want to change class of hbase so
we hack this class in kylin side

this is main change left is kylinloadincrementalHFile right is LoadIncrementalHfile

 !screenshot-1.png! 

> Support the standalone HBase cluster using HDFS HA
> --------------------------------------------------
>
>                 Key: KYLIN-3811
>                 URL: https://issues.apache.org/jira/browse/KYLIN-3811
>             Project: Kylin
>          Issue Type: Improvement
>          Components: Storage - HBase
>    Affects Versions: v2.3.1
>            Reporter: zhangwei
>            Assignee: zhangwei
>            Priority: Minor
>         Attachments: hdfs_ha.patch, hdfs_ha_2.patch, screenshot-1.png
>
>
> 独立hbase 集群的 hdfs namenode主备切换导致Kylin无法正常工作的问题
> 痛点:
> ylin.hbase.cluster.fs=hdfs://namenode:54310,在hbase的hdfs namenode切换之后会,和hbase
hdfs相关的步骤会出现失败
> 我们的方案:(所有的修改都基于kylin的代码,不需要hbase 做修改) 
> kylin.properties 
> kylin.hbase.cluster.fs=hdfs://nshbase
> kylin.storage.hbase.cluster-hdfs-config-file=hbase-hdfs-site.xml
> hbase-hdfs-site.xml配置 hbase hdfs的HA连接方式,其中dfs.nameservices= nshbase



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message