helix-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HELIX-706) ExternalViewGeneration should be executed asynchronously in Helix controller
Date Thu, 28 Jun 2018 21:26:00 GMT

    [ https://issues.apache.org/jira/browse/HELIX-706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526795#comment-16526795
] 

Hudson commented on HELIX-706:
------------------------------

FAILURE: Integrated in Jenkins build helix #1476 (See [https://builds.apache.org/job/helix/1476/])
[HELIX-706] process tev and persist assignment asynchronously (hrzhang: rev 7a2b9693d49d578ac9121a944f1b469c2f2316d9)
* (edit) helix-core/src/main/java/org/apache/helix/common/DedupEventProcessor.java
* (edit) helix-core/src/main/java/org/apache/helix/controller/stages/AttributeName.java
* (edit) helix-core/src/main/java/org/apache/helix/controller/stages/ClusterDataCache.java
* (edit) helix-core/src/main/java/org/apache/helix/controller/GenericHelixController.java
* (edit) helix-core/src/main/java/org/apache/helix/controller/stages/PersistAssignmentStage.java
* (edit) helix-core/src/main/java/org/apache/helix/controller/pipeline/AbstractBaseStage.java
* (add) helix-core/src/main/java/org/apache/helix/controller/stages/AsyncWorkerType.java
* (edit) helix-core/src/main/java/org/apache/helix/controller/stages/TargetExteralViewCalcStage.java


> ExternalViewGeneration should be executed asynchronously in Helix controller
> ----------------------------------------------------------------------------
>
>                 Key: HELIX-706
>                 URL: https://issues.apache.org/jira/browse/HELIX-706
>             Project: Apache Helix
>          Issue Type: Task
>            Reporter: Hao Zhang
>            Priority: Major
>
> EV generation should not block helix resource rebalance. According to our profiling results,
external view generation takes ~ 1/5 of the pipeline latency.
> The goal is to generate external view asynchronously, and hopefully we can have 20% improvement
in rebalance pipeline



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message