helix-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HELIX-706) ExternalViewGeneration should be executed asynchronously in Helix controller
Date Tue, 26 Jun 2018 23:09:00 GMT

    [ https://issues.apache.org/jira/browse/HELIX-706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524313#comment-16524313
] 

ASF GitHub Bot commented on HELIX-706:
--------------------------------------

GitHub user zhan849 opened a pull request:

    https://github.com/apache/helix/pull/206

    [HELIX-706] process tev and persist assignment asynchronously

    Added async worker in generic helix controller to process persist assignment stage and
tev generation state asynchronously

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/zhan849/helix harry/async-ev

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/helix/pull/206.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #206
    
----
commit bb4ffd7e5663377427a5ad5988948659dd0db378
Author: Harry Zhang <hrzhang@...>
Date:   2018-06-26T23:05:50Z

    [HELIX-706] process tev and persist assignment asynchronously

----


> ExternalViewGeneration should be executed asynchronously in Helix controller
> ----------------------------------------------------------------------------
>
>                 Key: HELIX-706
>                 URL: https://issues.apache.org/jira/browse/HELIX-706
>             Project: Apache Helix
>          Issue Type: Task
>            Reporter: Hao Zhang
>            Priority: Major
>
> EV generation should not block helix resource rebalance. According to our profiling results,
external view generation takes ~ 1/5 of the pipeline latency.
> The goal is to generate external view asynchronously, and hopefully we can have 20% improvement
in rebalance pipeline



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message