spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From tsdeng <...@git.apache.org>
Subject [GitHub] incubator-spark pull request: add event listener when executors ar...
Date Thu, 13 Feb 2014 21:04:39 GMT
GitHub user tsdeng opened a pull request:

    https://github.com/apache/incubator-spark/pull/597

    add event listener when executors are stopped, for sending back final stats

    add onExecutorStopped event handler.
    So when master command a shutdown, the executors can send the final message reporting
its statuses by replying ExecutorFinalState message(currently only hdfsRead is reported, more
can be added later).
    And the master will wait for all response to comeback within the timeout window.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/apache/incubator-spark on_executors_stopped_master

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-spark/pull/597.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #597
    
----
commit 7a45209600017bf9e8b89ff79d23bc245358429f
Author: Tianshuo Deng <tdeng@twitter.com>
Date:   2014-02-13T21:02:54Z

    add event listener when executors are stopped, for sending back final executor state

----


Mime
View raw message