spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nan Zhu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-6422) support customized akka system for actor-based receiver
Date Fri, 20 Mar 2015 01:24:38 GMT
Nan Zhu created SPARK-6422:
------------------------------

             Summary: support customized akka system for actor-based receiver
                 Key: SPARK-6422
                 URL: https://issues.apache.org/jira/browse/SPARK-6422
             Project: Spark
          Issue Type: Improvement
          Components: Streaming
    Affects Versions: 1.4.0
            Reporter: Nan Zhu


To disable the Akka's fault detection system, we currently set large default values for Akka'
transport failure detector threshold and heartbeat interval, and discourage users to customize
these values..

Meanwhile, we are trying to eliminate the dependency to Akka, e.g. we are trying to implement
a general RPC interface (https://github.com/apache/spark/pull/4588), etc.

Based on the above facts, enabling a customized Akka system for actor-based receiver has two
benefits: 1) users can easily set values related to failure detector which are more practical
in general Akka usage scenario; 2) reduce the dependency level to Akka, (in future, we can
even move Actor-based receiver to external project)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message