spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tathagata Das (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-4028) ReceivedBlockHandler interface to abstract the functionality of storage of received data
Date Tue, 21 Oct 2014 02:15:33 GMT
Tathagata Das created SPARK-4028:
------------------------------------

             Summary: ReceivedBlockHandler interface to abstract the functionality of storage
of received data
                 Key: SPARK-4028
                 URL: https://issues.apache.org/jira/browse/SPARK-4028
             Project: Spark
          Issue Type: Sub-task
          Components: Streaming
            Reporter: Tathagata Das
            Assignee: Tathagata Das
            Priority: Critical


As part of the initiative to prevent data loss on streaming driver failure, this JIRA tracks
the subtask of implementing a ReceivedBlockHandler, that abstracts the functionality of storage
of received data blocks. The default implementation will maintain the current behavior of
storing the data into BlockManager. The optional implementation will store the data to both
BlockManager as well as a write ahead log. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message