spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron Davidson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-6373) Add SSL/TLS for the Netty based BlockTransferService
Date Tue, 24 Mar 2015 16:19:54 GMT

    [ https://issues.apache.org/jira/browse/SPARK-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14378084#comment-14378084
] 

Aaron Davidson commented on SPARK-6373:
---------------------------------------

>From my brief look at your work, it seemed pretty close to what I was mentioning, and
overall seemed to be in a very workable state (with tests!). I think it would be great if
you could ready the patch for review, and hopefully it won't be too much more work from your
end.

(Largely unrelated note, but on your patch, an auto-formatter seems to have run which increased
the size of the diff; additionally, the linter seems to have been configured with an 80-char
limit rather than Spark's 100-char.)

> Add SSL/TLS for the Netty based BlockTransferService 
> -----------------------------------------------------
>
>                 Key: SPARK-6373
>                 URL: https://issues.apache.org/jira/browse/SPARK-6373
>             Project: Spark
>          Issue Type: New Feature
>          Components: Block Manager, Shuffle
>    Affects Versions: 1.2.1
>            Reporter: Jeffrey Turpin
>
> Add the ability to allow for secure communications (SSL/TLS) for the Netty based BlockTransferService
and the ExternalShuffleClient. This ticket will hopefully start the conversation around potential
designs... Below is a reference to a WIP prototype which implements this functionality (prototype)...
I have attempted to disrupt as little code as possible and tried to follow the current code
structure (for the most part) in the areas I modified. I also studied how Hadoop achieves
encrypted shuffle (http://hadoop.apache.org/docs/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core/EncryptedShuffle.html)
> https://github.com/turp1twin/spark/commit/024b559f27945eb63068d1badf7f82e4e7c3621c



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message