spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adam Roberts (JIRA)" <>
Subject [jira] [Created] (SPARK-19552) Upgrade Netty version to 4.1.8 final
Date Fri, 10 Feb 2017 16:32:41 GMT
Adam Roberts created SPARK-19552:

             Summary: Upgrade Netty version to 4.1.8 final
                 Key: SPARK-19552
             Project: Spark
          Issue Type: Improvement
          Components: Build
    Affects Versions: 2.1.0
            Reporter: Adam Roberts
            Priority: Minor

Netty 4.1.8 was recently released but isn't API compatible with previous major versions (like
Netty 4.0.x), see for details.

This version does include a fix for a security concern - I don't know if Spark can be used
as an attack vector so let's upgrade the version we use to be on the safe side. The security
fix I'm especially interested in is not available in the 4.0.x release line.

As this 4.1 version involves API changes we'll need to implement a few methods and possibly
adjust the Sasl tests. I'd also like to know the purpose of the additional netty (without
"all" in the artifact name) in our pom that's at version 3.9.9.

This JIRA and associated pull request starts the process which I'll work on - and any help
would be much appreciated! Currently I know:

public void write(ChannelHandlerContext ctx, Object msg, ChannelPromise promise)
      throws Exception {
      if (!foundEncryptionHandler) {
        foundEncryptionHandler =
 != null; <-- this returns false
and causes test failures
      ctx.write(msg, promise);

Here's what changes will be required (at least):

requires touch, retain and transferred methods

requires the above methods too


With "dummy" implementations so we can at least compile and test, we'll see five new test
failures to address.

These are
org.apache.spark.rpc.netty.NettyRpcEnvSuite.send with SASL encryption
org.apache.spark.rpc.netty.NettyRpcEnvSuite.ask with SASL encryption

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message