hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-16050) s3a SSL connections should use OpenSSL
Date Mon, 29 Apr 2019 23:08:01 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-16050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16829811#comment-16829811

Steve Loughran commented on HADOOP-16050:

bq. I just wish there's a module specific for cloud storage so we don't bloat the hadoop-comm

we can compile the stuff into hadoop-common but only add the new JAR into the specific modules
(hadoop-azure, aws, maybe ozone) which want to use it. 

> s3a SSL connections should use OpenSSL
> --------------------------------------
>                 Key: HADOOP-16050
>                 URL: https://issues.apache.org/jira/browse/HADOOP-16050
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 2.9.1
>            Reporter: Justin Uang
>            Assignee: Sahil Takiar
>            Priority: Major
>         Attachments: Screen Shot 2019-01-17 at 2.57.06 PM.png
> We have found that when running the S3AFileSystem, it picks GCM as the ssl cipher suite.
Unfortunately this is well known to be slow on java 8: [https://stackoverflow.com/questions/25992131/slow-aes-gcm-encryption-and-decryption-with-java-8u20.]
> In practice we have seen that it can take well over 50% of our CPU time in spark workflows.
We should add an option to set the list of cipher suites we would like to use. !Screen Shot
2019-01-17 at 2.57.06 PM.png!

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message