hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-16319) ITestS3AMiscOperations.testEmptyFileChecksums and ITestS3AMiscOperations.testNonEmptyFileChecksumsUnencrypted fail with default encryption enabled on bucket
Date Fri, 17 May 2019 21:17:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-16319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842596#comment-16842596
] 

Steve Loughran commented on HADOOP-16319:
-----------------------------------------

Looks like from the S3 client direct you can see if there's a default encryption and skip
the tests if so

https://docs.aws.amazon.com/AmazonS3/latest/API/RESTBucketGETencryption.html

> ITestS3AMiscOperations.testEmptyFileChecksums and ITestS3AMiscOperations.testNonEmptyFileChecksumsUnencrypted
fail with default encryption enabled on bucket
> ------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-16319
>                 URL: https://issues.apache.org/jira/browse/HADOOP-16319
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>            Reporter: Ben Roling
>            Priority: Major
>
> I recently updated a bucket I use for hadoop-aws maven testing to enable default encryption. 
After doing so, I noticed these two tests failing:
> {noformat}
> [INFO] Running org.apache.hadoop.fs.s3a.ITestS3AMiscOperations
> [ERROR] Tests run: 12, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 35.097 s <<<
FAILURE! - in org.apache.hadoop.fs.s3a.ITestS3AMiscOperations
> [ERROR] testEmptyFileChecksums(org.apache.hadoop.fs.s3a.ITestS3AMiscOperations) Time
elapsed: 3.503 s <<< FAILURE!
> java.lang.AssertionError: checksums expected:<etag: "35ce921ee8c01e6c2ca15d4c44f3cbde">
but was:<etag: "18677de776ff748ef9dbeb0d906e9fdc">
> at org.apache.hadoop.fs.s3a.ITestS3AMiscOperations.testEmptyFileChecksums(ITestS3AMiscOperations.java:147)
> [ERROR] testNonEmptyFileChecksumsUnencrypted(org.apache.hadoop.fs.s3a.ITestS3AMiscOperations)
Time elapsed: 3.145 s <<< FAILURE!
> java.lang.AssertionError: checksums expected:<etag: "bedaf4e62dbcd7c57bd2bb784ace06d0">
but was:<etag: "4b97915374221d1e3d2ffb20562c8867">
> at org.apache.hadoop.fs.s3a.ITestS3AMiscOperations.testNonEmptyFileChecksumsUnencrypted(ITestS3AMiscOperations.java:199){noformat}
> I haven't looked in detail at the tests yet but it seems they should either be updated
such that they can succeed or be skipped when default encryption is enabled or documentation
for running the tests should contain instructions to use a bucket without default encryption.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message