hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron Fabbri (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-14946) S3Guard testPruneCommandCLI can fail
Date Thu, 24 May 2018 19:46:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16489671#comment-16489671

Aaron Fabbri commented on HADOOP-14946:

Thanks guys.
{quote}NTP logs?
Attempt at a joke / me grasping at an explanation for your last stack trace. :) A bogged-down
system should result in "too many items pruned", (since "fresh" files become "stale") not
"not enough items pruned" which is what was different about your last stack trace. I could
only reproduce the former.
{quote}the other one would be to dynamically change the asserts
Yeah. We could assert an OR of the two possibilities. That at least gives some sanity check. 
Not sure how to do one exact value without a race.   Anyways, will probably just commit
this for now since it appears to work, and revisit if it comes up again–unless you have
other desires [~stevel@apache.org].

(Aside: Ideally we'd have a Timer or Ticker "fake time source" we could inject into S3AFileSystem
and DynamoDBMS so we could precisely control time without doing this sleep stuff.  Another

> S3Guard testPruneCommandCLI can fail
> ------------------------------------
>                 Key: HADOOP-14946
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14946
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 3.0.0
>            Reporter: Steve Loughran
>            Assignee: Gabor Bota
>            Priority: Major
>         Attachments: HADOOP-14946.001.patch, HADOOP-14946.002.patch
> The test of the S3Guard CLI prune can sometimes fail on parallel test runs. Assumption:
it is the parallelism which is causing the problem
> {code}
> org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardToolDynamoDB
> testPruneCommandCLI(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardToolDynamoDB)  Time
elapsed: 10.765 sec  <<< FAILURE!
> java.lang.AssertionError: Pruned children count [] expected:<1> but was:<0>
> 	at org.junit.Assert.fail(Assert.java:88)
> {code}

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message