hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron Fabbri (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-14946) S3Guard testPruneCommandCLI can fail
Date Thu, 24 May 2018 19:46:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16489671#comment-16489671
] 

Aaron Fabbri commented on HADOOP-14946:
---------------------------------------

Thanks guys.
{quote}NTP logs?
{quote}
Attempt at a joke / me grasping at an explanation for your last stack trace. :) A bogged-down
system should result in "too many items pruned", (since "fresh" files become "stale") not
"not enough items pruned" which is what was different about your last stack trace. I could
only reproduce the former.
{quote}the other one would be to dynamically change the asserts
{quote}
Yeah. We could assert an OR of the two possibilities. That at least gives some sanity check. 
Not sure how to do one exact value without a race.   Anyways, will probably just commit
this for now since it appears to work, and revisit if it comes up again–unless you have
other desires [~stevel@apache.org].

(Aside: Ideally we'd have a Timer or Ticker "fake time source" we could inject into S3AFileSystem
and DynamoDBMS so we could precisely control time without doing this sleep stuff.  Another
day).

> S3Guard testPruneCommandCLI can fail
> ------------------------------------
>
>                 Key: HADOOP-14946
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14946
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 3.0.0
>            Reporter: Steve Loughran
>            Assignee: Gabor Bota
>            Priority: Major
>         Attachments: HADOOP-14946.001.patch, HADOOP-14946.002.patch
>
>
> The test of the S3Guard CLI prune can sometimes fail on parallel test runs. Assumption:
it is the parallelism which is causing the problem
> {code}
> org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardToolDynamoDB
> testPruneCommandCLI(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardToolDynamoDB)  Time
elapsed: 10.765 sec  <<< FAILURE!
> java.lang.AssertionError: Pruned children count [] expected:<1> but was:<0>
> 	at org.junit.Assert.fail(Assert.java:88)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message