hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mingliang Liu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13446) S3Guard: Support running isolated unit tests separate from AWS integration tests.
Date Tue, 02 Aug 2016 00:08:21 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15403073#comment-15403073
] 

Mingliang Liu commented on HADOOP-13446:
----------------------------------------

+1 (non-binding) for the proposal.

As the S3Guard is using DynamoDB as the major metadata store, I suggest we consider use the
DynamoDBLocal for assisting unit tests. I've been using it locally for my other Hadoop in
the cloud projects and it basically works as expected. Does this make sense?

> S3Guard: Support running isolated unit tests separate from AWS integration tests.
> ---------------------------------------------------------------------------------
>
>                 Key: HADOOP-13446
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13446
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>            Reporter: Chris Nauroth
>            Assignee: Chris Nauroth
>            Priority: Minor
>
> Currently, the hadoop-aws module only runs Surefire if AWS credentials have been configured.
 This implies that all tests must run integrated with the AWS back-end.  It also means that
no tests run as part of ASF pre-commit.  This issue proposes for the hadoop-aws module to
support running isolated unit tests without integrating with AWS.  This will benefit S3Guard,
because we expect the need for isolated mock-based testing to simulate eventual consistency
behavior.  It also benefits hadoop-aws in general by allowing pre-commit to do something more
valuable.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message