hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Juan Yu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-11128) abstracting out the scale tests for FileSystem Contract tests
Date Thu, 25 Sep 2014 00:46:33 GMT
Juan Yu created HADOOP-11128:
--------------------------------

             Summary: abstracting out the scale tests for FileSystem Contract tests
                 Key: HADOOP-11128
                 URL: https://issues.apache.org/jira/browse/HADOOP-11128
             Project: Hadoop Common
          Issue Type: Improvement
            Reporter: Juan Yu


Currently we have some scale tests for openstack and s3a. For now we'll just trust HDFS to
handle files >5GB and delete thousands of file in a directory properly.
We should abstract out the scale tests so it can be applied to all FileSystems.

A few things to consider for scale tests:
scale tests rely on the tester having good/stable upload bandwidth, might need large disk
space. It needs to be configurable or optional.
scale tests might need long time to finish, consider have test timeout configurable if possible



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message