hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-6248) Circus: Proposal and Preliminary Code for a Hadoop System Testing Framework
Date Fri, 02 Oct 2009 23:52:23 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12761781#action_12761781

Allen Wittenauer commented on HADOOP-6248:

For performance testing, I am not seeing what this gives me over gridmix.  There simply isn't
enough here to generate a load that can be measured and compared and contrasted.

For QA testing of my application, why wouldn't I just try to run my job on a smaller chunk
of representative data that has a known outcome?  Also: if I've already written a mapreduce
job, surely I'm competent enough to run get/put/mkdir/etc.

The fact that it requires python: that's a big fail in my book.  Maybe I missed it, but I'm
not seeing anything that couldn't be handled in shell, never mind the fact that perl is much
more universally installed everywhere. [Yes, I'm on a portability kick. ;) ]

At this point, I don't think this is ready and/or has a clear goal in mind.

> Circus: Proposal and Preliminary Code for a Hadoop System Testing Framework
> ---------------------------------------------------------------------------
>                 Key: HADOOP-6248
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6248
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: test
>         Environment: Python, bash
>            Reporter: Alex Loddengaard
>         Attachments: HADOOP-6248.diff, HADOOP-6248_v2.diff, HADOOP-6248_v3.diff
> This issue contains a proposal and preliminary source code for Circus, a Hadoop system
testing framework.  At a high level, Circus will help Hadoop users and QA engineers to run
system tests on a configurable Hadoop cluster, or distribution of Hadoop.  See the comment
below for the proposal itself.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message