openoffice-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From robw...@apache.org
Subject svn commit: r1443641 - /openoffice/site/trunk/content/orientation/intro-qa.mdtext
Date Thu, 07 Feb 2013 18:19:33 GMT
Author: robweir
Date: Thu Feb  7 18:19:33 2013
New Revision: 1443641

URL: http://svn.apache.org/r1443641
Log:
Content updates

Modified:
    openoffice/site/trunk/content/orientation/intro-qa.mdtext

Modified: openoffice/site/trunk/content/orientation/intro-qa.mdtext
URL: http://svn.apache.org/viewvc/openoffice/site/trunk/content/orientation/intro-qa.mdtext?rev=1443641&r1=1443640&r2=1443641&view=diff
==============================================================================
--- openoffice/site/trunk/content/orientation/intro-qa.mdtext (original)
+++ openoffice/site/trunk/content/orientation/intro-qa.mdtext Thu Feb  7 18:19:33 2013
@@ -163,66 +163,87 @@ Everyone in QA needs a Bugzilla account,
 you have a Bugzilla account, you should send a note to the QA list asking to be added to
the QA role in 
 Bugzilla.  This will give you some additional permissions in Bugzilla.  Include your Bugzilla
login ID in your request.
 
+##Easy QA Task: Confirm New Defect Reports
 
-##Easy QA Tasks
+Most new volunteers start by reviewing incoming defect reports and attempting to "confirm"
them.   The defect reports are 
+often from users and are often not very clearly written.  You learn to "read between the
lines" and ask the user clarifying questions
+in order to turn the raw report into a reproducible defect that the developers can debug
and fix.
 
-The easiest tasks for a new QA Volunteer are:
+You can get a list of unconfirmed defect reports with from [this query](https://issues.apache.org/ooo/buglist.cgi?bug_status=UNCONFIRMED&f2=keywords&f3=cf_bug_type&known_name=NeedConfirm&list_id=39759&o2=notsubstring&o3=equals&query_format=advanced&resolution=---&v2=needmoreinfo&v3=DEFECT&order=bug_id%20DESC&query_based_on=NeedConfirm).
 
-  - Verify bug fixes.  This helps you gain familiarity with the OpenOffice product, and our
process.  This 
-verification is also very important, since some bug fixes either fail to fix the bug, or
cause
-a new bug.
-  - Confirm new defect reports.   You review incoming defect reports, often from users and
not very clearly written.
-You learn to "read between the lines" and fill in missing steps to turn the raw report into
a reproducible
-defect that the developers can debug and fix.
-  - Manual testing.  This gains you further familiarity with QA process, by executing pre-defined
test cases and
-writing up defect reports for any new defects found
-  - Writing new test cases.  This is a more advanced topic, but after mastery of the above
two steps, and learning
-to "think like a bug", you will be ready for this.
+Or, if you are just starting out, you can post a note to the QA mailing list and ask for
a small batch of reports to be assigned to you.  This can be a good first
+step, since we'll try to give you easier reports to review at first.
+
+Here's what to do to confirm a new defect report:
+
+ 1. First, assign the report to yourself by setting your Bugzilla username (your email address)
in the "QA Contact" field.
+ 1. Then read over the report.  What are they really saying?  Are the reporting a bug?  Asking
for a new feature?  Asking a support question?  Just because it is in Bugzilla
+ does not mean that it is a defect report.  
+ 1. Ask yourself:  Are they saying that something is working incorrectly?  Or are they asking
for new functionality?
+If they are asking for a new feature, change the Issue Type field to "FEATURE".  If they
are asking for an enhancement of an existing feature, set the Issue Type field to "ENHANCEMENT".
+You can now set the Status to CONFIRMED and then save your changes.  You are done with the
report.  
+ 1. Search Bugzilla to see if this is a duplicate defect report.  If it is, change the Status
to RESOLVED, DUPLICATE and type in the defect number that this report is a duplicate of. 

+ You are now done with this report.
+     1. If the report is actually reporting a defect, then you have more work to do.  Try
to reproduce it with the latest release of OpenOffice. If you can reproduce the defect, 
+     set the Status to CONFIRMED, set the "Last Confirmation" field to the release that you
tested with, and set the Importance field to an appropriate value, depending on the severity

+     of the defect.
+     1. If the report is not clear enough to reproduce, enter a comment asking the user for
more information and add "needmoreinfo" to the Keyword field. Be specific about what information
+     you need:  more detailed steps, a test document, clarification about what version they
are running, etc.  When the user responds you will be copied on 
+     their response and can continue with this report.  But for now you are done with this
report.
+     1. If you testing cannot reproduce the bug, and you *do not* need more information from
the user, then change the status to RESOLVED/IRREPRODUCIBLE.
+     1. If the user was confused, did not understand the functionality, was asking a support
question, etc., then point them to the [Community Support Forums](http://forum.openoffice.org)
+     and mark the issue as RESOLVED/INVALID.  Of course, you can help if it is a simple question,
but the forums are the better place for a user to find help.  Bugzilla is not for 
+     support.  It is for reporting bugs.
+
+Note: Once you have reviewed a bug report, it should only be left in the UNCONFIRMED state
if you are waiting for more information from the user, in which case you should also
+set the "needsmoreinfo" value into the Keyword field.  In all other cases you should push
the report forward to a new status, either CONFIRMED, RESOLVED/IRREPRODUCIBLE,
+RESOLVED/INVALID or RESOLVED/DUPLICATE, or by changing the Issue Type to FEATURE or ENHANCEMENT.
+
+Also, it is a judgement call on whether to immediately mark an issue RESOLVED/IRREPRODUCIBLE
or to send the user a question and wait for a response. 
+
+An intermediate approach, when confirming defects report written against older versions of
OpenOffice, is to mark the bug as RESOLVED/IRREPRODUCIBLE and at the same time add a 
+comment saying, "I was not able to confirm the bug given these steps in the current version
of OpenOffice (AOO 3.4.1), so I'm closing this report.  If you are still seeing this 
+problem after upgrading to AOO 3.4.1 please post the details and we can reopen the report".
+
+Finally, think of the confirmation process as the opportunity for the QA Team to improve
the value of information we receive from users.  We're taking the raw bug reports,
+sorting through them, eliminating the ones that do not report new bugs, and then passing
on the good ones to the programmers.  So anything you can do to improve the quality
+of the incoming defect reports will help.  This includes clarifying the steps needed to reproduce
the problem, attaching sample documents that you might create to reproduce the
+problem, improving report titles to make them more accurate/relevant to the real issue, correcting
classifications and adjusting defect priorities.
 
-### Verifying Fixed Defects
 
-You can get resolved bug list from this query: [All fixed bugs after AOO 3.4 release](https://issues.apache.org/ooo/buglist.cgi?cmdtype=dorem&remaction=run&namedcmd=Fixed_After_340&sharer_id=248432)
+##Easy QA Task: Verifying Fixed Defects
+
+Verifying bug fixes (re-testing a bug report after a developer has fixed it) is also very
important, since some bug fixes either fail to fix the bug, or cause
+a new bug.
+
+You can get a list of fixed bugs from this query: [All fixed bugs after AOO 3.4 release](https://issues.apache.org/ooo/buglist.cgi?cmdtype=dorem&remaction=run&namedcmd=Fixed_After_340&sharer_id=248432)
 
 Select the bug you want to verify:
 
- 1. First you need to understand which fault does the defect report is referring to.
+ 1. First you need to understand which problem the defect report is referring to.
  1. Install the latest build.
  1. Follow the steps to reproduce and check to see if the defect has been fixed.
  1. Add additional comments to the bug with your test result. e.g. build revision number,
platform you have been tested etc.
  1. "Test around" the bug to make sure that nothing was broken when fixing it.  You will
develop and intuition for
 this as you learn to "think like a bug".
- 1. Change defect status to "Verified" (this action requires "CanEdit" privilege" in Bugzilla
system, if you cannot do that then send mail to mailing list and ask other QA do this for
you.)
-
-### Confirm New Defect Reports
+ 1. Change defect status to "Verified" 
 
-You can get a list of unconfirmed defect reports with from [this query](https://issues.apache.org/ooo/buglist.cgi?bug_status=UNCONFIRMED&f2=keywords&f3=cf_bug_type&known_name=NeedConfirm&list_id=39759&o2=notsubstring&o3=equals&query_format=advanced&resolution=---&v2=needmoreinfo&v3=DEFECT&order=bug_id%20DESC&query_based_on=NeedConfirm).
 
-Select the report you want to confirm:
 
- 1. Incoming reports could be from other project members, from power users or from new users.
  Some might not
-even be real defect reports.  It might be a support question or a request for a new feature.
 So your first
-task is to do determine what you really have here. 
- 1. Ask yourself:  Are they saying that something is working incorrectly?  Or are they asking
for new functionality?
-If they are asking for a new feature, change the Issue Type field to "FEATURE".  You are
now done with that report.
- 1. Search Bugzilla to see if this is a duplicate defect report.  If it is, change the Status
to Resolved, Duplicate
-and type in the defect number that this report is a duplicate of.  You are now done with
this report.
- 1. If the report is reporting a defect, try to reproduce it with the latest release of OpenOffice.
 If the report
-is not clear enough to reproduce, enter a comment asking for more information and add the
"needmoreinfo" keyword.  
-When the user responds you will be copied on their response and can continue with this report.
 But for now you
-are done with this report.
- 1. If you can reproduce the defect, set the status to CONFIRMED, set the "Last Confirmation"
field to the 
-release that you tested with, and set the Importance field to an appropriate value, depending
on the severity
-of the defect.
- 1. If you cannot confirm the bug, and the bug report was clear, then change the status to
RESOLVED/IRREPRODUCIBLE.
+##Easy QA Task: Manual Testing
 
-###Manual Testing
+Manual testing gains you further familiarity with QA process, by executing pre-defined test
cases and
+writing up defect reports for any new defects found
 
 To get more familiar with AOO, now you can try to perform some manual test cases.
 
   - Browse test management tool, [Testlink](http://aootesting.adfinis-sygroup.org) to find
available test cases.<br>
   - Read this guide if you are not familiar with Testlink tool. [Testlink usage guide](http://wiki.openoffice.org/wiki/QA/Testlink
)
 
-###Test Case Authoring
+##: Easy QA Task: Test Case Authoring
+
+This is a more advanced topic, but after mastery of the above two steps, and learning to
"think like a bug", you will be ready for this.
+
 After some practice on test case execution, now you can start writing new test cases.
 
 Useful guide for writing manual test cases:
@@ -234,7 +255,7 @@ Useful guide for writing manual test cas
 ## Module Completion
 
 Once you have done the above, go to our our [Directory of Volunteers](https://cwiki.apache.org/confluence/display/OOOUSERS/Directory+of+Volunteers)
wiki page and add or update your 
-information.  Congratulations!  Please send a note to [qa@openoffice.apache.org](mailto:qa@openoffice.apache.org?subject=Completed
Introduction to QA) 
-so we know.
+information.  Also, add an entry for yourself to the [QA Testing Preferences](https://cwiki.apache.org/confluence/display/OOOUSERS/QA+Testing+Preferences)
page. Congratulations!  
+Please send a note to [qa@openoffice.apache.org](mailto:qa@openoffice.apache.org?subject=Completed
Introduction to QA) so we know.
 
 



Mime
View raw message