Copyright © 2002-2003 W3C® (MIT, ERCIM, Keio), All Rights Reserved. W3C liability, trademark, document use and software licensing rules apply.
This is an Appendix to QA Framework: Operational Examples & Techniques. It contains a template for a Working Group QA Process Document (QAPD). It is complete in outline form -- all necessary sections and topics, as required by the QA Framework: Operational Guidelines (OpsGL), are represented.
This template should help implementers of QA Framework: Operational Guidelines (OpsGL) to satisfy those OpsGL checkpoints that require a QAPD or place requirements on its content -- start with this template and fill in the designated QA-related information. This will produce a complete QAPD that satisfies the OpsGL requirements.
This template contains prototype statements and content as required of a QAPD. The prototype statements contain fill-in-the-blank sections, which appear like this, "[specification name]". A WG would supply the appropriate information here to complete the prototype statement and make it an actual QAPD statement.
This template makes reference to an Authoring Guideline or Test Material manual. This is typically a separate WG document that describes the format of the test materials and is used to ensure that test material contributions are in an appropriate format and include the requisite information to facilitate consistency, assessment, and inclusion of the test materials. If a WG does not have an Authoring Guideline or Test material manual, then it is recommended that authoring information be included in its QA Process Document.
Each subsection relates to a particular Checkpoint of OpsGL. The appropriate back reference and link immediately follows the subsection title, and looks like this:
[For OpsGL checkpoint CPx.y]
These may be deleted from the final QAPD text that the WG produces, at the discretion of the QAPD author.
The following are some fill-in-the-blank items that are commonly used or repeated in this template:
@@ This is the second revision. Still some stuff to be done. Inconsistent use of TM name/type. Look out for "test suite". A couple of undefined concepts: "Development Guide"; @@
The QA Process Document (QAPD) template follows this line.
This is the [DATE] QA Test Material Process Document for [WG Name].
Comments on this document are invited and are to be sent to the [name of mail list] mailing list [address of list]. An archive is available at [address of archive].
This document has been produced by the W3C [WG Name]. The authors of this document are the [WG Name] WG members.
This document describes the QA process for ensuring availability of comprehensive conformance [test material type - choice of: test suite(s) | validator tool(s) | checklist | other(specify)] for the [specification name | (W3C-[WG Name]-specifications)]. It provides information about the WG's quality-related logistical and communications setup, contribution mechanism, licensing policies, publication and maintenance plans, as well as any other critical processes and operational details needed to produce and maintain the [test material type].
The [test material type] produced by the W3C [WG name] will be known as [test material name].
The [test material name] will be produced in a way that provides for contributions from developers and companies in the community. The [test material name] will be coordinated and supervised by the [WG Name and/or other names]. The WG appoints a moderator to lead the effort.
[For OpsGL checkpoint CP4.4]
[Choose one: a) if you use the WGs established list or b) if you set up a dedicated list]
a) The main channel of communication for the [test material name] will be the existing [WG name] mailing list [address]. An archive is available at [address]
b)The main channel of communication for the [test material name] will be a dedicated mailing list, called [test material name] mailing list [address]. An archive is available at [address].
The public web page for QA information is named /Test/ and is available at: [http://www.w3.org/WGname/Test/]. This page includes links to this process document, the [test material name] and information about the [test material name] including:
[For OpsGL checkpoint CP4.5]
The [test material type] will be produced in a public framework with contributions from members of the [WG name], W3C, or the community at large. The framework will provide a stable mechanism for submission of test materials, saving information about those tests, version handling, use of the tests, and so forth.
[For OpsGL checkpoint CP5.2]
[Delete paragraph, if WG has no Authoring Guideline or Test Material Manual]Contributions should be submitted in accordance with the[Choose: Authoring Guidelines | Test Material Manual].The[Choose: AuthoringGuidelines | Test Material Manual]explain how to write tests for the[test material name]. It defines the[choose one or more: format | test description file | schema | other]for the contribution along with any additional required documenation.
Choose one:
a) Contributions of test materials should be submitted to the [test material name] via the [WG name or test material name @@ this is a or b from above] mailing list: [address].
b) Contributions of test materials should be submitted to the [test material name] test submission mailing list: [name-testsuite]-submit@w3.org. An archive is available at: [address]
The process for test materials contributions is:
[For OpsGL checkpoint CP5.4]
Contributions to the [test material name] are evaluated according to the following criteria.
If a contributed test is judged suitable for inclusion in the [test material type] according to these criteria, the test is added to the [test material type] with status "Accepted".
Tests that are judged to be inappropriate for publication are returned to the contributor. Such tests are archived and not included in the [test material type].
[For OpsGL checkpoint CP8.3
(?)]
Once a test is included into the[test material name], it becomes
subject to the dispute process outlined below.
At any time, any member of the community or WG may dispute the validity of
any test in the [test material name]. This
is done by raising the issue on the [test material
name] mailing list. If the dispute is felt to be valid either by
the community and/orby members of the WG[test material name]Task
Force, the status of the test is changed to "Disputed", and the test is
referred to the WG for detailed review. The possible outcomes of the review
are:
Each contribution to the [test material name] must be fully documented, [@@ if there is a schema (indicated in subsection:Recept and Review of Test Contributions #3) add:] and conform to the schema for test submissions, which is available at the [test material name] website. The documentation provides such information as:
[For OpsGL checkpoint@@@-- is there
one?]
It is proposed that the W3C[WG
name]WG representative act as moderator and controller for
incoming tests. The[test material
name]moderator is chosen by the[WG name]WG. All tests should be
kept for archive purposes, whether they get published or not.
[For OpsGL checkpoints CP4.6, CP6.4]
The [test material name] aims, as
explained above,to help implementers write applications that support
[specification name]. In no way are these
conformance tests to be construed as providing certification or branding of
[specification name] implementations. The
only claim that could be made is that a particular implementation is
conformant to a particular version of the [test
material name]. There are two cases of results of running the [test material type]:
[For OpsGL checkpoints CP5.3, CP6.2]
The Contributor hereby makes certain materials, as described below (the "Materials";), available for use in supporting the World Wide Web Consortium (W3C). The Contributor hereby grants to MIT, ERCIM, and Keio (the "W3C Hosts";) a perpetual, nonexclusive, royalty-free, world-wide right and license to use, copy, modify, create derivatives of and distribute the Materials, in whole or in part, solely in connection with the W3C, and to allow others to do the same. W3C Hosts will publish and distribute the Materials, or any modifications or derivatives thereof, pursuant to the W3C Software License (20021231), and/or the W3C Document License (20021231) as modified from time to time.
The Contributor represents that she/he has all rights necessary to contribute the Materials, and that use of the Materials as contemplated herein by W3C Hosts does not violate any copyright, patent, trademark, or contractual obligations.
The Contributor agrees that any derivatives of the Materials created in connection with the W3C shall be owned by the W3C Hosts. Any publication or distribution of the Materials or any derivative thereof, will retain attribution of authorship to the Contributor. Whenever modifications are made to the Materials, this fact, and the nature of the modifications, will be clearly identified in the distributed version thereof. The W3C Hosts make no commitment to support or distribute the Materials.
The [test material name] produced by the [WG name] Working Group will be distributed under the W3C [License type - choice of: Document | Software].
The [test material name] will be published on the W3C [WG name] website, available from: [http://www.w3.org/[WGname]/Test/].
The [test material name] will be published after thorough review by the WG and the community, and with the consensus of the WG.
The [test material name] will contain the conformance disclaimer as stated above.
[For OpsGL checkpoint CP6.5]
The [WG name] WG encourages the publication of test results. To facilitate publication of results, the WG will make available on its webspace, a place to publish test results. Only test results that have been supplied or approved by the developer of the tested implementation will be considered for publication.
The WG will also consider a 'members only' webspace to publish developer submitted test results. This restricted publication of results may be used for situations in which the specification and/or tests are being debugged. For example, when the specification is in CR and a set of tests are being used to assess the features of the specification by determining what is being implemented.
[For OpsGL checkpoints CP8.2, CP8.3]
The WG is committed to maintaining the quality and relevance of the [test material name]. This will be done by ensuring that the test materials are consistent with any erratum and are updated as needed to reflect the current versions and status of the specification. The procedures describe above will be used to accept new contributions as well as to handle tests that are in dispute.