WCAG 2.0 Evaluation Methodology Task Force (Eval TF) Work Statement
Page Contents
Status
This Work Statement for the WCAG 2.0 Evaluation Methodology Task Force (Eval TF) has been approved by Web Content Accessibility Guidelines Working Group (WCAG WG) and Evaluation and Repair Tools Working Group (ERT WG). Eval TF is active since August 2011.
Objective
The objective of Eval TF is to develop an internationally harmonized methodology for evaluating the conformance of websites to WCAG 2.0, that supports different contexts, such as for self-assessment or third-party evaluation of small or larger websites. This work includes developing approaches for:
- Selecting representative samples of web pages from entire websites; this includes defining approaches for dynamically generated websites and web applications, large-scale surveys, and other contexts.
- Carrying out evaluation of individual web pages using WCAG 2.0 Techniques; this includes defining approaches for selection appropriate WCAG 2.0 Techniques and assessing Accessibility-Support assumptions.
- Aggregating individual results into an overall conformance statement; this includes defining approaches for assessing the relative impact on failures, potentially through incorporating tolerance metrics.
This work is part of other related W3C/WAI activities around evaluation and testing.
Approach
The evaluation methodology will likely be broken down into modular components, for instance to match the three sub-parts described in the objective section. The individual components of the evaluation methodology will be developed as a W3C Recommendation, W3C Working Group Note, or other W3C/WAI resource. This will be decided after the development of an initial, more detailed set of requirements.
The development of the evaluation methodology will employ the following approach:
- Gather current best practices, such as studies, surveys, or existing methodologies;
- Develop requirements for the individual components of the evaluation methodology;
- Develop an initial release of the evaluation methodology to be tested in practice;
- Refine the evaluation methodology according to experiences from various stakeholders.
The work will be carried out iteratively with continual involvement of the public throughout the development. In particular, key stakeholders such as developers, evaluators, experts, researchers, and users will be regularly involved in the development process.
Timeline
The following presents a rough timeline of the work:
- June 2011 - approval and launch of this Eval Task Force
- September 2011 - requirements for the evaluation methodology
- December 2011 - first draft of the evaluation methodology
- March, June, September 2012 - refined drafts for public review
- December 2012 - first release of the evaluation methodology
- June 2013 - updated draft with refinements for public review
- December 2013 - finalized evaluation methodology for WCAG 2.0
Dependencies
Eval TF has the following dependencies:
- WCAG WG - to ensure accurate interpretation and representation of WCAG requirements
- ERT WG - to facilitate coordination with other W3C and WAI testing efforts
Eval TF will also coordinate with EOWG where necessary to improve the writing, presentation, and educational value of the methodology.
Communication
Eval TF communications are publicly visible. Communication mechanisms for Eval TF include:
- Eval TF mailing list and mailing list archive (to be created);
- Weekly teleconferences, minutes from the teleconferences are also sent to ERT WG and WCAG WG mailing lists;
- Regular updates and feedback to ERT WG and WCAG WG, and potentially WAI Coordination Group (CG) as needed;
- Regular submission of deliverables to ERT WG and WCAG WG for approval;
- Summary of current status and progress on the Eval TF home page (to be created).
Participation
Eval TF participants must be participants of ERT WG or of WCAG WG; and must actively contribute to the work of Eval TF, including:
- Minimum 6 hours per week of Eval TF work;
- Remain current on the Eval TF mailing list and respond in a timely manner to postings;
- Participate in Eval TF telephone meetings, or send regrets to the Eval TF mailing list.
Contact Shadi Abou-Zahra (shadi@w3.org) to become a participant of Eval TF or with questions.
Leadership
- Staff contact: Shadi Abou-Zahra (shadi@w3.org)
- Task Force facilitator: Eric Velleman
Participants
Participants in the WCAG 2.0 Evaluation Methodology Task Force (Eval TF).
Patent Policy
This Task Force is part of the ERT WG Charter and WCAG WG Charter, which operate under the W3C Patent Policy (5 February 2004 Version).