W3C

Results of Questionnaire Add "Evaluating Procedures" Protocol as exploratory content

The results of this questionnaire are available to anybody.

This questionnaire was open from 2022-07-29 to 2022-08-01.

7 answers have been received.

Jump to results for question:

  1. Comments and Concerns to include into a draft editor's note
  2. Add "Evaluating Procedures" Proposal into testing section (replacing procedures) as Exploratory

1. Comments and Concerns to include into a draft editor's note

Please review the editor's note at the top of section 5 and then include any additional comments, questions or concerns you wish to include in an editor's note for this exploratory content.

Details

Responder Comments and Concerns to include into a draft editor's note
Jennifer Strickland This work should remain exploratory until WCAG3 evolves testing and conformance. Please explain any possible reasoning for why this would be included in testing. In the Editor's Note I don't see anything that explains this. Rather I see a list of questions and some clarifications of terminology.
Gundula Niemann It should say "An outcome" (first words)

Jaunita George
Mary Jo Mueller IMO, the list of questions is very extensive and the editor's note doesn't indicate if these are questions that you are seeking input on or simply questions that the group intends to answer in future draft content.

If response to the questions is being sought, some of the questions are too broad or can be interpreted in different ways so readers may not really know what is being asked and how to respond. As one example: The current question, "Is it possible to localize it into different languages?" Does this mean, "Can/should a protocol be localized (translated) into different languages?" or "Is there a need to have protocols that are specific to a locale or type of language (e.g. right to left, left to right, to support Kanji or other symbol-based writing)?" Do you want the responder to give some examples? If so, ask for them.
Jeanne F Spellman We would want an example between small and large >5FTE and <25 FTE -- but that is assumed and not relevant to the examples. We should consider the evaluations in total as well as individual, because I think that the examples are too heavy weight if an organization were doing multiple outcomes all requiring similar examples.
Bruce Bailey
Rachael Bradley Montgomery

2. Add "Evaluating Procedures" Proposal into testing section (replacing procedures) as Exploratory

Do you support adding the "Evaluating Procedures" proposal into the testing section (replacing procedures) as Exploratory?

Summary

ChoiceAll responders
Results
yes 5
no 2

Details

Responder Add "Evaluating Procedures" Proposal into testing section (replacing procedures) as ExploratoryComments
Jennifer Strickland no I don't understand how the "Evaluating Procedures" proposal fits into testing.

First, what is Testing in WCAG3? Do we have that yet? Why would we add anything to it? I'm not putting my money into an account that will some day be created.

Second, Protocols are not to be used to assert conformance with any standard. Rather, protocols serve to show the effort made to evaluate *subjective* WCAG guidelines that cannot be measured objectively. Using an established protocol as a guide to evaluate subjective outcomes is a way that folks developing digital services can meet the spirit of WCAG subjective outcomes.

In an ideal world, WCAG would provide what protocols do — the reality is WCAG lacks the volunteers and effective processes to output the guidance for all the subjective outcomes. WCAG is busting at the seams in desperate need of more volunteers, functional processes that those volunteers can effectively output guidelines, and accessible, equitable, and inclusive methods to participate in WCAG.
Gundula Niemann no
To me it is not clear whether an " outcome evaluation procedure" describes how a company plans to go or how it went.
On one hand it says "Outcome implementation procedures describe inputs to the process such as documentation of steps, actions taken, date completed, ..." which suggests the way was already gone.

On the other hand example 1 it says "This procedure aims to ensure that ...". which suggests the way is planned to go.

In order to clearly suggest the meaning I suggest to also change the name, for example to "method" (if this is meant) or journal / logbook (if this is meant).
Jaunita George yes
Mary Jo Mueller yes It's fine adding it, though there are some terms and abbreviations used that have no definition that could hinder understanding of the content. e.g. "FTE assignments" where "FTE" is never spelled out. Use of "assertion" vs. "declaration" vs. "statement" in the questions vs. the use of "outcome implementation procedures" in the draft content. This makes it difficult to determine if you're talking about something else or the same thing by different terms.
Jeanne F Spellman yes This is a great start that will allow us to include guidance into WCAG3 that could not be included in the WCAG 2.x structure.
Bruce Bailey yes
Rachael Bradley Montgomery yes

More details on responses

  • Jennifer Strickland: last responded on 29, July 2022 at 14:33 (UTC)
  • Gundula Niemann: last responded on 1, August 2022 at 12:32 (UTC)
  • Jaunita George: last responded on 1, August 2022 at 13:29 (UTC)
  • Mary Jo Mueller: last responded on 1, August 2022 at 22:00 (UTC)
  • Jeanne F Spellman: last responded on 1, August 2022 at 23:40 (UTC)
  • Bruce Bailey: last responded on 2, August 2022 at 14:12 (UTC)
  • Rachael Bradley Montgomery: last responded on 2, August 2022 at 14:33 (UTC)

Non-responders

The following persons have not answered the questionnaire:

  1. Gregg Vanderheiden
  2. Chris Wilson
  3. Lisa Seeman-Horwitz
  4. Janina Sajka
  5. Shawn Lawton Henry
  6. Katie Haritos-Shea
  7. Shadi Abou-Zahra
  8. Chus Garcia
  9. Steve Faulkner
  10. Patrick Lauke
  11. David MacDonald
  12. Gez Lemon
  13. Makoto Ueki
  14. Peter Korn
  15. Preety Kumar
  16. Georgios Grigoriadis
  17. Stefan Schnabel
  18. Romain Deltour
  19. Laura Carlson
  20. Chris Blouch
  21. Jedi Lin
  22. Wilco Fiers
  23. Kimberly Patch
  24. Glenda Sims
  25. Ian Pouncey
  26. Alastair Campbell
  27. Léonie Watson
  28. David Sloan
  29. John Kirkwood
  30. Detlev Fischer
  31. Reinaldo Ferraz
  32. Matt Garrish
  33. Mike Gifford
  34. Loïc Martínez Normand
  35. Mike Pluke
  36. Justine Pascalides
  37. Chris Loiselle
  38. Tzviya Siegman
  39. Jan McSorley
  40. Sailesh Panchang
  41. Cristina Mussinelli
  42. Jonathan Avila
  43. John Rochford
  44. Sarah Horton
  45. Sujasree Kurapati
  46. Jatin Vaishnav
  47. Sam Ogami
  48. Kevin White
  49. E.A. Draffan
  50. Paul Bohman
  51. JaEun Jemma Ku
  52. 骅 杨
  53. Victoria Clark
  54. Avneesh Singh
  55. Mitchell Evan
  56. Michael Gower
  57. biao liu
  58. Scott McCormack
  59. Francis Storr
  60. Rick Johnson
  61. David Swallow
  62. Aparna Pasi
  63. Gregorio Pellegrino
  64. Melanie Philipp
  65. Jake Abma
  66. Nicole Windmann
  67. Oliver Keim
  68. Ruoxi Ran
  69. Wendy Reid
  70. Scott O'Hara
  71. Charles Adams
  72. Muhammad Saleem
  73. Amani Ali
  74. Trevor Bostic
  75. Jamie Herrera
  76. Shinya Takami
  77. Karen Herr
  78. Kathy Eng
  79. Cybele Sack
  80. Audrey Maniez
  81. Jennifer Delisi
  82. Arthur Soroken
  83. Daniel Bjorge
  84. Kai Recke
  85. David Fazio
  86. Daniel Montalvo
  87. Mario Chacón-Rivas
  88. Michael Gilbert
  89. Caryn Pagel
  90. Achraf Othman
  91. Helen Burge
  92. Fernanda Bonnin
  93. Jared Batterman
  94. Raja Kushalnagar
  95. Jan Williams
  96. Todd Libby
  97. Isabel Holdsworth
  98. Julia Chen
  99. Marcos Franco Murillo
  100. Yutaka Suzuki
  101. Azlan Cuttilan
  102. Joe Humbert
  103. Ben Tillyer
  104. Charu Pandhi
  105. Poornima Badhan Subramanian
  106. Alain Vagner
  107. Roberto Scano
  108. Rain Breaw Michaels
  109. Kun Zhang
  110. Regina Sanchez
  111. Shawn Thompson
  112. Thomas Brunet
  113. Kenny Dunsin
  114. Jen Goulden
  115. Mike Beganyi
  116. Ronny Hendriks
  117. Olivia Hogan-Stark
  118. Rashmi Katakwar
  119. Julie Rawe
  120. Duff Johnson
  121. Laura Miller
  122. Will Creedle
  123. Shikha Nikhil Dwivedi
  124. Marie Csanady
  125. Meenakshi Das
  126. Perrin Anto
  127. Rachele DiTullio
  128. Jan Jaap de Groot
  129. Rebecca Monteleone
  130. Ian Kersey
  131. Peter Bossley
  132. Anastasia Lanz
  133. Michael Keane
  134. Chiara De Martin
  135. Giacomo Petri
  136. Andrew Barakat
  137. Devanshu Chandra
  138. Xiao (Helen) Zhou
  139. Joe Lamyman
  140. Bryan Trogdon
  141. Mary Ann (MJ) Jawili
  142. 禹佳 陶
  143. 锦澄 王
  144. Stephen James
  145. Jay Mullen
  146. Thorsten Katzmann
  147. Tony Holland
  148. Kent Boucher
  149. Abbey Davis
  150. Phil Day
  151. Julia Kim
  152. Michelle Lana
  153. David Williams
  154. Mikayla Thompson
  155. Catherine Droege
  156. James Edwards
  157. Eric Hind
  158. Quintin Balsdon
  159. Mario Batušić
  160. David Cox
  161. Sazzad Mahamud
  162. Katy Brickley
  163. Kimberly Sarabia
  164. Corey Hinshaw
  165. Ashley Firth
  166. Daniel Harper-Wain
  167. Kiara Stewart
  168. DJ Chase
  169. Suji Sreerama
  170. Lori Oakley
  171. David Middleton
  172. Alyssa Priddy
  173. Young Choi
  174. Nichole Bui
  175. Julie Romanowski
  176. Eloisa Guerrero
  177. Daniel Henderson-Ede
  178. George Kuan
  179. YAPING LIN
  180. Justin Wilson
  181. Leonard Beasley
  182. Tiffany Burtin
  183. Shane Dittmar
  184. Nayan Padrai
  185. Niamh Kelly
  186. Matt Argomaniz Matthew Argomaniz
  187. Frankie Wolf
  188. Kimberly McGee
  189. Ahson Rana
  190. Carolina Crespo
  191. humor927 humor927
  192. Samantha McDaniel
  193. Matthäus Rojek
  194. Phong Tony Le
  195. Bram Janssens
  196. Graham Ritchie
  197. Aleksandar Cindrikj
  198. Jeroen Hulscher
  199. Alina Vayntrub
  200. Marco Sabidussi
  201. John Toles
  202. Jeanne Erickson Cooley
  203. Theo Hale
  204. Gert-Jan Vercauteren
  205. Karla Rubiano
  206. Aashutosh K
  207. Hidde de Vries
  208. Julian Kittelson-Aldred
  209. Roland Buss
  210. Aditya Surendranath
  211. Avon Kuo
  212. Elizabeth Patrick
  213. Tj Squires
  214. Nat Tarnoff
  215. Illai Zeevi
  216. Filippo Zorzi
  217. Gleidson Ramos
  218. Mike Pedersen
  219. Rachael Yomtoob
  220. Oliver Habersetzer
  221. Irfan Mukhtar

Send an email to all the non-responders.


Compact view of the results / list of email addresses of the responders

WBS home / Questionnaires / WG questionnaires / Answer this questionnaire