14:42:03 RRSAgent has joined #eval 14:42:03 logging to http://www.w3.org/2011/11/03-eval-irc 14:42:05 RRSAgent, make logs world 14:42:05 Zakim has joined #eval 14:42:07 Zakim, this will be 3825 14:42:07 ok, trackbot; I see WAI_ERTWG(Eval TF)11:00AM scheduled to start in 18 minutes 14:42:08 Meeting: WCAG 2.0 Evaluation Methodology Task Force Teleconference 14:42:08 Date: 03 November 2011 14:42:38 chair: Eric 14:43:57 agenda: http://lists.w3.org/Archives/Public/public-wai-evaltf/2011Nov/0001.html 14:44:34 agenda+ Welcome 14:44:34 agenda+ Short title of the Methodology 14:44:34 agenda+ Table of Contents 14:44:34 agenda+ Any other business 14:44:47 Liz has joined #eval 14:47:13 vivienne has joined #eval 14:49:36 WAI_ERTWG(Eval TF)11:00AM has now started 14:49:43 +Liz 14:51:39 houtepen has joined #eval 14:52:36 +??P34 14:52:39 zakim, ?P34 is me 14:52:39 sorry, ssirois, I do not recognize a party named '?P34' 14:52:47 zakim, ??P34 is me 14:52:47 +ssirois; got it 14:53:11 +[IPcaller] 14:53:17 zakim, mute me 14:53:17 ssirois should now be muted 14:53:47 zakim, [IPcaller] is me 14:53:47 +vivienne; got it 14:54:14 zakim, mute me 14:54:14 vivienne should now be muted 14:54:25 + +49.404.318.aaaa 14:54:59 Zakim, Detlev is aaaa 14:55:02 sorry, Detlev, I do not recognize a party named 'Detlev' 14:55:04 Zakim, unmute me 14:55:04 ssirois should no longer be muted 14:56:06 zakim, Detlev is aaaa 14:56:06 sorry, Detlev, I do not recognize a party named 'Detlev' 14:56:11 Kathy has joined #eval 14:56:36 +Kathy 14:56:40 zakim, aaaa is Detlev 14:56:40 +Detlev; got it 14:57:10 zakim, mute me 14:57:10 ssirois should now be muted 14:57:18 zakim, mute me 14:57:18 Kathy should now be muted 14:57:20 zakim, mute me 14:57:20 Detlev should now be muted 14:58:10 AmyChen has joined #eval 14:58:53 + +31.30.239.aabb 14:59:06 zakim, aabb is houtepen 14:59:07 +houtepen; got it 14:59:17 zakim, mute me 14:59:17 houtepen should now be muted 14:59:33 EricVelleman has joined #eval 14:59:37 +AmyChen 14:59:40 +??P0 14:59:49 +EricVelleman 14:59:50 zakim, ??p0 is me 14:59:50 +shadi; got it 14:59:59 zakim, who is on the phone? 14:59:59 On the phone I see Liz, ssirois (muted), vivienne (muted), Detlev (muted), Kathy (muted), houtepen (muted), AmyChen, shadi, EricVelleman 15:00:00 Vincent has joined #eval 15:00:11 zakim, who is making noise? 15:00:14 zakim, mute me 15:00:14 AmyChen should now be muted 15:00:21 shadi, listening for 10 seconds I heard sound from the following: shadi (34%), AmyChen (30%), EricVelleman (65%) 15:00:40 zakim, mute me 15:00:40 shadi should now be muted 15:00:42 +Vincent 15:01:23 :-) 15:01:56 zakim, who's here? 15:01:56 On the phone I see Liz, ssirois (muted), vivienne (muted), Detlev (muted), Kathy (muted), houtepen (muted), AmyChen (muted), shadi (muted), EricVelleman, Vincent 15:01:59 On IRC I see Vincent, EricVelleman, AmyChen, Kathy, houtepen, vivienne, Liz, Zakim, RRSAgent, shadi, Detlev, ssirois, trackbot 15:02:25 zakim, unmute me 15:02:25 ssirois should no longer be muted 15:02:48 Mike_Elledge has joined #eval 15:03:01 zakim, who is making noise? 15:03:12 shadi, listening for 10 seconds I heard sound from the following: EricVelleman (77%), Vincent (13%) 15:03:19 zakim, mute me 15:03:19 ssirois should now be muted 15:03:25 zakim, who is making noise? 15:03:32 agarrison has joined #eval 15:03:35 +Mike 15:03:37 Vincent, listening for 10 seconds I heard sound from the following: EricVelleman (58%) 15:03:58 half your luck! 15:04:42 +??P44 15:04:46 Zakim, ??P44 is me 15:04:46 +agarrison; got it 15:04:55 Vivienne has it as 11pm , not am 15:05:11 regrets: Sarah, Kerstin, Leonie 15:05:34 In Sweden 15:05:43 Cannot understand Alistair at all - call again? 15:05:57 http://www.w3.org/WAI/ER/2011/eval/minutes.html 15:06:21 candidate order: Mike, Liz, Vincent 15:06:40 Yippee! 15:06:45 scribe: Mike 15:06:50 scribenick: Mike_Elledge 15:06:58 Please everyone identify yourselves before each comment... 15:07:02 zakim, take up agendum 1 15:07:02 agendum 1. "Welcome" taken up [from shadi] 15:07:02 Zakim, mute me 15:07:03 Vincent should now be muted 15:07:26 http://www.w3.org/WAI/ER/conformance/ED-methodology-20111102.html 15:07:41 EV: Shadi put on revised doc on line for me. Still needs filling out. 15:08:41 Different sections. Some discussion so far. Divide the sections, start with #1. Send in proposed text. Choose one section to start with, not most difficult, then have discussion. 15:09:06 how about starting with #6? 15:09:06 q+ 15:09:35 q- 15:09:44 EV: Looked at sections, not really one without discussion. Before continuing w/ TOC, let's start w/ Methodology. 15:09:58 zakim, take up next 15:09:58 agendum 2. "Short title of the Methodology" taken up [from shadi] 15:10:10 EV: Agreed on WCAG EM. Hold discussion, go back later. Any disagreement? 15:10:10 no, I'm fine 15:10:12 q? 15:10:16 I am fine with that 15:10:21 +! 15:10:22 OK 15:10:23 +1 15:10:26 +1 15:10:30 fine with using WCAG EM for now. 15:10:30 +1 15:10:32 +1 15:10:33 ok 15:10:34 +1 15:11:25 EV: Lots of +1! Use WCAG EM as temporary short time. Bring back to agenda later. Better name. Maybe we'll like and keep. 15:11:25 q+ 15:11:25 zakim, take up next 15:11:26 I see a speaker queue remaining and respectfully decline to close this agendum, shadi 15:11:30 Zakim, unmute me 15:11:30 Detlev should no longer be muted 15:11:33 EV: Table of Contents. 15:11:36 ack de 15:11:38 zakim, take up next 15:11:38 agendum 3. "Table of Contents" taken up [from shadi] 15:12:18 http://lists.w3.org/Archives/Public/public-wai-evaltf/2011Nov/0014.html 15:13:14 D: Made contribution proposing reorganizing in line w/ suggestion last week. From practical pov, general context, then general procedure. Useful for guiding document. Some sections should be reorganized: Procedure shld go thru SC or guidelines, then recogntion for checkpoints. Now more a description of technique and not sequential when stepping through checkpoints. 15:13:28 D: Propose a different order. 15:14:14 EV: More or less in document. Not yet step by step. Changing order would have to reflect how walk thru evaluation. You covered it in your proposal. 15:14:19 EV: Discussion? 15:14:36 D: Don't know if people find approach useful. 15:14:59 EV: TOC looks theoretical. D approach practical. 15:15:05 Detlev proposal for table of content can be found here: http://lists.w3.org/Archives/Public/public-wai-evaltf/2011Nov/0014.html 15:15:10 q+ 15:15:16 EV: Can add to TOC or other section. Everyone looked over? 15:15:16 ack me 15:15:37 Zakim, mute me 15:15:37 Detlev should now be muted 15:16:17 V: Looked over, really like it. If someone looking into audit, could understand what's req in part A. If someone already knows could go to Part B. w/out hveing to go through whole section. 15:16:19 Tim has joined #eval 15:16:30 zakim, mute me 15:16:30 vivienne should now be muted 15:16:38 V: Not get bogged down in theoretical details. 15:16:43 M: Makes sense to me. 15:16:44 q+ 15:16:45 q? 15:16:51 ack me 15:17:02 -agarrison 15:17:13 Shadi, sound is OK 15:17:31 +[IPcaller] 15:17:42 S: Not sure can hear. Unsure about B4: level of detail and overlap w/ existing techniques. Can figure out details later. 15:17:50 q+ 15:17:54 is section 4 - i.e. b4.1 etc. just an example? 15:17:58 q+ 15:18:02 +Tim_Boland 15:18:07 q+ 15:18:31 q? 15:18:35 EV: Agree w/ Shadi. Proposal for template, what it would look like. DK if want to go to that degree. Wld be lots of discussion. 15:18:35 ack me 15:18:36 shadi has joined #eval 15:18:49 agarrison has joined #eval 15:19:11 ack me 15:19:11 K: Level of detail have to be careful not duplicate WCAG. Use ful to have links to WCAG, though. 15:19:13 q? 15:19:28 zakim mute me 15:19:39 zakim, mute me 15:19:39 Kathy should now be muted 15:19:41 zakim, who is muted? 15:19:41 I see vivienne, Detlev, Kathy, houtepen, AmyChen, Vincent muted 15:19:43 q+ 15:19:53 q? 15:19:55 zakim, mute me 15:19:55 shadi should now be muted 15:19:57 Sam: B6. DK how people will go into best practices, may see as part c. Could be middle of part c reporting. 15:20:12 zakim, ipcaller is agarrison 15:20:12 +agarrison; got it 15:20:24 EV: Have appendices for templates. Reports are out of document. Part c a good idea. 15:20:25 q? 15:20:26 zakim, mute me 15:20:26 ssirois should now be muted 15:20:28 ack me 15:21:02 q+ 15:21:09 AC: Wondering if combine Detlev doc and EV outline. Splitting context and x so using same terms. 15:21:31 Zakim, unmute me 15:21:31 Detlev should no longer be muted 15:21:50 EV: Split of TOC and parts of method B, some things in TOC that should be in B. How can we make easier and create more overview. Practical overview missing. 15:21:53 q? 15:22:09 AC: or split TOC in two parts, see what is missing, see how they fit together. 15:22:19 EV: will discuss with Detlev. 15:22:22 zakim, mute me 15:22:22 AmyChen should now be muted 15:23:32 q? 15:23:33 q+ to say out of scope 15:24:14 D: Just a draft, did not check to see if everythign there. Will need to see if runs down 12 checkpoints. Hve to include different SC depending on level. Why didn't go there. Techniques should not be replciated in methodology? However SC can be met by Check if headings are met, real value that you can bring techniques into somoe sort or order so don't get lost. 15:24:44 +1 to Eric 15:24:45 EV: Should stick to describing when to use. Not like telling them per SC or guideline. 15:25:01 q? 15:25:01 ack me 15:25:09 D: What's point of methodology then? Not telling peoole how to do it. 15:25:17 q- det 15:25:26 zakim, mute detlev 15:25:26 Detlev should now be muted 15:26:44 q+ 15:27:11 +1 to Vivienne 15:27:16 VC: I kind of like what Amy was saying...taking original 1 and splitting it up. Like Detlev testing as B, C as perfoarmnce claims and reporting. Easy to use. Understand what D is saying, but we'd be repeating things in WCAG. Don't have problem putting links to SC and guideliens. Currenting difficlt to do in WCAG. Appendix that links things to make it easier. Methodology not a poinint by point, more how you do it., 15:27:20 q? 15:27:31 zakim, mute me 15:27:31 vivienne should now be muted 15:27:48 q+ 15:27:54 q? 15:27:59 ack me 15:28:00 shadi, you wanted to say out of scope 15:28:04 EV: Makes sense. Documents are there. We're guiding people in methodology. Not reusing WCAG a second time. Danger if go into too much tech detail. 15:28:10 www.w3.org/WAI/WCAG20/quickref/ 15:29:12 Sh: How to use WCAG 2 guidance, how to follow it precisely, quick reference guide more geared to that. Is being updated. Should not be in that level of detai in this document. Amount of detial should look into, cross links may make sense... 15:29:26 q+ 15:29:40 zakim, mute me 15:29:40 shadi should now be muted 15:29:43 Sh: Overall approach...methodology. Not about step by step testing but overall assessment procedure. 15:30:29 People, including me, still have an unclear view of what the methodology will be and do. I suggest we get some content together first, and then re-evaluate the structure at a later date to make sure it reflects what the methodology has become. 15:30:33 +1 to Alistair -- start drafting sections then we will need to reorganize anyway 15:30:34 Al: People still have questions about what method will do. Get some context into document. Evalaute structure at later date. DK what methodology will actually do. 15:30:50 zakim, unmute me 15:30:50 Detlev should no longer be muted 15:30:55 EV: When we write sections will see some will be covered in different places. 15:31:13 q+ 15:31:21 ack de 15:31:26 Det: Different perceition than I. How will it be used? If won't be useful for evaluator, who will use it? 15:31:29 ack ag 15:31:31 q? 15:31:33 q+ 15:31:33 q- 15:31:45 zakim, mute me 15:31:45 Detlev should now be muted 15:32:38 i agree with shadi about the methodology as an overall approach. i believe that clarification about the "understanding" wcag is responded by Education & Outreach. the methodology is the how to evaluate. not how to meet accessibility. in my humble opinion. 15:32:40 EV: Methodology for anyone doing evaluation,. Difference betw writing details and using document in proper way. Help people to set the scope of their eval. You're proposigin we go into more detail. We should try to stay at higher level. 15:33:08 q? 15:33:11 EV: WCAG is there. We point to it. If unclear, go to WCAG working group. Should be so clear we only need to poitn to working group. 15:33:13 ack me 15:33:32 q+ 15:33:47 http://accessibility.gtri.gatech.edu/aem/AEM1.html 15:34:06 AC: Thinkig that shouldn't repeat anything. Maybe when there is unclear point give an example? Someone sent link to GA Tech methodology. That one is good stayed at higher level. Thinking approach of how to test product. 15:34:14 q- 15:34:22 AC: Would point to WCAG for techniques if unclear. 15:34:23 q+ 15:34:24 q? 15:34:27 ack me 15:34:29 zakim, mute me 15:34:29 AmyChen should now be muted 15:36:04 Sh: Yeah think most has been said. Value add of method: 1, How to evaluate pages doesn't exist currently. 2. Applying WCAG 2 on selected pages. 3. Scoring, aggregating of results. Probably most difficult part. These three parts would be major contribution. 15:36:13 EV: Are they in current TOC? 15:36:25 Shadi: Would you mind repeating or typing the 3 points you are making? we can't hear you well. 15:36:40 I agree with Shadi, as an evaluator they are areas that I struggle with - scoring and aggregating, etc 15:36:59 http://www.w3.org/WAI/ER/2011/eval/eval-ws 15:37:01 Sh: The scorring is not. Agree with what saying before. Start drafting and then things will pan out. Will reorganize any way. 15:37:05 q- 15:37:38 Sh: ? 15:38:11 zakim, mute me 15:38:11 shadi should now be muted 15:38:12 q+ 15:38:50 [[Selecting representative samples of web pages from entire websites; this includes defining approaches for dynamically generated websites and web applications, large-scale surveys, and other contexts. 15:38:50 Carrying out evaluation of individual web pages using WCAG 2.0 Techniques; this includes defining approaches for selection appropriate WCAG 2.0 Techniques and assessing Accessibility-Support assumptions. 15:38:50 Aggregating individual results into an overall conformance statement; this includes defining approaches for assessing the relative impact on failures, potentially through incorporating tolerance metrics.]] 15:38:55 q? 15:38:57 Zakim, unmute me 15:38:57 Detlev should no longer be muted 15:38:58 EV: Three pieces. Split into A and B. Start drafting and see where we arrive. Expect TOC will change. Important parts: selection, applying and aggregating and scoring will be there. Perhaps not as clear in WCAG 2.0 but should be. 15:40:01 Det: Add that no longer nec to have split betw A and B. Would help guide people through SC. So that kind of logic is still missing. No idea relation between SC. But won't need split if don't provide that context. 15:40:08 Zakim, mute me 15:40:08 Detlev should now be muted 15:40:37 q+ 15:40:40 q+ 15:40:45 Zakim, unmute me 15:40:45 Detlev should no longer be muted 15:40:49 q? 15:40:54 ack me 15:40:56 EV: Doesn't mean there isn't need for clarification. If not clear when drafting, we'll clarify. Could mean need more text of how to use it, without going into guidelines, perhaps pointing or linking. Will come up in drafting. 15:41:01 q- 15:42:14 Vc: Few areas in WCAG where hard to know which criteria accoutn for which things. Labels for example. Overlap. We can address to make it clearer how to decide which area you score something in. A value add. One item can violate a whole bunch of critera. But have to decide which level it violates. 15:42:27 Zakim, mute me 15:42:27 ssirois was already muted, ssirois 15:42:31 zakim, mute me 15:42:31 vivienne should now be muted 15:42:35 VC: People struggle which is violating. 15:42:52 q+ 15:43:08 Zakim, unmute me 15:43:08 Detlev was not muted, Detlev 15:43:14 EV: Perhaps coming more detail. Will have to linclude techniques if necessary in methodlology. 15:43:58 -Detlev 15:44:01 Det: If we dive in will need to be at guidelines and aspects VC just mentioned. Hve to be at level of SC, otherwise too general. Give at sC or don't. Dipping toe into water won't help. 15:44:01 q+ 15:44:11 q- det 15:44:20 ack ag 15:44:36 +1 to Alistair -- need to get started drafting 15:44:38 Al: Need to get on and push for first draft. Test it out. Will move on to second draft. Just get it down there. 15:44:44 +Detlev 15:44:49 EV: Sounds so easy! But I agree. 15:45:12 q+ 15:45:34 ack me 15:45:36 EV: Just start drafting. Send me text for different sections, place and discuss. In mailing list, name and title. Put proposed text there. Or choose a certain section and start on that. 15:46:08 Sh: Everyone is ready to contribute, become co-editor, though we need to have a lead editor. 15:47:05 Sh: Eric you are the lead editor, and do heavy lifting. But if you have a certain section want to do, commit to it, no guarantee is what will be final. 15:47:36 zakim, mute me 15:47:36 shadi should now be muted 15:47:38 +1 to Eric! 15:47:57 +1 to Eric too! 15:48:00 q+ 15:48:05 Go Eric Go!!! 15:48:17 EV: Make a lot of text that is for sections not in document. You'll see lots coming. Difficult thing to do methodology. Section of website sounds so easy. Easy to miss things. Will need input. 15:48:26 q? 15:48:29 EV: Will add things. Feel free to shoot at them. 15:48:29 ack me 15:48:57 AC: Question. Going through these in order, or just put comment in mailing list. Or focus on a few sections. 15:49:13 EV: Will send around link to section and we can all comment on it. 15:49:15 q? 15:49:27 zakim, mute me 15:49:27 AmyChen should now be muted 15:49:32 EV: Let's keep it for this moment. Go to point 4. 15:49:33 zakim, take up next 15:49:33 agendum 4. "Any other business" taken up [from shadi] 15:50:06 EV: Got many scenaros and methodologies, but need more. Any scenarios keep sending them to Shadi. 15:50:11 q+ 15:50:14 Zakim, unmute me 15:50:14 Detlev was not muted, Detlev 15:50:15 EV: Any other business? 15:51:12 q+ 15:51:15 Det: Want to raise questin Aaron Leventhal raised. Advanced dynamic web apps operating only on modern web browsers, some might not apply. For to different technology scenarios. Can ti be implemented? 15:51:19 ack de 15:51:36 ack me 15:51:37 EV: We could make it a discussion item for after this meeting. It is interesting and not yet covered. 15:51:41 q? 15:52:19 zakim, mute me 15:52:19 Detlev should now be muted 15:52:48 Sh: So I think...had a series of discussions with Aaron...our approach for ARIA...but ARIA is a draft...part relates to ally support, all pieces that are needed for complete evaluation, but be carefl about scope creep. 15:52:55 http://www.w3.org/WAI/ER/2011/eval/ 15:53:36 zakim, mute me 15:53:36 shadi should now be muted 15:53:41 yes 15:53:47 Sh: Refer you to...different activities on evaluation and testing that are taking...need all peices together to hav complete support. Are working on it, but can't do everything at once. Ours is just part of this. 15:53:56 EV: Answer question, Detlev? 15:54:06 Det: Yes. 15:54:09 thanks Eric. Looking forward to adding text into the document. 15:54:17 EV: Will have to start adding, will send link when do so. 15:54:18 -Detlev 15:54:18 bye 15:54:19 -Tim_Boland 15:54:19 -Kathy 15:54:21 -agarrison 15:54:22 bye 15:54:22 bye 15:54:25 -EricVelleman 15:54:25 thanks, bye! 15:54:26 vivienne has left #eval 15:54:30 houtepen has left #eval 15:54:30 Bye 15:54:31 thank you all! bye 15:54:35 -AmyChen 15:54:36 -Mike 15:54:36 -shadi 15:54:36 -Vincent 15:54:39 -Liz 15:54:43 -houtepen 15:54:45 -vivienne 15:55:39 zakim, who is on the phone? 15:55:39 On the phone I see ssirois 15:55:46 zakim, drop ss 15:55:46 ssirois is being disconnected 15:55:48 WAI_ERTWG(Eval TF)11:00AM has ended 15:55:51 Attendees were Liz, ssirois, vivienne, +49.404.318.aaaa, Kathy, Detlev, +31.30.239.aabb, houtepen, AmyChen, EricVelleman, shadi, Vincent, Mike, agarrison, Tim_Boland 15:55:53 trackbot, end meeting 15:55:53 Zakim, list attendees 15:55:53 sorry, trackbot, I don't know what conference this is 15:55:54 RRSAgent, please draft minutes 15:55:54 I have made the request to generate http://www.w3.org/2011/11/03-eval-minutes.html trackbot 15:55:55 RRSAgent, bye 15:55:55 I see no action items