IRC log of ai-powered-accessibility on 2024-09-25

Timestamps are in UTC.

14:48:25 [RRSAgent]
RRSAgent has joined #ai-powered-accessibility
14:48:29 [RRSAgent]
logging to https://www.w3.org/2024/09/25-ai-powered-accessibility-irc
14:48:29 [tpac-breakout-bot]
RRSAgent, do not leave
14:48:30 [tpac-breakout-bot]
RRSAgent, make logs public
14:48:31 [tpac-breakout-bot]
Meeting: Demonstration of AI Powered Accessibility Auditing
14:48:31 [tpac-breakout-bot]
Chair: David Fazio
14:48:31 [tpac-breakout-bot]
Agenda: https://github.com/w3c/tpac2024-breakouts/issues/19
14:48:31 [Zakim]
Zakim has joined #ai-powered-accessibility
14:48:32 [tpac-breakout-bot]
Zakim, clear agenda
14:48:32 [Zakim]
agenda cleared
14:48:32 [tpac-breakout-bot]
Zakim, agenda+ Pick a scribe
14:48:33 [Zakim]
agendum 1 added
14:48:33 [tpac-breakout-bot]
Zakim, agenda+ Reminders: code of conduct, health policies, recorded session policy
14:48:33 [Zakim]
agendum 2 added
14:48:33 [tpac-breakout-bot]
Zakim, agenda+ Goal of this session
14:48:34 [Zakim]
agendum 3 added
14:48:34 [tpac-breakout-bot]
Zakim, agenda+ Discussion
14:48:34 [Zakim]
agendum 4 added
14:48:34 [tpac-breakout-bot]
Zakim, agenda+ Next steps / where discussion continues
14:48:35 [Zakim]
agendum 5 added
14:48:36 [tpac-breakout-bot]
tpac-breakout-bot has left #ai-powered-accessibility
17:31:47 [cyns]
cyns has joined #ai-powered-accessibility
17:43:58 [cyns]
cyns has left #ai-powered-accessibility
17:55:44 [hgarg]
hgarg has joined #ai-powered-accessibility
18:00:26 [Susi_Pallero]
Susi_Pallero has joined #ai-powered-accessibility
18:09:03 [mgarrish]
mgarrish has joined #ai-powered-accessibility
18:10:07 [CharlesL]
CharlesL has joined #ai-powered-accessibility
18:11:57 [NehaJ]
NehaJ has joined #ai-powered-accessibility
18:12:39 [CharlesL]
present+
18:13:21 [asully]
asully has joined #ai-powered-accessibility
18:15:50 [giacomo-petri]
giacomo-petri has joined #ai-powered-accessibility
18:15:53 [hgarg]
present+
18:16:10 [Lionel_Wolberger]
Lionel_Wolberger has joined #ai-powered-accessibility
18:16:19 [Lionel_Wolberger]
zakim, who is here?
18:16:19 [Zakim]
Present: CharlesL, hgarg
18:16:23 [Zakim]
On IRC I see Lionel_Wolberger, giacomo-petri, asully, NehaJ, CharlesL, mgarrish, hgarg, Zakim, RRSAgent
18:16:42 [hgarg]
scribe+
18:16:46 [MJ]
MJ has joined #ai-powered-accessibility
18:17:00 [MJ]
present+
18:17:20 [JackieFei]
JackieFei has joined #ai-powered-accessibility
18:19:25 [zolkis]
zolkis has joined #ai-powered-accessibility
18:19:40 [Daniel]
Daniel has joined #ai-powered-accessibility
18:20:29 [lambda]
lambda has joined #ai-powered-accessibility
18:20:42 [MJ]
MJ has joined #ai-powered-accessibility
18:20:59 [hgo]
hgo has joined #ai-powered-accessibility
18:21:14 [jamesn]
jamesn has joined #ai-powered-accessibility
18:21:25 [hgarg]
Traditionally accessibility audits have been manual. We're attempting use of AI to automate some of it.
18:21:38 [cyns]
cyns has joined #ai-powered-accessibility
18:21:56 [hgarg]
Leveraging AI (LLM's) where they help.
18:22:00 [duga]
duga has joined #ai-powered-accessibility
18:22:07 [duga]
present+
18:22:56 [edward]
edward has joined #ai-powered-accessibility
18:23:29 [Ben_Tillyer_]
Ben_Tillyer_ has joined #ai-powered-accessibility
18:23:34 [Ben_Tillyer_]
present+
18:23:42 [cyns]
present+
18:23:47 [hgarg]
Current set of tools have limited localization in local languages. We have used AI to localize the tool itself and also to analyze/audit pages in different languages.
18:25:04 [cyns]
Can you share a link to the slides? It's hard to see in the room
18:25:24 [JaseW]
JaseW has joined #ai-powered-accessibility
18:27:26 [ericaconnell2]
ericaconnell2 has joined #ai-powered-accessibility
18:27:33 [kzms2]
kzms2 has joined #ai-powered-accessibility
18:27:49 [hgarg]
One rule that the tool checks against is WCAG 3.1.4 which checks for use of uncommon abbreviations in text.
18:30:00 [Fazio]
Fazio has joined #ai-powered-accessibility
18:30:10 [hgarg]
Another rule that the tool checks against is WCAG 3.1.4 which checks for use of unusual words in text.
18:30:12 [Fazio]
present+
18:30:20 [Fazio]
chair: Fazio
18:30:22 [Fazio]
q?
18:30:47 [Ben_Tillyer_]
@fazio, we have had requests for a link to the slides if possible
18:31:57 [hgarg]
Use of LLM's allows analysis of different languages in the tool.
18:32:47 [ZoeBijl]
ZoeBijl has joined #ai-powered-accessibility
18:33:18 [hgarg]
The tool would incorporate elements to allow end users to interact with AI to fetch more examples or possible solutions for reported issues.
18:35:16 [hgarg]
The tool also uses LLM's to analyze where the Link text is inadequate and could more meaningfully convey the link target.
18:40:34 [Ben_Tillyer_]
q+ to ask 3 questions 1) about links 2) about hallucinations 3) about sustainability
18:40:59 [CharlesL]
q+
18:41:08 [Fazio]
q?
18:41:09 [NehaJ]
present+
18:42:51 [hgarg]
Question: `Click here` can be reported by non AI tools too. Do you look at the surrounding text too?
18:42:51 [hgarg]
Answer: Yes, the context is shared with AI.
18:43:17 [Adam_Page]
Adam_Page has joined #ai-powered-accessibility
18:43:58 [Ben_Tillyer_]
ack ben
18:43:58 [Zakim]
Ben_Tillyer_, you wanted to ask 3 questions 1) about links 2) about hallucinations 3) about sustainability
18:44:44 [hgarg]
Question: How do you protect against hallucinations?
18:45:39 [hgarg]
Answer: Human intervention is used.
18:47:18 [hgarg]
Question: 10 clients submitting requests that are similar? Do you plan to offline some of the LLM responses?
18:47:18 [hgarg]
Answer: Yes. Not yet. But a necessity.
18:49:25 [hgarg]
Limits on number of tokens, requests are current challenges
18:50:03 [Ben_Tillyer_]
q?
18:50:48 [Ben_Tillyer_]
ack Char
18:51:40 [Fazio]
q
18:51:40 [Fazio]
?
18:51:45 [Fazio]
q?
18:51:48 [hgarg]
Question: How do you fix source files hosted on wordpress?
18:51:48 [hgarg]
Answer: We can't, but the idea is to test it locally via the tool. And then fix it at source
18:53:04 [hgarg]
Question: Is checking for use of correct semantic tags on the horizon?
18:53:04 [hgarg]
Answer: Yes, though not implemented yet. Work in progress.
18:53:38 [chrisp]
chrisp has joined #ai-powered-accessibility
18:53:43 [Fazio]
q?
18:53:53 [chrisp]
q+
18:54:26 [CharlesL]
CharlesL has left #ai-powered-accessibility
18:54:34 [hgarg]
We will be at m-enabling in October also showcasing this.
18:54:49 [Ben_Tillyer_]
ack chr
18:56:07 [Adam_Page]
Adam_Page has left #ai-powered-accessibility
18:56:17 [hgarg]
Question: Existing LLM's vs fine tuning vs prompt engineering, which one?
18:56:17 [hgarg]
Answer: Existing LLM's with appropriate input from the web page for analysis.
18:56:25 [Ben_Tillyer_]
q?
18:56:32 [Fazio]
q?
18:57:32 [hgarg]
Email: dfazio@helixopp.com
18:57:34 [Fazio]
dfazio@helixopp.com
18:57:38 [NehaJ]
njadhav@helixopp.com
18:57:42 [Ben_Tillyer_]
rssagent, create minutes
18:59:00 [ZoeBijl]
RRSAgent, make minutes
18:59:02 [RRSAgent]
I have made the request to generate https://www.w3.org/2024/09/25-ai-powered-accessibility-minutes.html ZoeBijl
18:59:58 [hgarg]
That worked ZoeBijl Ben_Tillyer_
19:00:03 [hgarg]
Thanks
19:00:39 [ZoeBijl]
Did that capture everything?
19:01:14 [hgarg]
Yes most of what I put down as scribe.
19:01:21 [ZoeBijl]
Zakim, end meeting
19:01:21 [Zakim]
As of this point the attendees have been CharlesL, hgarg, MJ, duga, Ben_Tillyer_, cyns, Fazio, NehaJ
19:01:23 [Zakim]
RRSAgent, please draft minutes
19:01:24 [RRSAgent]
I have made the request to generate https://www.w3.org/2024/09/25-ai-powered-accessibility-minutes.html Zakim
19:01:31 [Zakim]
I am happy to have been of service, ZoeBijl; please remember to excuse RRSAgent. Goodbye
19:01:31 [Zakim]
Zakim has left #ai-powered-accessibility
19:04:04 [ZoeBijl]
RRSAgent, LEAVE
19:04:04 [RRSAgent]
I see no action items