Risk
The platforms used to build, govern, generate, and audit AI (programming environments, monitoring tools, and evaluation interfaces, etc.) are themselves often inaccessible to developers and auditors with disabilities. This prevents persons with disabilities from participating in the development of AI systems and tools and improving their accessibility.
Mitigation
Compliance with the Web Content Accessibility Guidelines (WCAG) and other accessibility standards should be required for all AI development environments, and accessibility should be funded for major machine-learning toolchains. Developers, auditors, and DPO representatives with disabilities should be a part of the governance structure and compensated for their participation.
Illustrative Examples
Education
Inaccessible tools shaping inaccessible courses
Tools used to create and manage AI in education may not be accessible to instructional designers with disabilities. This can limit the instructor’s ability to design inclusive course materials or identify accessibility issues, reducing the quality of learning environments.
Employment
Inaccessible hiring pipelines for technical roles
Hiring processes for technical roles often use coding tests and development platforms that may not be fully accessible. This can make it harder for developers with disabilities to demonstrate their skills or complete assessments. As a result, fewer individuals with disabilities may be included in AI-related roles.
Healthcare
Inaccessible systems limiting oversight by disabled clinicians
Tools used to operate or review clinical AI systems, such as dashboards and monitoring platforms, may not be fully accessible. This can make it harder for clinicians with disabilities to use, oversee, or question these systems. As a result, fewer perspectives may shape how the AI is improved or corrected.
Services
Accessibility gaps in AI governance and oversight
Tools used to design, purchase, and review public-sector AI systems may not be fully accessible. This can limit the ability of people with disabilities to take part in oversight and decision-making. As a result, fewer accessibility concerns may be identified and addressed.