Canada does not need to start from scratch to figure out how to govern artificial intelligence responsibly. Developing federal disability policy over many years has taught us lessons that are remarkably relevant to the AI challenge now confronting governments: how to anticipate harms, involve people most affected by them and make those responsible for design and purchase accountable before problems become entrenched.

The Accessible Canada Act moved federal policy toward identifying, removing and preventing barriers rather than placing the onus on individuals to ask that their needs be accommodated. Federally regulated organizations must develop accessibility plans, consult people with disabilities, establish channels for communication and report on progress.

This framework underscores that prevention, participation and ongoing feedback must be built into how complex AI systems operate.

Three federal bodies are particularly well positioned to act as artificial intelligence becomes embedded in hiring, benefits, immigration, government services and other consequential decisions. They are the Treasury Board, departments using AI, and Public Services and Procurement Canada (PSPC).

Treasury Board should require participatory testing

The first lesson from disability policy is that barriers are easier to prevent when the people likely to encounter them are involved before anything is implemented.

The Treasury Board should require departments using high-impact AI to demonstrate that it has been tested with people who may experience it differently, including people with disabilities. This should go beyond technical testing or performance measures. A program can perform well overall and still create serious barriers for particular groups.

Consider automated hiring that analyzes speech, facial movements, response times or interactions with........

© IRPP - Policy Options