Accessibility checks on AI-built websites
We gave AI coding tools the same everyday website briefs without accessibility instructions. Then we scanned the pages they built with axe-core.
Results
A run pairs one coding tool with one model. Open a run to see its sites and their scan results.
AIMAC Debt counts only critical and serious axe-core violations. Repeated violations of the same rule on a page add progressively less to its score. Runs are ranked by median page score across the 28 categories that every run captured. Lower scores rank first, with ties broken by the lower average page score. The Violations column counts all impact levels. Smaller pages give axe-core fewer elements to check.
| Rank | Run | AIMAC Debt | Sites scored | Violations | HTML elements |
|---|---|---|---|---|---|
| 1 | Codex CLI GPT-6.2-Astra | 0.0 | 28 | 0 | 3130 |
| 2 | Codex CLI GPT-6.2-Sol | 0.0 | 28 | 4 | 2957 |
| 3 | Antigravity CLI GPT-OSS 120B | 0.0 | 28 | 65 | 1166 |
| 4 | Claude Code Fable 5.2 | 2.0 | 28 | 103 | 16578 |
| 5 | Codex CLI GPT-6.1 Terra | 5.0 | 28 | 667 | 5651 |
| 6 | Codex CLI GPT-6-Luna | 5.7 | 28 | 317 | 4256 |
| 7 | Claude Code Opus 5.5 | 7.3 | 28 | 572 | 12247 |
| 8 | Antigravity CLI Gemini 3.8 Flash | 8.0 | 28 | 440 | 7705 |
Categories
Choose a category to read its brief and compare the sites built from it.
- Arts and Entertainment
- Automotive
- Business
- Careers
- Education
- Family and Parenting
- Food and Drink
- Gambling/Casinos
- Gaming
- Government
- Health and Fitness
- Hobbies and Interests
- Home and Garden
- Law, Government, & Politics
- News/Weather/Information
- Non-Profit/Charity
- Personal Finance
- Pets
- Real Estate
- Religion and Spirituality
- Science
- Shopping
- Social Media
- Society
- Sports
- Style & Fashion
- Technology & Computing
- Travel
Method
Each run received the same briefs, one per category. Each tool started with its default model. We chose later models by their rank on aimac.ai. We sent the opening instructions through the /goal command in Codex and as a regular message in Claude Code and Antigravity. A structural check confirmed that every run completed every category before scanning. We opened each saved page in Chromium with external requests blocked and ran axe-core once with its default rules.
| Tool | Version or setting |
|---|---|
| axe-core | 4.14.1 |
| @axe-core/playwright | 4.14.0 |
| playwright | 1.65.1 |
| chromium | 159.0.8154.6 |
| node | v26.7.0 |
| Injected axe-core script (SHA-256) | 29348999450cdf2849a8e70b7912fc2da85a849da39c0d0d5394f51d4a9ed95c |
| Viewport | 1280 by 1024 pixels |
| Locale, timezone, color scheme | en-US, UTC, light |
Limits
- Each tool used its own Linux container on a Mac mini. Its models ran one after another, each in a fresh conversation and a separate folder. Later models could read earlier folders. Chromium was installed, and some models used it to check their pages. Antigravity ran on Google's free tier. Room checks confirmed access to the public internet and blocked access to the host's home folders, tested local network services and other rooms. Full clean-room qualification is pending.
- Each model ran once. After the opening instructions, we intervened only with GPT-OSS 120B. We told it to continue five times and shared two errors from the structural checker after it reported finishing with two sites missing.
- A failed capture leaves the page's accessibility result unknown.
- Axe-core scanned each page as it first loaded at one desktop size, without clicks, scrolling or other interaction. A full accessibility assessment or a judgment of conformance with the Web Content Accessibility Guidelines (WCAG) requires further testing. The briefs required pages to load without external resources, which can change what a model builds.
- The rankings reflect critical and serious axe-core violations from one run per model. How much scores vary across repeat runs is unknown.