# AI Website Readiness Explorer

> Can ChatGPT, Claude, Perplexity and AI agents read your website? Explainable score. Checks a page the way AI crawlers and agents see it: robots.txt rules for 16 AI and search bots (training vs. search vs. user-triggered, RFC 9309 matching, Content-Signal), meta robots, whether the content exists without JavaScript, semantic structure, JSON-LD types, llms.txt, sitemap, OpenAPI/API catalog and machine-readable alternates. Every check is listed with its points, so the score is fully explainable.

Part of usefulweb.site (https://usefulweb.site/). Results are deterministic calculations from the inputs and the listed assumptions; the API returns exactly what the web page shows.

## Use it
- Human interface: https://aiwebsitereadinessexplorer.usefulweb.site/ (interactive tool at https://aiwebsitereadinessexplorer.usefulweb.site/tool)
- JSON API: POST https://aiwebsitereadinessexplorer.usefulweb.site/api/v1/calculate with a JSON object of inputs (schema: https://aiwebsitereadinessexplorer.usefulweb.site/api/v1/tool)
- OpenAPI: https://aiwebsitereadinessexplorer.usefulweb.site/openapi.json
- MCP (Streamable HTTP): https://aiwebsitereadinessexplorer.usefulweb.site/mcp - tool `ai_website_readiness_explorer`

## Inputs
- url (url): Page URL
- html (textarea): Or paste the page HTML (offline)
- robotsTxt (textarea): robots.txt content (offline mode)
- llmsTxt (textarea): llms.txt content (offline mode, optional)

## Method
- robots.txt is evaluated per RFC 9309 for the page path: the group naming the bot exactly is used, otherwise the * group; the longest matching rule wins (Allow on ties). Content-Signal lines are reported.
- Access score: search and user-request bots allowed earns the access points; blocking training-only bots (GPTBot, CCBot, Google-Extended, …) is a legitimate choice and is NOT penalised.
- Content: visible text without JavaScript (scripts/styles removed); ≥ 500 characters = server-rendered.
- Score = earned points / possible points × 100 over all checks (each check lists its points). Grade: A ≥ 90, B ≥ 75, C ≥ 60, D ≥ 40, else F.
- Online mode fetches the page, /robots.txt, /llms.txt, /sitemap.xml, /openapi.json and /.well-known/api-catalog (RFC 9727) once each.