Is Your Site Agent-Ready?
Scan any URL against 20 emerging agent-readiness standards — from robots.txt and Markdown negotiation to MCP, OAuth discovery, Agent Skills, WebMCP, and agentic commerce. Open methodology. Paste-ready fix prompts.
Scans take 10–25 seconds · Results are public · Free
A scorecard your devs can act on.
Twenty probes, scored deterministically. Each one tagged by adoption flag, so your team knows what's table-stakes and what's still on the horizon.
lexity.ai
Scanned just now · 20 probes · 0.18s
4 pass · 10 fail
- Discoverability3/4
- Content negotiation0/1
- Bot access control0/2
- API · Auth · MCP1/7
- Agent commerce0/0
Request
https://lexity.ai/robots.txtResponse
Response headers
- content-type:text/plain; charset=utf-8
- content-length:103
- cache-control:public, max-age=0, must-revalidate
- access-control-allow-origin:*
Body excerpt
/robots.txt · 4 linesUser-Agent: * Allow: / Disallow: /api/ Host: https://lexity.ai Sitemap: https://lexity.ai/sitemap.xml
robots.txt is a plain-text file at the root of your domain that tells automated visitors which parts of your site they may read. Missing it means well-behaved bots usually treat everything as crawlable — and you lose the chance to record any preference. RFC 9309 ↗
- robots.txt· DiscoverabilityHigh adoption
- Sitemap· DiscoverabilityHigh adoption
- JSON-LD structured data· DiscoverabilityHigh adoption
- Link headers (RFC 8288)· DiscoverabilityReal & growing
- llms.txt (Chrome Lighthouse)· DiscoverabilityEarly but real
- Markdown Negotiation· Content negotiationEarly but real
Half of these standards are still being argued.
Use this scan as a starting point, not a spec sheet. Every check links back to the canonical source so your team can validate before implementing.
Adoption flags, explained
Every check is tagged with one. Use it to decide what to ship now vs. what to watch.
- High adoption
Established standard, widely supported across major crawlers and platforms. Safe to implement; reasonable to expect bots to honour.
- Real & growing
Published spec or near-final RFC with verified production use at multiple platforms. Stable enough to ship.
- Early but real
Active spec work or first-mover production implementations. Worth shipping if you're an early adopter, but expect the surface to shift.
- Speculative
Proposed standard, working draft, or competing approaches. Worth watching, but assume breaking changes before it stabilises.
- Aloha extension
A check we run that is not yet a published standard. Useful operational signal — not authoritative.
What we based these checks on
Every probe links to a canonical source. The biggest ones live here.
- RFC 9309 — robots.txtThe canonical robots.txt spec (IETF, 2022)
- Chrome Lighthouse · Agentic BrowsingGoogle's scoring model for agent readiness (incl. llms.txt)
- web.dev · AI agent site UXGoogle's guidance for sites that want agents to succeed
- Model Context ProtocolAnthropic's MCP spec for tool-using agents
- llms.txtConvention for LLM-friendly content discovery
- RFC 9727 — API CatalogWell-known API catalogs for automated discovery
- RFC 9728 — OAuth Protected ResourceOAuth resource metadata for agent auth
This scanner is an experiment. Validate before you implement.
We built this to learn alongside the agentic-web stack — many of the standards we probe are early, still under spec work, or contested between vendors. Before implementing anything beyond robots.txt and JSON-LD: read the canonical spec we link, confirm the standard hasn't shifted since this scan, and consult a technical SEO or platform expert for critical surfaces. The checks themselves will evolve as the ecosystem does. This is open methodology — not legal, security, or compliance advice.
No black-box scoring. Just probes you can rerun in your terminal.
We built the scanner the way the spec authors meant the standards to be tested — every probe deterministic, every result reproducible.
- 01
Deterministic HTTP probes
Every finding is a request you can reproduce in your terminal with curl. No AI in the scoring loop, no proprietary signals — just request, response, body excerpt.
- 02
Honest adoption flags
Each check carries a flag — high adoption, real-and-growing, early-but-real, speculative, or Aloha-extension — so your team knows what to ship now vs. what to watch.
- 03
Paste-ready fix prompts
For every fail, we generate a ready-to-paste prompt for Claude Code or Cursor. Your devs go from "what is x402" to a merged PR without reading a spec.
A scanner built for the agentic web — not retrofitted for it.
- 20
Deterministic probes
- 5
Categories of agent readiness
- < 25s
From URL to full report
- 0
AI in the scoring loop
Hand the full audit to your devs.
Every scan exports as a single Markdown file — request, response, body excerpt, and a plain-English explainer for each check. Paste it into Claude Code, Cursor, or your project tracker.
Want a hand interpreting the results? Talk to us →


