Top 100,000 websites census

website lookup · census · UK · fetched 2026-09-30 · JSON

bbc.co.uk

bbc.co.uk · BBC - Home

TLD familyUK
Rank236
Website reachable over HTTPSyes (HTTP 200)
HSTS headeryes
security.txt (RFC 9116)complete published at /.well-known/security.txt
Privacy policy linked from the homepagenot linked
Accessibility statement linked from the homepagelinked
robots.txtserved; GPTBot blocked, ClaudeBot blocked, ChatGPT-User blocked, Claude-User partly blocked, Perplexity-User blocked, Googlebot partly blocked, all other bots partly blocked; names 12 AI crawlers explicitly
llms.txtnot published
A2A agent cardnot published

What to fix

  1. robots.txt tells ChatGPT-User not to open pages for users; if that is unintended, split training crawlers from assistants. Rules for AI crawlers
  2. No privacy policy link found on the homepage. Legal notices checklist
  3. No llms.txt: a short Markdown index of what the site offers to AI assistants. Guide
  4. No A2A agent card at /.well-known/agent-card.json. Guide

Full agent-readiness grade (live)

Run this site?

Instant AI visibility report for bbc.co.uk: $9 · $49 full report or $99 monthly monitoring · Hosted accessibility feedback and privacy request desk

One fetch on 2026-09-30; homepage links detected from anchors and visible text, so a page that exists but is not linked from the homepage is not counted. Record as JSON: bbc.co.uk.json (CC BY 4.0). Not legal advice.