website lookup · census · com · fetched 2026-09-30 · JSON · feed · badge
theregister.com
theregister.com · Technology news and analysis | The Register
| TLD family | com |
|---|---|
| Rank | 3,062 |
| Website reachable over HTTPS | yes (HTTP 200) |
| HSTS header | no |
| security.txt (RFC 9116) | missing not published |
| Privacy policy linked from the homepage | not linked |
| Accessibility statement linked from the homepage | not linked |
| robots.txt | served; GPTBot blocked, ClaudeBot blocked, ChatGPT-User allowed, Claude-User allowed, Perplexity-User blocked, Googlebot allowed, all other bots blocked; names 14 AI crawlers explicitly |
| llms.txt | not published |
| A2A agent card | not published |
On 1 gap list
This domain appears in 1 gap list of this census: theregister.com is one of the websites missing a control in the 2026-09-30 census. Each list comes with a free first 50 rows, a change feed, and the full list as a file for 1.00 USDC (x402 on Base, no account); the people who buy these lists sell the fix.
- Top-100k websites blocking GPTBot: 7,305 websites · free top 50 · feed · full list CSV, 1.00 USDC · JSON
Buyers: AI-visibility and content-licensing vendors, publisher analytics, bot-management vendors.
Not re-checked since the census yet: this host re-checks a rotating slice of websites every 6 hours, each domain at most once per 14 days, and records differences here. Watch this domain (feed).
What to fix
- No security.txt: publish one at /.well-known/security.txt with Contact and Expires lines (RFC 9116). Guide
- robots.txt disallows every bot for the whole site. Rules for AI crawlers
- No HSTS header: browsers can still be downgraded to HTTP on the first visit.
- No privacy policy link found on the homepage. Legal notices checklist
- No accessibility statement link found on the homepage. Legal notices checklist
- No llms.txt: a short Markdown index of what the site offers to AI assistants. Guide
- No A2A agent card at /.well-known/agent-card.json. Guide
Full agent-readiness grade (live)
Badge
Show your record: paste this on your site. It links to this page, follows the record (the badge is re-rendered from the census and live re-checks, cached one day) and carries no tracking.
<a href="https://top100k.agentexchange.work/site/theregister.com"><img src="https://top100k.agentexchange.work/site/theregister.com.svg" alt="Top 100,000 websites census record for theregister.com"></a>
Run this site?
Instant AI visibility report for theregister.com: $9 · $49 full report or $99 monthly monitoring · Hosted accessibility feedback and privacy request desk
One fetch on 2026-09-30; homepage links detected from anchors and visible text, so a page that exists but is not linked from the homepage is not counted. Record as JSON: theregister.com.json (CC BY 4.0) · Atom feed of changes: theregister.com.xml. Not legal advice.