website lookup · census · com · fetched 2026-09-30 · JSON
twitter.com
twitter.com · X. It’s what’s happening / X
| TLD family | com |
|---|---|
| Rank | 15 |
| Website reachable over HTTPS | yes (HTTP 200) (serves from x.com) |
| HSTS header | yes |
| security.txt (RFC 9116) | incomplete published at /.well-known/security.txt; Expires date has passed |
| Privacy policy linked from the homepage | linked |
| Accessibility statement linked from the homepage | linked |
| robots.txt | served; GPTBot blocked, ClaudeBot blocked, ChatGPT-User blocked, Claude-User blocked, Perplexity-User blocked, Googlebot partly blocked, all other bots blocked; names 4 AI crawlers explicitly |
| llms.txt | not published |
| A2A agent card | not published |
What to fix
- security.txt has passed its Expires date; refresh it. Guide
- robots.txt tells ChatGPT-User and Claude-User not to open pages for users; if that is unintended, split training crawlers from assistants. Rules for AI crawlers
- No llms.txt: a short Markdown index of what the site offers to AI assistants. Guide
- No A2A agent card at /.well-known/agent-card.json. Guide
Full agent-readiness grade (live)
Run this site?
Instant AI visibility report for twitter.com: $9 · $49 full report or $99 monthly monitoring · Hosted accessibility feedback and privacy request desk
One fetch on 2026-09-30; homepage links detected from anchors and visible text, so a page that exists but is not linked from the homepage is not counted. Record as JSON: twitter.com.json (CC BY 4.0). Not legal advice.