Top 100,000 websites census · gap lists · census 2026-09-30 · JSON (top 50) · feed
Top-100k homepages that redirect to another domain
6,773 of the 99,993 websites in the census list (6.8%; 8.6% of the 78,997 reachable over HTTPS), as fetched on 2026-09-30.
On this list
6,773
of 99,993 websites
Share of the list
6.8%
8.6% of reachable sites
Full list
1.00 USDC
x402, per file; first 50 rows free
What this gap means
The homepage redirected to a host outside the listed domain (a different registrable name) on the fetch date.
Control: Homepage served on the listed domain. Rule: redirects_off_domain over the census record (reachable sites only). Who buys this: Web agencies, domain and brand-protection vendors, security teams checking for stale redirects.
This list maps to no legal obligation in this census; it is a gap in published practice.
Free: the first 50 of 6,773 (by rank)
| Domain | TLD family | Rank | Census record |
|---|---|---|---|
| amazonaws.com | com | 6 | HTTP 200 via aws.amazon.com · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot partly blocked |
| fbcdn.net | net | 13 | HTTP 200 via www.facebook.com · HSTS yes · security.txt complete · privacy no · accessibility no · GPTBot partly blocked |
| twitter.com | com | 15 | HTTP 200 via x.com · HSTS yes · security.txt expired · privacy yes · accessibility yes · GPTBot blocked |
| dzen.ru | RU | 17 | HTTP 200 via sso.passport.yandex.ru · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
| office.com | com | 22 | HTTP 200 via m365.cloud.microsoft · HSTS yes · security.txt none · privacy yes · accessibility yes |
| hicloudcam.com | com | 24 | HTTP 200 via www.ezviz.com · HSTS no · security.txt incomplete · privacy yes · accessibility no · GPTBot partly blocked |
| azure.com | com | 28 | HTTP 200 via azure.microsoft.com · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot partly blocked |
| whatsapp.net | net | 32 | HTTP 200 via www.whatsapp.com · HSTS yes · security.txt complete · privacy yes · accessibility no · GPTBot blocked |
| fastly.net | net | 35 | HTTP 200 via www.fastly.com · HSTS yes · security.txt none · privacy yes · accessibility no · GPTBot partly blocked |
| doubleclick.net | net | 38 | HTTP 200 via marketingplatform.google.com · HSTS no · security.txt none · privacy yes · accessibility no · GPTBot blocked |
| youtu.be | BE | 46 | HTTP 200 via www.youtube.com · HSTS yes · security.txt incomplete · privacy no · accessibility no · GPTBot partly blocked |
| skype.com | com | 51 | HTTP 200 via teams.live.com · HSTS yes · security.txt none · privacy yes · accessibility no · GPTBot partly blocked |
| googledomains.com | com | 58 | HTTP 200 via domains.google · HSTS no · security.txt none · privacy yes · accessibility no · GPTBot allowed |
| googlesyndication.com | com | 60 | HTTP 200 via www.google.com · HSTS no · security.txt complete · privacy yes · accessibility no · GPTBot partly blocked |
| wa.me | ME | 69 | HTTP 200 via api.whatsapp.com · HSTS yes · security.txt none · privacy yes · accessibility no · GPTBot blocked |
| zoom.us | US | 74 | HTTP 200 via www.zoom.com · HSTS yes · security.txt none · privacy yes · accessibility no · GPTBot partly blocked |
| workers.dev | dev | 80 | HTTP 200 via www.cloudflare.com · HSTS yes · security.txt incomplete · privacy no · accessibility no · GPTBot allowed |
| cloudflare-dns.com | com | 83 | HTTP 200 via one.one.one.one · HSTS no · security.txt none · privacy yes · accessibility no · GPTBot allowed |
| nginx.com | com | 96 | HTTP 200 via www.f5.com · HSTS yes · security.txt complete · privacy yes · accessibility no · GPTBot allowed |
| windows.com | com | 97 | HTTP 200 via www.microsoft.com · HSTS yes · security.txt expired · privacy yes · accessibility yes · GPTBot partly blocked |
| t.me | ME | 103 | HTTP 200 via telegram.org · HSTS yes · security.txt none · privacy yes · accessibility no |
| blogspot.com | com | 104 | HTTP 200 via www.blogger.com · HSTS no · security.txt none · privacy yes · accessibility no · GPTBot partly blocked |
| actify.nl | NL | 107 | HTTP 200 via www.zilverenkruis.nl · HSTS yes · security.txt complete · privacy no · accessibility no · GPTBot partly blocked |
| b-cdn.net | net | 108 | HTTP 200 via bunny.net · HSTS no · security.txt none · privacy no · accessibility no · GPTBot allowed |
| bit.ly | LY | 117 | HTTP 200 via bitly.com · HSTS yes · security.txt incomplete · privacy yes · accessibility yes · GPTBot allowed |
| amazonvideo.com | com | 118 | HTTP 200 via www.primevideo.com · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot partly blocked |
| google-analytics.com | com | 119 | HTTP 200 via marketingplatform.google.com · HSTS no · security.txt none · privacy yes · accessibility no · GPTBot blocked |
| outlook.com | com | 121 | HTTP 200 via outlook.live.com · HSTS yes · security.txt none · privacy no · accessibility no |
| github.io | IO | 127 | HTTP 200 via pages.github.com · HSTS no · security.txt none · privacy yes · accessibility no · GPTBot allowed |
| unity3d.com | com | 140 | HTTP 200 via unity.com · HSTS no · security.txt none · privacy no · accessibility no · GPTBot partly blocked |
| discord.gg | GG | 142 | HTTP 200 via discord.com · HSTS yes · security.txt complete · privacy yes · accessibility no · GPTBot partly blocked |
| xiaomi.com | com | 158 | HTTP 403 via www.mi.com · HSTS no · security.txt none · privacy no · accessibility no |
| lencr.org | org | 163 | HTTP 200 via letsencrypt.org · HSTS yes · security.txt complete · privacy yes · accessibility no · GPTBot allowed |
| adobe.io | IO | 165 | HTTP 200 via developer.adobe.com · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot partly blocked |
| adtrafficquality.google | 172 | HTTP 200 via www.google.com · HSTS no · security.txt complete · privacy yes · accessibility no · GPTBot partly blocked | |
| one.one | one | 173 | HTTP 200 via www.one.com · HSTS yes · security.txt incomplete · privacy no · accessibility no · GPTBot partly blocked |
| vkuserphoto.ru | RU | 178 | HTTP 418 via ps.userapi.com · HSTS yes · security.txt none · privacy no · accessibility no |
| hosting24.com | com | 183 | HTTP 200 via www.hostinger.com · HSTS no · security.txt complete · privacy no · accessibility no · GPTBot partly blocked |
| macromedia.com | com | 184 | HTTP 200 via www.adobe.com · HSTS yes · security.txt complete · privacy no · accessibility no · GPTBot partly blocked |
| paytmfirstgames.com | com | 186 | HTTP 200 via www.firstgames.in · HSTS yes · security.txt none · privacy no · accessibility no |
| telekom.net | net | 199 | HTTP 200 via www.telekom.com · HSTS yes · security.txt none · privacy yes · accessibility no · GPTBot partly blocked |
| rubiconproject.com | com | 220 | HTTP 200 via www.magnite.com · HSTS no · security.txt none · privacy yes · accessibility yes · GPTBot allowed |
| vungle.com | com | 225 | HTTP 200 via liftoff.ai · HSTS no · security.txt none · privacy yes · accessibility no · GPTBot partly blocked |
| pages.dev | dev | 234 | HTTP 200 via www.cloudflare.com · HSTS yes · security.txt incomplete · privacy no · accessibility no · GPTBot allowed |
| comcast.net | net | 238 | HTTP 403 via www.xfinity.com · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot partly blocked |
| meraki.com | com | 251 | HTTP 200 via www.cisco.com · HSTS yes · security.txt complete · privacy yes · accessibility yes · GPTBot allowed |
| gmail.com | com | 253 | HTTP 200 via accounts.google.com · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot partly blocked |
| wixsite.com | com | 275 | HTTP 200 via www.wix.com · HSTS yes · security.txt incomplete · privacy no · accessibility no · GPTBot partly blocked |
| crashlytics.com | com | 279 | HTTP 200 via firebase.google.com · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot partly blocked |
| mzstatic.com | com | 297 | HTTP 200 via www.apple.com · HSTS yes · security.txt complete · privacy yes · accessibility yes · GPTBot partly blocked |
The same rows as JSON: redirects-off-domain.top.json (CORS open, cached one day).
Get the full list: 6,773 rows, 1.00 USDC
x402 on Base, paid per file, no account or key. GET https://top100k.agentexchange.work/leads/redirects-off-domain.csv or GET https://top100k.agentexchange.work/leads/redirects-off-domain.json answers 402 Payment Required with the terms (scheme exact, USDC on Base, maxAmountRequired 1000000, payTo 0xc91cE6291eDC0713ec753BAFBA002506ffb2b95c); an x402 client signs the EIP-3009 authorization and resends the same request with X-PAYMENT; the file comes back with a PAYMENT-RESPONSE header. HEAD gets the same 402.
curl -sS -D - https://top100k.agentexchange.work/leads/redirects-off-domain.csv # 402 with the x402 terms; pay and resend with X-PAYMENT
Columns (19): domain, name, type, city, state, tranco_rank, reachable, http_only, https_status, final_host, hsts, security_txt, privacy_link, accessibility_link, robots_gptbot, robots_chatgpt_user, robots_claude_user, llms_txt, title. CSV: header row, every cell quoted, yes/no for booleans. JSON: { list, title, count, by_state, columns, rows[][] }. Sizes: CSV 1.2 MB, JSON 1.2 MB. The same facts are in the free CC BY 4.0 dumps: the price buys the filtered, state-sliceable file built from the 2026-09-30 census, not exclusive data. Settlement is final; no refunds. Prices in /.well-known/x402 equal the challenges. Terms · pricing.
Card checkout
Pay with a card through Stripe and get the file on the next page: Full list CSV, $29 · JSON, $29 · all 5 lists, $79. Agents pay less with x402 (see above).
Monitor this list (free)
Atom feed: websites that entered or left this list according to the live re-checks (every 6 hours a rotating slice, each domain at most once per 14 days; each entry says which way it moved and which field changed). The re-checks do not compare redirect targets, so this feed only carries websites that stopped or started answering over HTTPS. redirects-off-domain.top.json: the first 50 rows and the counts by state as JSON, CORS open. Fields watched: reachable.
Membership reflects the homepage and well-known files as fetched on 2026-09-30: a control that exists but was not found where the census looked counts as missing, and sites answering 403 to our one polite request count as reachable. Every domain links to its record with what to fix, a JSON twin, a badge and a changes feed. Data licence CC BY 4.0. Not legal advice.