Top 100,000 websites census

Top 100,000 websites census · gap lists · census 2026-09-30 · JSON (top 50) · feed

Top-100k websites with an expired security.txt

918 of the 99,993 websites in the census list (0.9%; 1.2% of the 78,997 reachable over HTTPS), as fetched on 2026-09-30.

On this list

918

of 99,993 websites

Share of the list

0.9%

1.2% of reachable sites

Full list

1.00 USDC

x402, per file; first 50 rows free

What this gap means

A security.txt is published but its Expires date has passed; RFC 9116 says a file past that date should not be relied on.

Control: security.txt Expires line (RFC 9116). Rule: expired_security_txt over the census record (reachable sites only). Who buys this: Security teams and vulnerability-disclosure vendors: a lapsed file is a specific, verifiable conversation opener.

The obligation it maps to

security.txt (RFC 9116): A file at /.well-known/security.txt with Contact and Expires fields tells researchers where to report vulnerabilities. The census marks a file complete when both fields are present and the Expires date has not passed. Source

Free: the first 50 of 918 (by rank)

DomainTLD familyRankCensus record
amazonaws.comcom6HTTP 200 via aws.amazon.com · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot partly blocked
microsoft.comcom8HTTP 200 · HSTS yes · security.txt expired · privacy yes · accessibility yes · GPTBot partly blocked
twitter.comcom15HTTP 200 via x.com · HSTS yes · security.txt expired · privacy yes · accessibility yes · GPTBot blocked
x.comcom50HTTP 200 · HSTS yes · security.txt expired · privacy yes · accessibility yes · GPTBot blocked
windows.comcom97HTTP 200 via www.microsoft.com · HSTS yes · security.txt expired · privacy yes · accessibility yes · GPTBot partly blocked
booking.comcom281HTTP 202 · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot partly blocked
dell.comcom322HTTP 200 · HSTS yes · security.txt expired · privacy yes · accessibility no · GPTBot partly blocked
ivi.ruRU502HTTP 200 via www.ivi.tv · HSTS no · security.txt expired · privacy no · accessibility no · GPTBot allowed
usatoday.comcom597HTTP 200 · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot blocked
ikea.comcom633HTTP 200 · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot partly blocked
kick.comcom701HTTP 200 · HSTS no · security.txt expired · privacy yes · accessibility no · GPTBot partly blocked
bild.deDE766HTTP 200 · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot partly blocked
welt.deDE808HTTP 200 · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot partly blocked
life360.comcom869HTTP 403 · HSTS no · security.txt expired · privacy no · accessibility no
princeton.eduedu911HTTP 403 · HSTS no · security.txt expired · privacy no · accessibility no · GPTBot partly blocked
jimdo.comcom1,016HTTP 200 · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot partly blocked
xing.comcom1,027HTTP 200 · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot partly blocked
wise.comcom1,060HTTP 200 · HSTS yes · security.txt expired · privacy yes · accessibility yes · GPTBot partly blocked
crazygames.comcom1,091HTTP 200 · HSTS yes · security.txt expired · privacy yes · accessibility no · GPTBot partly blocked
gofundme.comcom1,114HTTP 200 · HSTS yes · security.txt expired · privacy yes · accessibility yes · GPTBot partly blocked
sectigo.comcom1,217HTTP 200 · HSTS no · security.txt expired · privacy no · accessibility no
divar.irIR1,241HTTP 200 · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot partly blocked
abc.net.auAU1,263HTTP 200 · HSTS no · security.txt expired · privacy no · accessibility no · GPTBot blocked
deezer.comcom1,543HTTP 200 · HSTS yes · security.txt expired · privacy no · accessibility yes · GPTBot partly blocked
va.govgov1,833HTTP 200 · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot partly blocked
timeanddate.comcom2,065HTTP 403 · HSTS no · security.txt expired · privacy no · accessibility no · GPTBot partly blocked
dynamics.comcom2,192HTTP 200 via www.microsoft.com · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot partly blocked
mparticle.comcom2,284HTTP 200 · HSTS yes · security.txt expired · privacy yes · accessibility no · GPTBot blocked
amazonaws.com.cnCN2,333HTTP 200 via www.amazonaws.cn · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot partly blocked
coinbase.comcom2,387HTTP 403 · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot partly blocked
surfshark.comcom2,430HTTP 200 · HSTS yes · security.txt expired · privacy yes · accessibility no · GPTBot partly blocked
mos.ruRU2,443HTTP 200 · HSTS no · security.txt expired · privacy no · accessibility no · GPTBot blocked
rockstargames.comcom2,596HTTP 200 · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot blocked
franceinfo.frFR2,606HTTP 200 · HSTS yes · security.txt expired · privacy yes · accessibility yes · GPTBot blocked
affirm.comcom2,758HTTP 200 · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot partly blocked
capitalone.comcom2,759HTTP 200 · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot partly blocked
comodoca.comcom2,776HTTP 200 via www.sectigo.com · HSTS no · security.txt expired · privacy no · accessibility no
bt.comcom2,840HTTP 200 · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot partly blocked
powerapps.comcom2,852HTTP 200 via www.microsoft.com · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot partly blocked
yr.noNO2,856HTTP 200 · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot blocked
tamu.eduedu2,896HTTP 200 · HSTS yes · security.txt expired · privacy yes · accessibility yes · GPTBot allowed
zalando.deDE3,020HTTP 200 · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot blocked
watchguard.comcom3,111HTTP 200 · HSTS yes · security.txt expired · privacy yes · accessibility no · GPTBot partly blocked
n-able.comcom3,119HTTP 403 · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot partly blocked
telenet.beBE3,144HTTP 200 via www2.telenet.be · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot partly blocked
razorpay.comcom3,315HTTP 200 · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot partly blocked
trouble-free.netnet3,444HTTP 200 via www.interserver.net · HSTS no · security.txt expired · privacy yes · accessibility yes · GPTBot partly blocked
azurecontainerapps.ioIO3,470HTTP 200 via www.microsoft.com · HSTS yes · security.txt expired · privacy yes · accessibility yes · GPTBot partly blocked
dinahosting.comcom3,476HTTP 200 · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot allowed
powerplatform.comcom3,505HTTP 200 via www.microsoft.com · HSTS yes · security.txt expired · privacy no · accessibility no · GPTBot partly blocked

The same rows as JSON: expired-security-txt.top.json (CORS open, cached one day).

Get the full list: 918 rows, 1.00 USDC

x402 on Base, paid per file, no account or key. GET https://top100k.agentexchange.work/leads/expired-security-txt.csv or GET https://top100k.agentexchange.work/leads/expired-security-txt.json answers 402 Payment Required with the terms (scheme exact, USDC on Base, maxAmountRequired 1000000, payTo 0xc91cE6291eDC0713ec753BAFBA002506ffb2b95c); an x402 client signs the EIP-3009 authorization and resends the same request with X-PAYMENT; the file comes back with a PAYMENT-RESPONSE header. HEAD gets the same 402.

curl -sS -D - https://top100k.agentexchange.work/leads/expired-security-txt.csv   # 402 with the x402 terms; pay and resend with X-PAYMENT

Columns (19): domain, name, type, city, state, tranco_rank, reachable, http_only, https_status, final_host, hsts, security_txt, privacy_link, accessibility_link, robots_gptbot, robots_chatgpt_user, robots_claude_user, llms_txt, title. CSV: header row, every cell quoted, yes/no for booleans. JSON: { list, title, count, by_state, columns, rows[][] }. Sizes: CSV 161 KB, JSON 163 KB. The same facts are in the free CC BY 4.0 dumps: the price buys the filtered, state-sliceable file built from the 2026-09-30 census, not exclusive data. Settlement is final; no refunds. Prices in /.well-known/x402 equal the challenges. Terms · pricing.

Card checkout

Pay with a card through Stripe and get the file on the next page: Full list CSV, $29 · JSON, $29 · all 5 lists, $79. Agents pay less with x402 (see above).

Monitor this list (free)

Atom feed: websites that entered or left this list according to the live re-checks (every 6 hours a rotating slice, each domain at most once per 14 days; each entry says which way it moved and which field changed). expired-security-txt.top.json: the first 50 rows and the counts by state as JSON, CORS open. Fields watched: security_txt, security_txt.expired.

Membership reflects the homepage and well-known files as fetched on 2026-09-30: a control that exists but was not found where the census looked counts as missing, and sites answering 403 to our one polite request count as reachable. Every domain links to its record with what to fix, a JSON twin, a badge and a changes feed. Data licence CC BY 4.0. Not legal advice.