Top 100,000 websites census · census 2026-09-30 · Atom feed · live.json

What changed since the census

559 websites re-checked since 2026-10-01, 112 changes recorded against the 2026-09-30 census records. Every 6 hours a rotating slice of up to 120 domains is re-fetched (homepage, robots.txt, security.txt, llms.txt; each domain at most once per 14 days); a 403, 429 or 503 to our request counts as inconclusive, not as a change.

2026-10-02 (22)

• flixcar.com: robots served → not served
• flixcart.com: reachable no → yes
• flixfacts.com: reachable no → yes
• flixster.com: hsts yes → no; links.privacy yes → no; links.accessibility yes → no; robots served → not served
• flkzwqqzl.com: links.privacy yes → no; robots served → not served
• flnet.su: reachable no → yes
• float-zone.com: reachable no → yes
• flockingchina.com: reachable no → yes
• flocktory.com: reachable no → yes
• floqast.engineering: reachable no → yes
• floragrow.ru: reachable yes → no
• floridastateparks.org: robots not served → served
• flosecurecloud.com: reachable no → yes
• flow-vps.cc: reachable no → yes
• flowapi.stream: reachable no → yes
• flowermangas.net: reachable no → yes
• flowfact-prod.cloud: reachable no → yes
• flowingdata.com: hsts no → yes; links.privacy no → yes; robots not served → served
• flowsixteen.com: reachable no → yes
• flowwow-images.com: reachable no → yes
• flowzari.info: reachable no → yes
• fluentcloud.com: reachable no → yes

2026-10-01 (90)

• fleethealth.io: reachable no → yes
• flex.ru: reachable yes → no
• flexcdn.kr: reachable no → yes
• flexecyclo.top: reachable no → yes
• flexireg.domains: reachable no → yes
• flexireg.ru: reachable no → yes
• flexjobs.com: reachable no → yes
• flexlinkspro.com: reachable no → yes
• flexwebhosting.com: reachable no → yes
• flickr.net: reachable no → yes
• flight-fare.com: links.privacy no → yes
• flightrising.com: reachable no → yes
• flip-white-list-vpn.shop: reachable no → yes
• flipkart.net: reachable no → yes
• flippback.com: reachable no → yes
• flippenterprise.net: reachable no → yes
• flippingbook.com: hsts yes → no; links.privacy yes → no; robots served → not served
• flirservices.com: reachable no → yes
• flirt4free.com: links.privacy yes → no
• flammarion.com: reachable no → yes
• flamp.ru: links.privacy no → yes; robots not served → served
• flannels.com: reachable no → yes
• flaru.com: links.privacy no → yes; robots not served → served
• flash-dash.net: reachable yes → no
• flash.net: reachable no → yes
• flashdance.cx: reachable no → yes
• flashhub.net: reachable no → yes
• flashproxy.io: links.privacy no → yes
• flashpush.net: reachable no → yes
• flashput.com: reachable no → yes
• flashrewards.co: links.privacy yes → no
• flashrpc.com: reachable no → yes
• flashspay.com: reachable no → yes
• flashsrv.com: reachable no → yes
• flashtalking.com: reachable no → yes
• flatfy.ua: reachable no → yes
• flauntmedia.net: reachable no → yes
• flava-cloud.com: reachable no → yes
• flavedo.io: reachable no → yes
• fishersci.com: reachable no → yes
• fishing-tackle.net: reachable no → yes
• fishmistakeel1te.net: reachable no → yes
• fishserver.ru: reachable no → yes
• fishservices.ru: reachable no → yes
• fishtun.com: reachable no → yes
• fiskaltrust.cloud: reachable no → yes
• fiskars.com: links.privacy yes → no
• fitonapp.com: hsts no → yes
• fitorf.ru: reachable no → yes
• fitsmallbusiness.com: links.privacy no → yes
• fivb.com: robots served → not served
• five64dmv.com: reachable no → yes
• five9-wfo.com: reachable no → yes
• fivecdm.com: reachable no → yes
• fivefoxes.co.jp: links.privacy yes → no
• fiverrcdn.com: reachable no → yes
• fix.com: links.privacy no → yes; links.accessibility no → yes
• fixpr.top: reachable no → yes
• fixtelega.co.uk: reachable no → yes
• fixuresrethink.cfd: reachable no → yes
• fizzopic.org: reachable no → yes
• fjc.gov: hsts yes → no; robots served → not served
• fjsdn.com: reachable no → yes
• fksnk.com: reachable no → yes
• fl.gov: reachable no → yes
• fl.ru: hsts no → yes; robots not served → served
• fios.tv: reachable no → yes
• firaxislive.com: reachable no → yes
• firebasedatabase.app: reachable no → yes
• firebaseio.com: reachable no → yes
• fireflyops.com: reachable no → yes
• firespringdns.com: reachable no → yes
• firestonecompleteautocare.com: hsts no → yes
• firevegas.net: reachable no → yes
• firewall-gateway.de: reachable no → yes
• first-colo.net: reachable no → yes
• first-ns.de: reachable no → yes
• firstbytedns.net: reachable no → yes
• firstbytedns.ru: reachable no → yes
• firstcoastnews.com: links.privacy yes → no; links.accessibility yes → no; security_txt not published → published
• firstcry.in: reachable no → yes
• firstcycling.com: robots not served → served
• firstfind.net: reachable no → yes
• firstheberg.net: reachable no → yes
• firsthorizon.com: reachable no → yes
• firstmedia.com: reachable no → yes
• firsts-squad.com: reachable no → yes
• firstserved.net: reachable no → yes
• firwinds.site: reachable no → yes
• fis.ru: robots served → not served

Each domain page shows its own re-check result and has a per-domain feed at https://top100k.agentexchange.work/site/<domain>.xml. Fields compared: reachable, HSTS, security.txt (contact, expires, expired, path), privacy and accessibility links, robots.txt verdicts for GPTBot, ClaudeBot, ChatGPT-User, Claude-User, Perplexity-User, Googlebot and all other bots, llms.txt.