Top 100,000 websites census · by tld family · fetched 2026-09-30

com: accessibility statements, security.txt and AI crawler rules of 45,411 websites (census 2026-09)

2,300 of the 36,850 reachable websites of tld family "com" (6.2%) link an accessibility statement from the homepage; 3,067 publish a security.txt; 3,445 block GPTBot in robots.txt. 45,411 websites in the list, 36,850 reachable over HTTPS on 2026-09-30.

Accessibility statement linked

6.2%

2,300 of 36,850 reachable

security.txt

8.3%

3,067 of 36,850 reachable

Block GPTBot

3,445

robots.txt disallows GPTBot for the whole site

HSTS

46.7%

17,223 of 36,850 reachable

Privacy policy linked

35.1%

12,928 of 36,850 reachable

Domains (first 200 of 45,411, by rank)

Domain	Accessibility statement	security.txt	Blocks GPTBot	Privacy policy	HSTS
google.com	no	yes	no	yes	no
cloudflare.com	no	yes	no	no	yes
facebook.com	no	yes	no	no	yes
gstatic.com	no	no	yes	no	no
googleapis.com	no	no	no	no	no
amazonaws.com	no	yes	no	no	yes
microsoft.com	yes	yes	no	yes	yes
youtube.com	no	yes	no	no	yes
apple.com	yes	yes	no	yes	yes
instagram.com	no	no	yes	no	yes
twitter.com	yes	yes	yes	yes	yes
linkedin.com	no	no	no	no	yes
googlevideo.com	no	no	yes	no	no
googletagmanager.com	no	no	no	no	no
office.com	yes	no	no	yes	yes
live.com	no	no	no	no	yes
hicloudcam.com	no	yes	no	yes	no
amazon.com	no	yes	yes	no	yes
azure.com	no	no	no	no	yes
github.com	no	yes	no	no	yes
appsflyersdk.com	no	no	no	no	no
bing.com	no	no	no	no	yes
googleusercontent.com	no	no	no	no	no
netflix.com	no	yes	no	no	yes
digicert.com	no	yes	no	no	yes
x.com	yes	yes	yes	yes	yes
skype.com	no	no	no	yes	yes
icloud.com	no	no	no	no	yes
pinterest.com	no	no	yes	no	yes
tiktok.com	no	no	yes	no	yes
whatsapp.com	no	yes	yes	yes	yes
googledomains.com	no	no	no	yes	no
yahoo.com	no	yes	yes	no	yes
googlesyndication.com	no	yes	no	yes	no
roblox.com	no	yes	no	no	yes
spotify.com	no	no	yes	no	yes
adobe.com	no	yes	no	no	yes
msn.com	no	no	yes	no	yes
qq.com	no	no	no	yes	no
baidu.com	no	no	yes	no	no
chatgpt.com	no	yes	yes	no	yes
cloudflare-dns.com	no	no	no	yes	no
tiktokv.com	no	no	no	no	yes
vimeo.com	no	yes	yes	no	yes
openai.com	no	yes	no	no	yes
opera.com	no	yes	no	yes	yes
f5.com	no	no	no	no	yes
nginx.com	no	yes	no	yes	yes
windows.com	yes	yes	no	yes	yes
samsung.com	no	no	no	no	yes
wordpress.com	yes	yes	no	yes	yes
blogspot.com	no	no	no	yes	no
yuga.com	no	no	no	no	no
reddit.com	no	yes	yes	no	yes
ui.com	no	yes	no	no	yes
office365.com	no	no	no	no	no
amazonvideo.com	no	no	no	no	yes
google-analytics.com	no	no	yes	yes	no
outlook.com	no	no	no	no	yes
registrar-servers.com	no	no	yes	no	no
app-analytics-services.com	no	no	no	no	no
epicgames.com	no	yes	no	no	yes
app-measurement.com	no	no	no	no	no
snapchat.com	no	yes	yes	yes	yes
triplinkintl.com	no	no	no	no	no
dropbox.com	yes	yes	no	no	yes
intuit.com	no	no	no	no	yes
criteo.com	no	yes	no	no	yes
unity3d.com	no	no	no	no	no
kaspersky.com	no	no	no	yes	yes
aliyuncs.com	no	no	no	no	no
godaddy.com	no	no	no	no	no
afternic.com	no	no	no	yes	yes
gravatar.com	no	no	yes	yes	yes
tumblr.com	no	yes	no	yes	yes
nytimes.com	no	yes	yes	no	yes
xiaomi.com	no	no	no	no	no
hichina.com	no	no	no	no	yes
webex.com	no	no	no	no	yes
discord.com	no	yes	no	yes	yes
applovin.com	no	no	no	no	yes
paypal.com	no	yes	no	yes	yes
shopify.com	no	yes	no	no	yes
hosting24.com	no	yes	no	no	no
macromedia.com	no	yes	no	no	yes
paytmfirstgames.com	no	no	no	no	yes
flickr.com	no	yes	yes	yes	no
soundcloud.com	no	yes	yes	no	yes
googleadservices.com	no	no	no	no	no
medium.com	no	no	yes	no	yes
cnn.com	no	no	yes	no	no
theguardian.com	no	yes	no	no	yes
ebay.com	no	no	yes	no	yes
adsafeprotected.com	no	yes	no	no	no
oracle.com	no	no	no	no	no
youtube-nocookie.com	no	no	no	no	yes
android.com	no	no	no	yes	no
rubiconproject.com	yes	no	no	yes	no
forbes.com	no	no	yes	no	yes
bbc.com	no	yes	yes	no	yes
ubuntu.com	no	no	no	yes	yes
vungle.com	no	no	no	yes	no
sciencedirect.com	no	no	yes	no	yes
taboola.com	no	no	no	yes	yes
cisco.com	yes	yes	no	yes	yes
stripe.com	no	yes	no	yes	yes
scorecardresearch.com	no	no	no	yes	yes
canva.com	no	yes	yes	no	yes
alidns.com	no	yes	no	no	yes
meraki.com	yes	yes	no	yes	yes
gmail.com	no	no	no	no	yes
pubmatic.com	no	no	no	no	yes
roku.com	yes	yes	no	yes	yes
hubspot.com	no	yes	no	no	yes
adnxs.com	no	no	no	no	no
imdb.com	no	no	yes	no	yes
hcaptcha.com	yes	no	no	yes	yes
wixsite.com	no	yes	no	no	yes
forter.com	no	no	no	yes	yes
crashlytics.com	no	no	no	no	yes
booking.com	no	yes	no	no	yes
samsungcloud.com	no	no	no	no	no
namecheap.com	no	no	no	no	yes
ibm.com	no	yes	no	no	yes
mtgglobals.com	no	no	no	no	no
appsflyer.com	no	no	no	yes	yes
reuters.com	no	yes	yes	no	no
dnsmadeeasy.com	no	no	no	yes	yes
salesforce.com	no	no	no	no	yes
mzstatic.com	yes	yes	no	yes	yes
springer.com	no	no	no	no	no
tinyurl.com	no	no	no	no	yes
hp.com	no	yes	no	no	yes
autodesk.com	no	no	no	no	yes
nature.com	yes	no	yes	yes	yes
googleblog.com	no	no	no	no	no
steampowered.com	no	no	no	yes	yes
inmobi.com	no	no	no	no	no
weibo.com	no	no	no	no	yes
amplitude.com	no	yes	no	yes	yes
alibaba.com	no	no	yes	no	yes
avast.com	no	no	no	no	no
weather.com	yes	yes	no	yes	yes
dell.com	no	yes	no	yes	yes
wiley.com	no	yes	no	no	yes
shalltry.com	no	no	no	no	no
aliyun.com	no	no	no	no	yes
etsy.com	no	yes	no	no	no
hostinger.com	no	yes	no	no	no
mi.com	no	no	no	no	no
name.com	no	no	no	no	no
bilibili.com	no	no	no	no	no
weebly.com	no	no	no	yes	no
mozilla.com	no	yes	no	yes	yes
ip-api.com	no	no	no	no	no
arubanetworks.com	no	no	no	no	no
doubleverify.com	yes	no	no	yes	yes
myshopify.com	no	no	no	no	no
ea.com	no	no	no	yes	yes
naver.com	no	no	yes	no	yes
slack.com	yes	yes	no	yes	yes
trustpilot.com	no	yes	no	no	no
checkpoint.com	no	yes	no	yes	yes
opendns.com	no	no	no	yes	yes
tradingview.com	yes	yes	no	no	yes
gitlab.com	no	no	no	yes	yes
hostgator.com	no	no	no	no	no
zendesk.com	no	yes	no	no	yes
nvidia.com	no	no	no	no	no
tp-link.com	no	no	no	yes	yes
issuu.com	no	yes	no	yes	yes
bloomberg.com	no	yes	yes	no	yes
wsj.com	no	no	no	no	no
datadoghq.com	no	yes	no	no	yes
plesk.com	no	yes	no	no	yes
calendly.com	no	yes	no	no	yes
yandex.com	no	yes	no	no	no
amazontrust.com	no	no	no	yes	yes
espn.com	no	no	yes	yes	no
expireddomains.com	no	no	no	no	no
indeed.com	no	no	no	no	no
kwai-pro.com	no	no	no	no	no
globo.com	no	no	yes	no	no
unsplash.com	no	yes	no	no	yes
163.com	no	no	no	no	no
brave.com	no	yes	no	yes	yes
aliexpress.com	no	no	no	no	no
dropcatch.com	no	no	no	no	no
go.com	no	no	yes	yes	no
netease.com	no	no	no	no	no
vivoglobal.com	no	no	no	no	no
dailymotion.com	no	yes	no	yes	yes
steamcommunity.com	no	no	no	yes	no
temu.com	no	no	no	yes	yes
huawei.com	no	yes	no	yes	no
supercell.com	yes	yes	no	yes	no
intel.com	no	yes	no	yes	yes
taobao.com	no	no	no	no	yes
paloaltonetworks.com	no	no	no	no	yes
kwaipros.com	no	no	no	no	no

Domain

Accessibility statement

security.txt

Blocks GPTBot

HSTS

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

googleusercontent.com

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

googlesyndication.com

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

registrar-servers.com

yes

app-analytics-services.com

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

scorecardresearch.com

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

yes

"Accessibility statement" and "privacy policy" mean a link found on the homepage on 2026-09-30; n/a marks sites that did not answer over HTTPS. Every domain links to its record with what to fix, a JSON twin, a badge and a changes feed.