Research

Netlify AI readiness statistics

In October 2026, we could only tell which sites run on Netlify where our scanner could read the page, so this page covers those sites and says nothing about how many turned our scanner away.

Updated 15:07 UTC · October 2026

Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.

All sites on the State of the Web

How Netlify sites land

Every page we read gets a score out of 100, the number at the top of its report (how scoring works). Each row is a range of scores. Where too few sites score in the lowest ranges, they are joined into one row.

Not enough sites yet There are not enough sites yet to split them by score.

A platform is only detectable on a page our scanner could read, so these shares are of the Netlify sites we could read.

Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.

Better or worse

Not enough history yet.

Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.

AI access

  • robots.txt disallows some AI crawlers 3%
  • robots.txt disallows major AI crawlers 0%
Show as a table
How Netlify sites treat AI crawlers
What we foundShare of sites
robots.txt disallows some AI crawlers3%
robots.txt disallows major AI crawlers0%

Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.

Every check, Netlify against all sites

Share of sites that pass each check, over the sites the check applies to. The Gap column is the difference in percentage points between the two shares; a dash means not enough sites yet.

Netlify sites against all sites: share passing each check
Check Netlify sites All sites Gap (points)
Served over a secure HTTPS connection — >99% —
HTTP redirects to HTTPS — 95% —
No mixed (insecure) content — 99% —
Core security headers are set — 8% —
Not flagged for malware or phishing — 100% —
No server version leakage — 94% —
security.txt is published — 4% —
Reached without a redirect chain — 99% —
Caching or validation headers are set — 95% —
The site settles on one host (www vs non-www) — 87% —
robots.txt is present and not over-blocking — 91% —
Not accidentally set to noindex — 99% —
This page declares its canonical URL — 59% —
Mobile viewport is set — 94% —
Has a title tag — >99% —
Title fits a search snippet — 58% —
Has a meta description — 88% —
Description fits a search snippet — 65% —
The page has an H1 — 86% —
Logical heading order — 63% —
Topic is consistent across title, H1 and description — 64% —
Images have descriptive alt text — 95% —
Your page's HTML isn't oversized — 99% —
Open Graph tags for sharing — 22% —
Twitter/X card tags — 75% —
XML sitemap is present and referenced — 76% —
Missing pages return a real 404 — 94% —
Images are optimised — 12% —
Language and charset declared — 85% —
hreflang for language variants — 99% —
Analytics is installed — 76% —
Search Console / Bing verification — 81% —
A favicon is set — 99% —
No meta-refresh redirect — >99% —
Your content survives without JavaScript — 97% —
Your answer is in the HTML — 96% —
Buttons, links and fields have names — 30% —
Semantic HTML landmarks — 50% —
Content is scannable in self-contained chunks — 94% —
Claims come with figures, quotes or sources — 55% —
Section headings are phrased as questions — 22% —
Author / publisher is clear — 50% —
A machine-readable published / updated date — 10% —
llms.txt is present and valid — 28% —
Clean content for agents (Markdown) — 4% —
Structured data is present — 56% —
Structured data is valid — 97% —
FAQ / Q&A schema — 46% —
Organization schema with sameAs — 33% —
Right schema type for the page — 94% —
Schema facts also appear in the page text — 57% —
Breadcrumb structured data — 28% —
AI crawlers aren't blocked — 93% —
Automated visitors can reach your pages — — —
Engines are allowed to quote the page — 99% —
Your page arrives quickly — 97% —
AI bot rules are explicit and intentional — 13% —
Content usage preferences declared — 4% —
Resource-discovery Link headers — 1% —
No broken links — 88% —
Links don't point at redirects — 93% —
Descriptive anchor text — 99% —
Sensible internal/external link mix — 96% —
Links are real links — 93% —
Largest Contentful Paint (LCP) — — —
Cumulative Layout Shift (CLS) — — —
Interaction to Next Paint (INP) — — —
Page weight and render-blocking — — —
MCP Server Card — 1% —
AI catalog — 1% —
A2A Agent Card — <1% —
WebMCP tools in the page — <1% —
AI usage preferences (Content-Usage) — <1% —
Licensing terms for AI (RSL) — <1% —
Text-and-data-mining reservation (TDMRep) — <1% —
Markdown version linked from the page — 1% —
Content signals agree everywhere — — —
Agent Skills index — 1% —
API catalog — 1% —
OAuth authorization-server metadata — 3% —
OAuth protected-resource metadata — 2% —
OpenID Connect discovery — 2% —
Web Bot Auth (operates a signed bot) — <1% —
Universal Commerce Protocol manifest — 7% —
Auth.md agent registration — <1% —
AI discovery via DNS — <1% —

Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.

See how your site compares

A free scan checks all of this on your page in seconds, with no signup.

Scan your site free

Want it handled? We do that too. No pitch, just a plain-English chat.

Book a call