CrawlabilityWhat it means for you.

How easily a search engine's bots can reach and read the pages of your site.

Growth Score · Acquisition

Definition

What it means

A page is crawlable when bots can request it and follow links to its neighbors. txt, broken links, login walls and heavy scripts can all stop a crawl.

Crawlability comes first: a page that is not crawled cannot be indexed.

In Growth Score

Part of your score

Test your site

Test it

Checks that read it on your site

Robots.txt testerReads the one file that can remove an entire site from search and tells you what it is really doing: what it blocks, what it lets through, and what it forgot to say.Sitemap.xml checkerReads the list you hand search and finds what is wrong with it: http addresses, pages listed twice, carts and tag archives, and dates that are all the build time.

Go deeper

Guides that cover it

Search for a new siteWhat moves a new domain, in what order, and what to skip so early effort is not wasted.Your first 100 customersFour zero-spend channels, run one at a time, each read in two weeks.Get pages found in searchSix checks in the order search meets them, from robots.txt through to indexing.

Acquisition

More in Acquisition

FAQ

Quick answers

What is Crawlability?

How easily a search engine's bots can reach and read the pages of your site.

Where does it sit in Growth Score?

It belongs to the Acquisition pillar, one of the 12 pillars your score is built from.

What should I read next?

Start with robots.txt and Crawl budget, then browse the other terms in Acquisition.

Browse

Nearby in the A to Z

PreviousCrawl budget NextCritical rendering path

How does your site score?

Growth Score reads your site and scores its Acquisition pillar against sites like yours.

Test your site All terms

Your Growth Score is 100

Your next fix is waiting in your dashboard.

Open your Growth Score Open dashboard