← All terms

Statisticalsignificance

A measure of how unlikely a test result would be if there were truly no difference.

Growth Score · Activation

Definition

What it means

A result is called significant when the chance of seeing it by luck alone falls below a chosen threshold, often five percent. It does not say the effect is large or important.

Stopping a test the moment it looks significant inflates false wins.

Activation

Why it matters, with an example

It stops you shipping a change because of a result that luck could have produced.

For example: With a 5% threshold, a result that would appear by luck 3% of the time counts as significant, and one that would appear 12% of the time does not.

In Growth Score

Part of your score

Go deeper

Guides that cover it

Checkout audit: 12 leaksTwelve places a sale leaks, in cost order, with a test and a fix for each one.When to redesign your siteHow to tell a real redesign need from vanity, and how to do it without losing rankings.Fast for real visitorsRead real visits, then fix images, scripts, layout shifts and the slow start.

Activation

More in Activation

FAQ

Quick answers

What is Statistical significance?

A measure of how unlikely a test result would be if there were truly no difference.

Where does it sit in Growth Score?

It belongs to the Activation pillar, one of the 12 pillars your score is built from.

What should I read next?

Start with A/B testing and Sample size, then browse the other terms in Activation.

Browse

Nearby in the A to Z

PreviousSPFNextStructured data

How does your site score?

Growth Score reads your site and scores its Activation pillar against sites like yours.

Test your siteAll terms

Your Growth Score is 100

Your next fix is waiting in your dashboard.

Open your Growth ScoreOpen dashboard