Crawler information

Our crawler reads the public pages of school and academy trust websites in England to check what they publish online. This page explains what it does and how to block it.

How to recognise it

It identifies itself with this user agent:

website-compliance-audit/0.2.0 (UK schools website audit; public pages only; robots.txt honoured; 1 req/s; https://evidentschools.com/crawler/)

The version number changes when we update the crawler. Some pages are loaded in a standard headless browser so that content built by scripts can be read. The headless browser sends the same user agent.

What it does

What it never does

How to block it

Add this to your robots.txt:

User-agent: website-compliance-audit
Disallow: /

Or email hello@evidentschools.com with your website address and we'll stop checking it.