Home/Notes/A practical look at robots.txt for a language school

A practical look at robots.txt for a language school

28 Feb 2025

How a language school deals with robots.txt — and what usually goes wrong.

Googlebot crawls site robots.txt allow / block Sitemap page list Pages robots.txt Google Index ranked robots.txt an inbox shared…

The problem: an inbox shared between the office and the webmaster. This breaks robots.txt for a language school.

There is a difference between a site that loads and a site that works. robots.txt is part of the second category for a language school.

The best robots.txt setup is the one nobody has to think about. For a language school, that means auto-renew, auto-redirect, and a monitoring ping every four hours.

HTTPS is table stakes, but robots.txt is where trust actually lives for a language school. A padlock with a misconfigured record behind it is decoration, not security.

Our own site had an inbox shared between the office and the webmaster for three days before a colleague noticed. We added it to the pre-launch checklist the same afternoon.

Search consoles like honest sitemaps. Every loc should be a document. Reserving ten thousand empty shells and hoping Google does not notice is not a strategy for robots.txt.

We document robots.txt in a shared spreadsheet. It is not glamorous, but a language school can open it on their phone at midnight if something breaks.

More notes

Related notes

Tell us what you need.

Write a few lines about your project. We reply within one working day, usually with questions and a rough estimate.

hello@digitalserved.com