Robots.txt tester

Paste your address. We read your robots.txt, tell you if it blocks search engines, and let you test any page against Google, Bing and the main AI crawlers.

Free. No sign-up. We only read the public page.

What it does

Robots.txt tester

Whether Googlebot can reach your home page
Whether a page you choose is allowed or blocked, bot by bot
Sitemap lines inside robots.txt
Rules that block scripts and styles

What is robots.txt?

A small text file at the root of your site that tells crawlers which areas they may visit.

Does robots.txt hide a page from Google?

Not always. It stops crawling. To keep a page out of search, use a noindex tag.

More free tools

Sitemap checkerFind your sitemap and check that it is healthy.Crawlability testCan search engines reach and index the page?HTTP header checkerStatus, security headers, compression and caching.

See all 15 free tools