Skip to main content

Free tool · No signup

Is your website blocking AI from recommending you?

When someone asks ChatGPT or Perplexity for the best business like yours, it can only recommend sites its crawler is allowed to read. We found big South African brands quietly blocking those crawlers at the server — while their robots.txt said everything was fine. The standard SEO check misses it. This one doesn’t: we fetch your site as each AI crawler and show you what comes back.

A buyer asks ChatGPT

Which firms should I consider for my business?

The assistant recommends the competitors whose pages it could fetch and read — and leaves out your site, because the crawler never got in.

If your server quietly blocks AI crawlers, this is the result: you’re absent from the answer, and nothing tells you. The check below shows what each crawler actually sees.

Checked acrossChatGPT · Claude · Perplexity · Gemini

We fetch your homepage as each AI crawler and compare it to a normal browser — the same test the SA AI Visibility Index runs. No signup. Takes ~15 seconds.

This is the same crawler test behind the SA AI Visibility Index — our public study of how AI assistants answer for South African brands. See exactly how we test →

Why this matters

Being readable is necessary, not sufficient — it’s one of seven rules we found by dissecting thousands of real AI answers about South African businesses across property, banking and crypto. The others: AI treats each engine as a different race, rewards the sources it already trusts, prefers pages that answera question over pages that list your address, and cares far less about schema markup than the GEO playbook claims. Crawlability is just the cheapest one to fix — usually a one-line change, once you know to look.

See where your brand actually stands across all four engines →