SeenLens Lab test page
This page exists to test AI readiness checks. SeenLens uses it in demo videos: we change one setting, such as a robots.txt rule or a firewall rule, scan the page, fix the setting and scan again. The box below shows the current setup, so every result in a video can be checked against it.
Current setup
Baseline: no known problems
Every AI crawler may fetch this page. The server answers every client the same way. llms.txt, Content-Signal, JSON-LD and a Markdown version are in place.
Set on .
What this page tests
- Whether AI crawlers such as GPTBot, OAI-SearchBot, ClaudeBot and PerplexityBot may fetch the page under robots.txt.
- Whether the server gives AI crawlers the same answer that it gives a browser.
- Whether the page publishes the signals AI tools read: an llms.txt file, a Content-Signal line, JSON-LD and a Markdown version.
Why a test page
A demo needs a page with a known problem. We do not show other people's websites, so we break and fix our own. You can scan any page for free at seenlens.com, and How it works lists every check.
By SeenLens ยท Last updated