Categories › Web & Browser › Scraping, crawling & page-to-text
Free check whether a website is technically open to AI assistants (AI crawlers, llms.txt, JSON-LD).
Remote server: your requests and data go to feelswebman.com. Claude Code: claude mcp add --transport http geo-bot https://feelswebman.com/projects/geo-bot/mcp.php · Claude app: Settings → Connectors → Add custom connector.
The tools this server listed when we connected to it, in its own words.
check_ai_readiness — Checks whether a website is technically open to AI assistants: robots.txt rules for 9 AI crawlers (GPTBot, OAI-SearchBot, ChatGPT-User, ClauNot tested by KitScout yet. When our harness runs it, pros, cons and the tasks we tried appear here, with the date and evidence.