Categories › Web & Browser › Scraping, crawling & page-to-text
Check if a website will block your AI agent and find its llms.txt, MCP or OpenAPI door.
Remote server: your requests and data go to accesscheck.cloudforbots.com. Claude Code: claude mcp add --transport http agent-access-check https://accesscheck.cloudforbots.com/mcp · Claude app: Settings → Connectors → Add custom connector.
The tools this server listed when we connected to it, in its own words.
check_agent_access — Before an agent browses or fetches a site, check if it will get in. Fetches the URL as an AI agent and as a browser, detects bot challenges find_agent_alternative — Find a machine-friendly way into a site instead of scraping its HTML: llms.txt, /.well-known/mcp.json, agents.json, openapi.json, ai-plugin.check_many — Run check_agent_access on up to 10 URLs at once (counts as 1 call). Use it to pick which sources an agent can actually use.usage_and_upgrade — Show today's usage for your key or IP and the $9/month upgrade link. Free tier: 50 calls/day. Not metered.Not tested by KitScout yet. When our harness runs it, pros, cons and the tasks we tried appear here, with the date and evidence.