KitScout

Categories › Web & Browser › Scraping, crawling & page-to-text

Agentwatch

MCP serverVerified domain · comiza.lightingRemote● LiveFree to try

Check if ChatGPT, Claude and Perplexity can reach, read and quote a website.

Install

Remote server: your requests and data go to comiza.lighting. Claude Code: claude mcp add --transport http agentwatch https://comiza.lighting/agentwatch/mcp · Claude app: Settings → Connectors → Add custom connector.

What it can do

The tools this server listed when we connected to it, in its own words.

  • check_site — Fetch a website the way ChatGPT, Claude, Perplexity, Google and Copilot fetch it, and report what stops them. Checks robots.txt per crawler
  • verify_crawler_visit — Given the IP address and User-Agent from a log line, say whether that visit really came from the crawler it claims to be. Checks the address
  • verify_signed_request — Verify a Web Bot Auth signature (RFC 9421, Ed25519) on a captured request. Unlike an address check, this proves who sent that exact request:
  • list_ai_crawlers — The robots.txt tokens used by the major assistants, separated by purpose: the ones that build the index answers come from, the ones that fet

KitScout test notes

Not tested by KitScout yet. When our harness runs it, pros, cons and the tasks we tried appear here, with the date and evidence.

Similar tools