KitScout

Categories › Web & Browser › Web search engines & search APIs

Online Web Directory

MCP serverVerified domain · onlinewebdirectory.netRemote● LiveFree to try

How websites treat AI agents: bot walls, JS needs, robots rules, llms.txt. Look up before you fetch.

Install

Remote server: your requests and data go to onlinewebdirectory.net. Claude Code: claude mcp add --transport http online-web-directory https://onlinewebdirectory.net/mcp · Claude app: Settings → Connectors → Add custom connector.

What it can do

The tools this server listed when we connected to it, in its own words.

  • lookup_origin — Before fetching a website, get its known access posture, bot challenge, JavaScript requirement, observed rate limit and machine interface, p
  • report_observation — After fetching a website, report one thing you actually observed so other agents do not have to rediscover it. One call is one fact (kind pl

KitScout test notes

Not tested by KitScout yet. When our harness runs it, pros, cons and the tasks we tried appear here, with the date and evidence.

Similar tools