KitScout

Categories › Web & Browser › Web search engines & search APIs

com.agentwebmap/agentwebmap

MCP serverVerified domain · agentwebmap.comRemote● LiveFree to try

Find publisher documentation via llms.txt, with source links, evidence and check dates.

Install

Remote server: your requests and data go to agentwebmap.com. Claude Code: claude mcp add --transport http agentwebmap https://agentwebmap.com/mcp · Claude app: Settings → Connectors → Add custom connector.

What it can do

The tools this server listed when we connected to it, in its own words.

  • similar_sites — Find related listed publishers by vector similarity to a known domain. Returns compact profiles, cosine similarity and actual shared section
  • list_sections — Discover publisher section labels across the indexed corpus, distinct-site counts, newly observed labels, conservative emerging signals and
  • explore_sections — Explore relationships between publisher headings. Edges count distinct listed sites sharing both labels. Pass section keys to return related
  • resolve — Start here to find documentation for a domain or development task. Returns specific page URLs with publisher excerpts, matching evidence, ow
  • directory_stats — Directory-wide counts for Agent Web Map: domains tracked, valid llms.txt files, listed, verified, pending.
  • list_countries — List country codes and names with valid listed-site counts, plus the unknown count. Use country=FR or country=unknown with resolve, search_l
  • list_categories — List topic taxonomy and counts by inferred category and agentic label, unclassified sites and publisher-declared MCP endpoints. Categories d
  • search_index_preview — Fast, non-exhaustive stored keyword preview. At most 500 candidate identities and 20 returned records; no corpus total, paid provider work o
  • search_llms_registry — Search stored domains and documentation links by words and indexed evidence. Relevance ranks before authority and ownership verification. No
  • list_domains — Ranked listing of the directory (verified first, then authority). Use verified_only to get only owner-verified sites.
  • lookup_domain — Look up a domain: source URLs, summary, authority, ownership verification, inferred country, last check and owner-stated terms. Compact by d
  • read_llms_txt — Return our validated copy of a listed site's llms.txt as text, with its source URL, check date and content hash. No second fetch needed, and
  • verification_instructions — Describe optional ownership management and its four proof methods. Call begin_ownership_claim to obtain a fresh expiring proof and a private
  • check_llms_txt — Requires tools:run via a registered integration or OAuth. Validate a site's llms.txt: reachability, HTML-instead-of-text, redirects to other
  • generate_llms_txt — Draft an llms.txt from a bounded crawl of a publisher’s public pages, sitemaps and documentation links. Uses observed headings, descriptions
  • validate_llms_txt — Check a pasted llms.txt draft in memory. Required format is separate from writing recommendations. No links are fetched, no text is saved an
  • audit_website — Requires tools:run via a free integration key or OAuth. Read a bounded public snapshot of homepage delivery, llms.txt, robots access for sea
  • check_mcp_endpoint — Requires tools:run via a free account integration key or OAuth. Inspect a public HTTPS MCP endpoint tool inventory and authentication respon
  • register_domain — Submit a public domain or announce a file update to queue a live crawl, including previously invalid tracked domains. Same-domain requests a
  • begin_ownership_claim — Start optional ownership management or recovery for a domain you control. Returns an expiring fresh public proof token and a private claim_s
  • verify_domain — Complete the fresh challenge from begin_ownership_claim using its private claim credentials. Checks the published proof and consumes the cha
  • rotate_owner_key — Owner only. Replace the API key and invalidate all existing browser owner sessions. Keep the new key; it is shown once. Does not require cha
  • update_site — Verified owner only. Control the listing profile (description, agent_summary, tags, nested llms.txt paths, contact, owner-declared publisher
  • site_stats — Verified owner only. Review measured website, REST and MCP requests, daily activity, documentation selections, publisher clicks, file health
  • recrawl_site — Verified owner only. Re-validate and update the directory listing now (once per 10 minutes). This crawl can change listing and ownership ver

KitScout test notes

Not tested by KitScout yet. When our harness runs it, pros, cons and the tasks we tried appear here, with the date and evidence.

Similar tools