Categories › Web & Browser › Web search engines & search APIs
Find publisher documentation via llms.txt, with source links, evidence and check dates.
Remote server: your requests and data go to agentwebmap.com. Claude Code: claude mcp add --transport http agentwebmap https://agentwebmap.com/mcp · Claude app: Settings → Connectors → Add custom connector.
The tools this server listed when we connected to it, in its own words.
similar_sites — Find related listed publishers by vector similarity to a known domain. Returns compact profiles, cosine similarity and actual shared sectionlist_sections — Discover publisher section labels across the indexed corpus, distinct-site counts, newly observed labels, conservative emerging signals and explore_sections — Explore relationships between publisher headings. Edges count distinct listed sites sharing both labels. Pass section keys to return relatedresolve — Start here to find documentation for a domain or development task. Returns specific page URLs with publisher excerpts, matching evidence, owdirectory_stats — Directory-wide counts for Agent Web Map: domains tracked, valid llms.txt files, listed, verified, pending.list_countries — List country codes and names with valid listed-site counts, plus the unknown count. Use country=FR or country=unknown with resolve, search_llist_categories — List topic taxonomy and counts by inferred category and agentic label, unclassified sites and publisher-declared MCP endpoints. Categories dsearch_index_preview — Fast, non-exhaustive stored keyword preview. At most 500 candidate identities and 20 returned records; no corpus total, paid provider work osearch_llms_registry — Search stored domains and documentation links by words and indexed evidence. Relevance ranks before authority and ownership verification. Nolist_domains — Ranked listing of the directory (verified first, then authority). Use verified_only to get only owner-verified sites.lookup_domain — Look up a domain: source URLs, summary, authority, ownership verification, inferred country, last check and owner-stated terms. Compact by dread_llms_txt — Return our validated copy of a listed site's llms.txt as text, with its source URL, check date and content hash. No second fetch needed, andverification_instructions — Describe optional ownership management and its four proof methods. Call begin_ownership_claim to obtain a fresh expiring proof and a privatecheck_llms_txt — Requires tools:run via a registered integration or OAuth. Validate a site's llms.txt: reachability, HTML-instead-of-text, redirects to othergenerate_llms_txt — Draft an llms.txt from a bounded crawl of a publisher’s public pages, sitemaps and documentation links. Uses observed headings, descriptionsvalidate_llms_txt — Check a pasted llms.txt draft in memory. Required format is separate from writing recommendations. No links are fetched, no text is saved anaudit_website — Requires tools:run via a free integration key or OAuth. Read a bounded public snapshot of homepage delivery, llms.txt, robots access for seacheck_mcp_endpoint — Requires tools:run via a free account integration key or OAuth. Inspect a public HTTPS MCP endpoint tool inventory and authentication responregister_domain — Submit a public domain or announce a file update to queue a live crawl, including previously invalid tracked domains. Same-domain requests abegin_ownership_claim — Start optional ownership management or recovery for a domain you control. Returns an expiring fresh public proof token and a private claim_sverify_domain — Complete the fresh challenge from begin_ownership_claim using its private claim credentials. Checks the published proof and consumes the charotate_owner_key — Owner only. Replace the API key and invalidate all existing browser owner sessions. Keep the new key; it is shown once. Does not require chaupdate_site — Verified owner only. Control the listing profile (description, agent_summary, tags, nested llms.txt paths, contact, owner-declared publishersite_stats — Verified owner only. Review measured website, REST and MCP requests, daily activity, documentation selections, publisher clicks, file healthrecrawl_site — Verified owner only. Re-validate and update the directory listing now (once per 10 minutes). This crawl can change listing and ownership verNot tested by KitScout yet. When our harness runs it, pros, cons and the tasks we tried appear here, with the date and evidence.