Categories › Web & Browser › Scraping, crawling & page-to-text
Free AI-readiness audit of any URL: AI crawler rules, JS-free text, JSON-LD, llms.txt. Tool catalog.
Remote server: your requests and data go to agentbuilt.dev. Claude Code: claude mcp add --transport http agentbuilt https://agentbuilt.dev/api/mcp · Claude app: Settings → Connectors → Add custom connector.
The tools this server listed when we connected to it, in its own words.
audit_ai_readiness — Free. Fetches a URL and reports how readable it is to AI assistants and agents: whether GPTBot, ClaudeBot, PerplexityBot, Google-Extended anlist_agentbuilt_tools — Free. Returns the agentbuilt catalog of pay-per-result data tools for AI pipelines — what each one does, when to use it, what it explicitly request_visibility_audit — Requests the free human-readable audit: agentbuilt asks real buyer questions to ChatGPT, Perplexity, Gemini and Claude and emails back a repNot tested by KitScout yet. When our harness runs it, pros, cons and the tasks we tried appear here, with the date and evidence.