Categories › AI & Agents › Thinking, planning & prompt tools
Run AI evaluations, record agent traces and gate releases on evidence, with scoped org access.
Remote server: your requests and data go to www.evalgate.com. Claude Code: claude mcp add --transport http evalgate https://www.evalgate.com/api/mcp · Claude app: Settings → Connectors → Add custom connector.
The tools this server listed when we connected to it, in its own words.
project_inspect — Snapshot the evaluations and project keys in the authenticated organization. Use it first to orient in an unfamiliar workspace or to resolveproject_plan — Plan the next steps for connecting a repository, reviewing an evaluation, or ingesting traces. Use it when deciding what to set up next. Retevaluations_list — List the organization's evaluations, optionally filtered by lifecycle status. Use it to find an evaluationId before calling runs_list or basruns_list — List the runs of one evaluation, newest first, optionally filtered by status. Use it to find a runId or check recent results and regression run_explain — Explain why one run passed or failed. Use it after runs_list when you need the failing cases and where the evidence came from. Returns the rbaseline_lineage — Show which run is the published baseline for an evaluation and where its evidence came from. Use it before comparing a new run against the bdocs_search — Search EvalGate's public REST API operations by keyword. Use it to find the right endpoint before writing an API call. Returns matching operconnector_health — Show the latest persisted connector-readiness reports, optionally for one connector. Use it to check whether an integration was set up and sconnections_list — List the workspace's current connections with their source restrictions and freshness. Use it to see what is already connected before planniconnections_catalog — Inspect every connector definition and its exact installed setup path. Use it to choose a connector or find how to install one. Returns connconnections_roots — Page through the configured account roots (top-level connected accounts) using current administrator authority. Use it to audit which accounconnections_graph — Read how connections link to resources: canonical connection references and the exact resource revisions currently visible. Use it to trace Not tested by KitScout yet. When our harness runs it, pros, cons and the tasks we tried appear here, with the date and evidence.