KitScout

Categories › AI & Agents › Models, LLM APIs, routing, serving, training & GPUs

BenchGecko

MCP serverVerified domain · benchgecko.aiRemote● LiveFree to try

AI model prices per provider, benchmarks, own AI behavior tests and AI economy data, with sources.

Install

Remote server: your requests and data go to benchgecko.ai. Claude Code: claude mcp add --transport http benchgecko https://benchgecko.ai/api/mcp · Claude app: Settings → Connectors → Add custom connector.

What it can do

The tools this server listed when we connected to it, in its own words.

  • search_models — Find AI models in the BenchGecko catalog by name, slug or lab. Returns slugs to use with get_model, cheapest_provider and compare_models, wi
  • get_model — Core facts for one AI model: BenchGecko score and rank, list price, price at every provider, benchmark scores with their original sources, G
  • cheapest_provider — Every provider serving a model, sorted by input price per 1M tokens (refreshed daily from provider endpoints), with output price, quantizati
  • compare_models — Side by side: BenchGecko score, list price, cheapest provider, context window, shared benchmark scores and Gecko Tests grades for two models
  • get_gecko_test — Results of one of BenchGecko's own tests (own measurements, CC BY 4.0): who-are-you (Does the model know which lab made it?) world-map (How
  • get_scorecard — BenchGecko Gecko Scorecard: every model across BenchGecko's own profile tests with a letter grade per test and an overall Gecko Score (behav
  • latest_findings — Latest notable results detected in the Gecko Tests and price data (fixed rules, numbers and quotes from stored results).
  • search — Search BenchGecko models and Gecko Tests. Returns ids for fetch.
  • fetch — Fetch the full record for an id returned by search (model:<slug>, gecko-test:<slug> or scorecard).

KitScout test notes

Not tested by KitScout yet. When our harness runs it, pros, cons and the tasks we tried appear here, with the date and evidence.

Similar tools

  • academy-guide 194,218 ★
    Stop and check this skill before finishing any reply to a question about how to use Claude or a Claude product
  • claude-api 194,218 ★
    Reference for the Claude API / Anthropic SDK — model ids, pricing, params, streaming, tool use, MCP, agents, c
  • ccs-align 116,897 ★
    Run the CCS Align seat's hourly breathing cycle — prove the local claude-mem worker is healthy, pull needle ob
  • mode-creator
  • html-ppt-hermes-cyber-terminal