Categories › Web & Browser › Web search engines & search APIs
Read public pairwise-preference rankings and their statistical quality evidence. No API key.
Remote server: your requests and data go to app.aimrank.io. Claude Code: claude mcp add --transport http aimrank https://app.aimrank.io/mcp/public · Claude app: Settings → Connectors → Add custom connector.
The tools this server listed when we connected to it, in its own words.
aimrank_get_daily_pair — Fetch today's Daily Pair — the trending matchup chosen at 00:00 UTC. Pairs with the `vote_of_the_day` agent template. Returns the challenge aimrank_get_ranking — Fetch a ranking's metadata + its top 25 entities. Entities carry a Bradley-Terry rating with a 95% interval (ci_95) and a tie-aware rank: enaimrank_get_leaderboard — Get the top N entities of a ranking with honest uncertainty. Ratings come from a Bradley-Terry fit over the counted votes, each with a 95% iaimrank_get_matchup — Get the next pair of entities to evaluate. Strategies: adaptive (default), swiss, balanced, random, uncertainty, explore, information_gain, aimrank_search_entities — Find entities by name substring within a ranking. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.aimrank_create_share_card — Return share-ready URLs + embed snippets for a ranking. Formats: "all" (default — everything), "twitter", "linkedin", "embed_leaderboard", "aimrank_predict_matchup_winner — Predict a matchup's winner from the current ratings -- for analysis. Uses Glicko-2 win probability under the same formula matchmaking uses iaimrank_discover_public_rankings — Browse public rankings — agent equivalent of surfing aimrank.io. Filters: category, media_type ("text" | "image" | "audio" | "video"), sort aimrank_list_domain_entities — List all entities in a domain's pool sorted by rating. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.aimrank_get_domain — Get domain details including entity pool and competition list. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refuaimrank_list_competitions — List all competitions (open voting + brackets) in a domain. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refusedaimrank_get_data_card — Auto data card — Layer 7. Provenance + IAA + coverage + per-annotator quality + transitivity + qualification stats in one synthesized markdoaimrank_get_agreement — Inter-annotator agreement — Layer 4. Returns Cohen's κ (n=2 raters), Fleiss' κ, Krippendorff's α, Scott's π + Landis-Koch interpretation, plaimrank_get_ceiling — Pairwise-κ ceiling from qualification attempts. The upper bound any judge / RM can credibly hit on this domain — used to pin the L3 pilot reaimrank_get_plackett_luce — Plackett-Luce listwise ranking aggregation — OFFLINE AUDIT ONLY. Reported post-hoc; it NEVER writes ratings, and setting it as a ranking's aaimrank_get_crowd_bt — CrowdBT — joint fit of entity scores + per-annotator reliability η. Surfaces noisy / anti-correlated raters explicitly. Methodology audit, naimrank_list_public_judges — Browse public judge-prompt artifacts shared by other users. Filter by ``category`` (free-text), ``domain_id``, or both. Sort options: ``forkaimrank_find_similar_domains — Find public domains most similar to a query or a known domain. Use ``query`` for free-text search ("pharma evaluation") OR ``domain_id`` to aimrank_predict — iCOMPLY contract: pairwise prediction with provenance fields. Returns the engine's predicted winner + probability shaped so iCOMPLY's Annex aimrank_explain — iCOMPLY contract: explain a prediction in features + narrative. Returns the Glicko-2 μ/φ inputs for both entities + a deterministic narrativaimrank_healthcheck — iCOMPLY contract: liveness + DB-connectivity probe.Not tested by KitScout yet. When our harness runs it, pros, cons and the tasks we tried appear here, with the date and evidence.