KitScout

Categories › Software Development › Testing & QA

analyze-exports

SkillInstall · skills CLI

Analyze tau2-bench task export files to identify exactly where and why tasks failed. Map failures to specific conversation rounds, show root causes, check whether relevant documentation was available, and cite sources. Use this skill whenever you need to debug a tau2-bench evaluation, understand why an agent made wrong decisions, identify missing knowledge, or review task performance—especially when context length, eligibility criteria, or policy compliance might be at fault.

Install

KitScout test notes

Not tested by KitScout yet. When our harness runs it, pros, cons and the tasks we tried appear here, with the date and evidence.

Similar tools

  • rea-analysis-optimization 456,474 ★
    Optimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserv
  • rea-ci-tests-audit 456,474 ★
    Audit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for s
  • diagnosing-bugs 323,337 ★
    Diagnosis loop for hard bugs and performance regressions. Use when the user says "diagnose"/"debug this", or r
  • migrate-to-shoehorn 323,337 ★
    Migrate test files from `as` type assertions to @total-typescript/shoehorn. Use when user mentions shoehorn, w
  • webapp-testing 194,218 ★
    Toolkit for interacting with and testing local web applications using Playwright. Supports verifying frontend