paper-autoraters

Run the four paper-quality autoraters from PaperOrchestra (arXiv:2604.05018, App. F.3) — Citation F1 (P0/P1 partition + Precision/Recall/F1), Literature Review Quality (6-axis 0-100 with anti-inflation rules), SxS Overall Paper Quality (side-by-side), and SxS Literature Review Quality (side-by-side). TRIGGER when the user asks to "score this paper draft", "evaluate against the benchmark", "compare two papers", or "run the autoraters".

Install

KitScout test notes

Not tested by KitScout yet. When our harness runs it, pros, cons and the tasks we tried appear here, with the date and evidence.

Similar tools

• wait-what
• karpathy-guidelines 232,934 ★
  Behavioral guidelines to reduce common LLM coding mistakes. Use when writing, reviewing, or refactoring code t
• discernment-nudge 194,218 ★
  After you give a substantive answer or draft that the user may act on — advice or recommendations, drafted art
• timeline-report
• weekly-digests