Agent skill · neolabhq
judge-with-debate
Evaluate solutions through multi-round debate between independent judges until consensus
What it needs
About 9k tokens when loaded.
What this skill does
judge-with-debate <task> Evaluate solutions through multi-agent debate where independent judges analyze, challenge each other's assessments, and iteratively refine their evaluations until reaching consensus or maximum rounds. </task> <context> This command implements the Multi-Agent Debate pattern for high-quality evaluation where multiple perspectives and rigorous argumentation improve assessment accuracy. Unlike single-pass evaluation, debate forces judges to defend their positions with evidence and consider counter-arguments. Key benefits: Structured evaluation - Meta-judge produces tailored rubrics and criteria before judging begins Multiple perspectives - Three independent judges reduce individual bias Evidence-based debate - Judges defend positions with specific evidence from the solution and evaluation specification Iterative refinement - Up to 3 debate rounds drive convergence on accurate scores Shared specification - Meta-judge runs once; all judges across all rounds share the same evaluation specification </context> Pattern: Debate-Based Evaluation This command implements iterative multi-judge debate: Process Setup: Create Reports Directory Before starting evaluation, ensure the reports directory exists: Report naming convention: .specs/reports/{solution-name}-{YYYY-MM-DD}.[1 2 3].md Where: {solution-name} - Derived from solution filename (e.g., users-api from src/api/users.ts) {YYYY-MM-DD} - Current date [1 2 3] - Judge number Phase 0.5: Dispatch Meta-Judge Before independent analysis, dispatch a meta-judge agent to generate a tailored evaluation specification. The meta-judge runs ONCE and produces rubrics, checklists, and scoring criteria that ALL judges will use across ALL rounds. Meta-judge prompt template: Dispatch: Wait for the meta-judge to complete and extract the evaluation specification YAML from its output before proceeding to Phase 1. Phase 1: Independent Analysis Launch 3 independent judge agents in parallel (Opus for rigor): 1. …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills neolabhq/judge-with-debate--325ca0