WIN Evaluate
Overview
Run only the committee scoring stage to produce data/output/committee_matrix.json.
Workflow
- •Ensure
profiles.jsonalready exists (run profile stage first if needed). - •Validate content and committee input contracts.
- •If required content/committee inputs are missing, please interview the user to acquire the necessary inputs before running commands.
- •Run committee evaluation and inspect weighted scores plus consensus spread.
Command
bash
scripts/run_evaluate.sh
Input Contracts
Expected schemas are documented in:
- •
../win-committee/references/data-contracts.md
Guardrails
- •Keep scoring criteria explicit through
rubric_weights. - •Avoid overfitting to one persona by checking expert weights and consensus spread.
- •If required inputs are missing, please interview the user to acquire the necessary inputs.
- •Keep user-specific drafts in
*.local.jsonfiles.