What I do
- •Define experiment selection, planning, and reporting.
- •Enforce experiment hygiene and Memory Bank updates.
Experiment workflow
- •Read
memory-bank/ARCHITECTURE.md,memory-bank/TASK.md,memory-bank/STATE.md. - •Choose a hypothesis (or use user-provided).
- •Plan hyperparameters and compute strategy.
- •Create
experiments/EXP-XXX_<desc>/with:- •
main_exp.py - •
config.py - •
REPORT.md
- •
- •Test the pipeline quickly, do smoke-test; do not run full training unless the user asks.
- •Record results and update Memory Bank.
Template
Use references/EXPERIMENT_REPORT_TMP.md for REPORT.md.
Required updates
- •
memory-bank/TASK.md(mark hypothesis tested, update Active Experiment) - •
memory-bank/STATE.md(experiment history, best model tracker) - •Log experiment runs and metrics per apm-logs.