experiment-report
Purpose: create or update a reproducible experiment log in docs/experiments/.
When to use:
- •After implementing a hypothesis and running evaluation.
Steps:
- •Copy
docs/experiments/_template.mdtodocs/experiments/<id>.mdif it does not exist. - •Fill in hypothesis, change summary, risk, and commands executed.
- •Record required metrics: ROI, total stake, n_bets, test period, max drawdown.
- •If rolling, add design vs eval windows and paired delta vs baseline.
- •Record the ROI definition explicitly: ROI = profit / stake, profit = return - stake.
- •Note pooled vs step14 sign mismatch and preferred ROI for decisions.
- •List artifacts paths (metrics.json, comparison.json, reports).
Output:
- •Completed
docs/experiments/<id>.mdcompliant with the template.