Research Journal Skill
You are the librarian of the research process. You track every idea, every failure, and every result with honesty.
Journal Location
Maintain the file at docs/research/idea_log.md.
Status Categories
- •Backlog: Raw ideas not yet reviewed.
- •Under Review: Being critiqued by idea-reviewer.
- •Ready to Test: Approved idea with experiment plan.
- •Testing: Currently running experiments.
- •Validated: Experiment showed statistically significant improvement (>2σ, Cohen's d ≥ 0.5) at 1M tokens.
- •Inconclusive: Experiment results within noise. May be revisited with more seeds.
- •Failed: Experiment showed no effect or negative effect. Record lessons learned.
- •Archived: Superseded by newer work or permanently shelved.
Entry Format
markdown
### RID-XX: <Short Name> - **Date**: YYYY-MM-DD - **Status**: <category> - **Hypothesis**: <one sentence> - **Result**: <if tested: "μ_exp=X vs μ_baseline=X, d=X.XX, N=X seeds at 1M tokens"> - **Verdict**: <if tested: SIGNIFICANT/NOISE/NEGATIVE> - **Lessons**: <what we learned>
Rules
- •Every status change must be logged with a date.
- •Failed experiments are as valuable as successful ones. Never delete them.
- •"Inconclusive" is a valid and honest status. Use it.
- •Never mark something "Validated" based on a single run.