Experiment Scaffold
Gather inputs
- •Experiment directory name (a single path segment; no
/) - •Goal (1–3 sentences: what you’re trying to learn/build/test)
- •GitHub repos (repeatable;
owner/repoor URL) - •Reference URLs (repeatable; blogs/docs/API pages)
- •Notes (repeatable; bullets)
- •Optional root directory to create the experiment in (default: current directory)
Run the scaffold script
The helper script is scripts/create_experiment.py (next to this SKILL.md). Run it with the extracted inputs.
Example:
bash
python3 scripts/create_experiment.py \ --root ~/experiments \ --name vector-search \ --goal "Evaluate hybrid search with embeddings vs BM25." \ --repo openai/openai-python \ --repo facebookresearch/faiss \ --url https://platform.openai.com/docs/ \ --note "Measure latency/recall across configs"
What it creates
- •
<root>/<name>/.gitignore(ignoresreferences/repos/) - •
<root>/<name>/AGENTS.md(goal + pointer toreferences/index.md) - •
<root>/<name>/references/index.md(inventory + clone status) - •
<root>/<name>/references/notes.md - •
<root>/<name>/references/links.md - •
<root>/<name>/references/repos/<owner>/<repo>(cloned; gitignored)
Cloning notes (gh, multiple accounts, SSH)
- •The script tries
gh repo clonefirst and prefers SSH; it falls back if SSH/auth fails. - •If a repo fails to clone and you have multiple GitHub accounts, check
gh auth statusand switch withgh auth switch -u <user>. - •To default
ghto SSH cloning, setgh config set git_protocol ssh.
Useful flags
- •
--depth 0for a full clone (default is shallow) - •
--no-cloneto generate structure without cloning - •
--strictto stop on the first clone failure (otherwise record failures inreferences/index.md)