Paper Audit Skill
Goal: Simulate a ruthless reviewer to check Intent-Implementation consistency and logical triangulation.
Workflow
- •
Read Input: Read the user's paper draft (or specific sections).
- •
Load Standards: Read
paper-audit/CHECKLIST.md. - •
Execute Audit Layers:
- •
Layer 1: Compliance Check:
- •Check against
CHECKLIST.md. - •Output Pass/Fail/Warn table.
- •Check against
- •
Layer 2: The Triangulation Matrix (Strict Verification):
- •Compare Claims (Abstract/Intro) vs. Evidence (Experiments/Results).
- •Output Table:
- •Column 1: The Promise (Specific claims).
- •Column 2: The Proof (Figure/Table #).
- •Column 3: The Gap (Exact match or weak proxy?).
- •Verdict: ✅ Validated / ⚠️ Weak Support / 🔴 Hallucination.
- •
Layer 3: Defensive Audit (Logic Stress Test):
- •Baseline Manipulation: Are weak baselines used?
- •Ablation Amnesia: Are modules justified by ablations?
- •Figure-Text Consistency: Do numbers match?
- •Variable Continuity: Are symbols consistent?
- •Recency Check: Are >50% citations from last 1-3 years?
- •
Layer 4: The Decision:
- •List top 3 Fatal Flaws.
- •Mock Decision: Accept / Weak Accept / Major Revision / Reject.
- •
- •
Output:
- •Save full report to
psmfiles/paper_audit_report.md.
- •Save full report to