Researching External Sources
Guide for comprehensive multi-source research that synthesizes findings from documentation, academic papers, and practitioner articles into actionable recommendations.
Instructions
Step 1: Parse Research Parameters
Extract from the request:
- •Topic: Main subject to investigate
- •Date Range (optional): Prioritize recent sources if specified
- •Source Preferences: Any specific sources to focus on
Step 2: Research in Parallel (Conceptually)
Investigate three source categories:
Documentation Sources
- •Official SDK docs (Claude Code, Google ADK, OpenAI)
- •API references and guides
- •Extract: Key concepts, APIs, patterns, best practices
- •Format findings with source URLs
Academic Papers
- •arxiv.org, Google Scholar, ACL Anthology
- •Prioritize last 12 months unless specified
- •Extract: Methodologies, findings, evaluation metrics
- •Include paper URLs and publication dates
Practitioner Articles
- •Engineering blogs, known practitioners
- •Simon Willison, Eugene Yan, vendor blogs
- •Extract: Production experiences, lessons learned
- •Include article URLs and dates
Step 3: Synthesize Cross-Source Findings
Consensus Patterns (High Confidence)
- •Insights appearing across multiple source types
- •Universal best practices
- •Evidence from docs + papers + practice
Unique Insights (Source-Specific Value)
- •Documentation: Technical details, API specs
- •Academic: Novel methodologies, rigorous evaluations
- •Practitioner: Production war stories, real-world constraints
Contradictions & Trade-offs
- •Where sources disagree (note context differences)
- •Evolution of thinking over time
- •Theory vs practice gaps
Step 4: Perform Gap Analysis
Map findings against existing book content:
- •
Find related content
codeGlob: chapters/**/*.md Grep: {topic keywords} - •
Assess current coverage
- •Read identified files
- •Check frontmatter status
- •Note partial vs complete coverage
- •
Identify gaps
- •Topics missing from book
- •Entries needing updates
- •Areas where research provides deeper insights
- •Contradictions to existing content (needs correction)
Step 5: Generate Recommendations
Priority 1: Critical Updates
- •Contradicts existing content
- •Fills major foundational gap
- •Supported by all source types
- •High impact
Priority 2: Valuable Additions
- •Extends existing content
- •Supported by 2+ source types
- •Medium-high impact
Priority 3: Nice to Have
- •Interesting but not essential
- •Single-source insights
- •Could seed new questions
For each recommendation:
- •File: Absolute path to target
- •Action: extend | new section | new entry | create questions
- •Insight: Phrased in book voice
- •Sources: Citation numbers
- •Reasoning: Why this priority
Step 6: Save Research Report
Save to: .claude/.cache/research/external/{topic-slug}-{YYYY-MM-DD}.md
Include:
- •Research summary (2-3 sentences)
- •Findings by source type
- •Cross-source synthesis
- •Gap analysis table
- •Priority-ranked recommendations
- •All citations with URLs
Step 7: Report Results
## Research Complete
**Topic:** {topic}
**Date:** {YYYY-MM-DD}
### Sources Researched
| Type | Status | Findings |
|------|--------|----------|
| Documentation | Complete | {count} |
| Academic Papers | Complete | {count} |
| Practitioner Articles | Complete | {count} |
### Cross-Source Synthesis
- **Consensus Patterns:** {count}
- **Unique Insights:** {count}
- **Contradictions:** {count}
### Gap Analysis
- **Existing Coverage:** {count} sections
- **Gaps Found:** {count}
### Top Recommendations
**Priority 1:**
1. `{path}` - {action}: "{insight}"
**Priority 2:**
1. `{path}` - {action}: "{insight}"
### Full Report
Saved to: {report_path}
Key Principles
Cross-Source Validation
- •Consensus across multiple sources = high confidence
- •Single source = interesting but needs validation
- •Documentation + papers + practice = strongest signal
Priority Assignment Logic
- •Contradicts book = always Priority 1 (accuracy matters)
- •Fills foundational gap + multi-source = Priority 1
- •Extends existing + multi-source = Priority 2
- •Single source + novel = Priority 3
Book Voice Integration
- •Phrase insights as learnings, not facts
- •Include production context when available
- •Match existing chapter tone
Citation Management
- •Number all citations sequentially
- •Include full URLs (stable, not temporary)
- •Note source type and publication date
- •Enable verification and deep dives
Examples
Example 1: Research prompt caching
Topic: "prompt caching strategies" Documentation: Anthropic docs on prompt caching API Papers: Recent arxiv on KV cache optimization Articles: Simon Willison on practical caching Synthesis: - Consensus: Caching prefix significantly reduces latency - Unique: Papers show 40% cost reduction metrics - Trade-off: Memory vs compute at different scales Gap Analysis: - chapters/4-context/ mentions caching briefly - No detailed implementation guidance Priority 1: Extend 4-context/2-context-strategies.md with caching patterns
Example 2: Research agent orchestration
Topic: "multi-agent coordination patterns" Sources found across all three types Strong consensus on supervisor patterns Contradictions on when to use hierarchical vs flat Gap Analysis: - chapters/6-patterns/ has orchestrator chapter - Missing: comparison of coordination approaches Priority 1: Add coordination comparison to 6-patterns/3-orchestrator-pattern.md Priority 2: New section on failure handling
Example 3: No contradictions found
Topic: "tool use best practices" All sources align on core principles Practitioner articles add production nuances Gap Analysis: - chapters/5-tool-use/ covers basics well - Could deepen with production examples Priority 2: Extend with practitioner war stories Priority 3: Add edge case handling section
Example 4: Partial source failure
Topic: "emerging evaluation methods" Documentation: Complete Papers: Complete Articles: Failed (connection issue) Report continues with available sources Note limitation in findings Suggest manual article search for completeness