AgentSkillsCN

collecting-evidence

当您需要研究某一特定支柱,并希望创建可追溯的证据对象时,可使用此技能。该技能指导您创建带有语义ID、置信度评分以及假设信息的YAML证据文件。

SKILL.md
--- frontmatter
name: collecting-evidence
description: Use when researching a specific pillar and need to create traceable evidence objects. Guides creation of YAML evidence files with semantic IDs, confidence scores, and assumptions.
context: fork
agent: general-purpose

Evidence Collection

This skill guides the creation of structured Evidence Objects for a single research pillar.

Prerequisites

  • Ledger workspace initialized (/ledger-init completed)
  • Pillar assignment (which pillar to research)
  • Research scope from 01-pillars/PILLARS.md

Workflow

Use TodoWrite to track these mandatory steps:

<required> 1. Load pillar scope and research questions 2. Identify evidence sources 3. Collect raw evidence 4. Create Evidence Objects with semantic IDs 5. Validate evidence quality 6. Check evidence gate (minimum 5 per pillar) </required>

Step 1: Load Pillar Scope

Read 01-pillars/PILLARS.md to understand:

  • Pillar priority level
  • Specific research questions for this pillar
  • Any scope restrictions

See references/research-protocols.md for pillar-specific protocols.

Step 2: Identify Evidence Sources

For each research question, identify potential sources:

Source TypeExamplesTypical Confidence
urlResearch reports, documentation60-90
pdfAcademic papers, whitepapers70-95
interviewUser interviews, expert calls50-80
internal-docCompany data, prior research60-85
experimentA/B tests, prototypes70-95
datasetAnalytics, survey results65-90

Step 3: Collect Raw Evidence

For each source:

  1. Extract the key claim(s)
  2. Note supporting quotes/data
  3. Assess confidence level
  4. List assumptions

Web research protocol:

  • Use WebSearch for discovery
  • Use WebFetch to retrieve and analyze content
  • Track source URLs and retrieval dates
  • Note if sources agree or contradict

Step 4: Create Evidence Objects

Write YAML files to 02-evidence/<pillar>/.

Naming: Use semantic IDs per references/id-generation-rules.md.

Schema: See references/evidence-object-schema.md.

<good-example> ```yaml id: EV-market-pricing-smb-wtp pillar: market source: type: url ref: "https://example.com/pricing-research" retrieved_at: 2026-01-21 claim: "SMB segment willingness-to-pay peaks at $29/mo for productivity tools." quote: "Our survey of 500 SMBs found median WTP of $29/month..." confidence: 0.75 assumptions: - "Survey sample representative of target market" - "WTP for 'productivity tools' applies to our specific category" notes: "Sample skewed toward US companies. May need regional validation." tags: - pricing - smb - wtp ``` - Semantic ID describes content (market-pricing-smb-wtp) - Falsifiable claim with specific number ($29/mo) - Honest confidence (0.75, not inflated) - Explicit assumptions documented - Source fully traceable </good-example> <bad-example> ```yaml id: EV-001 pillar: market source: type: url ref: "some website" claim: "People like our product" confidence: 0.95 assumptions: [] ``` - Non-semantic ID (EV-001 tells nothing about content) - Vague, unfalsifiable claim ("people like") - Overconfident (0.95) without strong source - No assumptions documented - Untraceable source reference </bad-example>

Step 5: Validate Evidence Quality

Each Evidence Object must pass:

CheckRequirement
Falsifiable claimClaim can be proven wrong
Confidence assigned0.0-1.0 value present
Assumptions listedAt least 1 assumption
Source traceableCan revisit the source
ID is semanticFollows ID scheme

Quality warnings:

  • Confidence > 0.9 without peer-reviewed source
  • Multiple evidence objects with identical claims
  • Assumptions that can't be tested

Step 6: Check Evidence Gate

Before synthesis, verify minimum 5 Evidence Objects per pillar.

code
Evidence Gate Check: market
├── EV-market-tam-b2b-saas ✓
├── EV-market-pricing-smb-wtp ✓
├── EV-market-growth-remote-tools ✓
├── EV-market-segment-priorities ✓
└── EV-market-competitive-density ✓
Total: 5/5 minimum ✓ GATE PASSED

If gate fails, continue research until threshold met.

User Interaction

Use the AskUserQuestion tool when:

Source prioritization needed

code
Question: "Multiple sources available for [topic]. Which to prioritize?"
Options:
- "Academic/peer-reviewed sources (higher confidence)"
- "Recent industry reports (more current)"
- "Direct user research (more specific)"
- "Research all and compare"

Confidence assessment uncertain

code
Question: "How confident should I rate this claim: '[claim]'?"
Options:
- "High (0.8-0.9) - Strong source, well-supported"
- "Medium (0.5-0.7) - Reasonable source, some uncertainty"
- "Low (0.3-0.5) - Weak source or significant assumptions"
- "Help me assess the source quality"

Contradictory evidence found

code
Question: "Sources disagree on [topic]. Source A says X, Source B says Y."
Options:
- "Create evidence for both, note contradiction"
- "Prioritize more recent source"
- "Prioritize more authoritative source"
- "Research further for resolution"

Evidence gate failing

code
Question: "Only [N] evidence objects for [pillar]. Need [5-N] more to pass gate."
Options:
- "Continue researching this pillar"
- "Accept partial evidence (will affect synthesis quality)"
- "Deprioritize this pillar for MVP"
- "Help me identify additional research areas"

Output

After evidence collection:

markdown
## Evidence Collection Complete: [pillar]

**Evidence Objects Created:** [N]
**Gate Status:** [PASSED/FAILED]

### Evidence Summary
| ID | Claim Summary | Confidence |
|----|---------------|------------|
| EV-market-tam-b2b-saas | TAM is $X billion | 0.80 |
| EV-market-pricing-smb-wtp | SMB WTP peaks at $29/mo | 0.75 |
| ... | ... | ... |

### Key Findings
- [Top 3 findings from this pillar]

### Contradictions Noted
- [Any conflicting evidence]

### Gaps Remaining
- [Research questions not fully answered]

References