ABT Narrative Critique
Evaluate scientific writing using the And-But-Therefore framework. Focuses on introductions and abstracts of research proposals and papers in environmental/urban science.
The ABT Framework
Scientific narratives follow: AND (context) → BUT (tension) → THEREFORE (resolution)
- •AND: Establishes what we know. Cites relevant literature to frame the problem.
- •BUT: Identifies the critical gap. Creates tension that demands resolution.
- •THEREFORE: Proposes the solution. Shows how methods/results address the gap.
Workflow
1. Determine Document Type
- •Research proposal: Forward-looking; "Therefore" focuses on proposed methods and expected contributions
- •Research paper: Retrospective; "Therefore" includes results and demonstrated impact
See references/proposal-criteria.md or references/paper-criteria.md for type-specific evaluation criteria.
2. Extract ABT Components
Parse the introduction/abstract to identify:
- •AND section: Background statements, cited literature, established knowledge
- •BUT section: Gap statement, tension, "however/but/yet" pivot
- •THEREFORE section: Proposed approach, methods justification, expected/demonstrated outcomes
3. Evaluate Each Component
AND Evaluation
- •Citation coverage: Extract all cited works. Search for each using Hugging Face paper search and web search to verify:
- •Citations exist and are from credible sources (peer-reviewed journals, reputable institutions)
- •Cited claims accurately represent source content (no distortion)
- •Coverage is appropriate—neither too sparse (missing key works) nor excessive (unfocused)
- •Framing quality: Do citations build a coherent foundation for the research question?
BUT Evaluation
- •Gap clarity: Is there a clear, specific knowledge gap?
- •Gap significance: Why does this gap matter? Consequences for:
- •Scientific field advancement
- •Technology development
- •Policy interventions
- •Societal problems
- •Logical connection: Does the gap emerge naturally from the AND section?
THEREFORE Evaluation
- •Method-gap alignment: Is there a "glove-to-hand" fit between problem and approach?
- •Feasibility/novelty: Are methods appropriate and sufficiently innovative?
- •For papers only: Do results actually address the stated gap? What are broader implications?
4. Verify Citations (Full Retrieval)
For each citation in the AND section:
1. Search: Use Hugging Face:paper_search and web_search to locate the paper 2. Fetch: Use web_fetch to retrieve abstract/full text when available 3. Verify: Check that the cited claim matches the source's actual findings 4. Assess: Is this source credible? Peer-reviewed? Recent enough?
Flag issues:
- •Citation not found or inaccessible
- •Claim misrepresents source
- •Source is non-peer-reviewed or low credibility
- •Key recent literature missing
5. Assess Severity
Classify each issue as:
- •Fatal flaw: Likely to cause rejection; must be addressed (e.g., missing gap statement, methods don't address stated problem, citation misrepresents source)
- •Significant weakness: Reduces competitiveness but not disqualifying (e.g., gap significance unclear, citations incomplete)
- •Minor issue: Polish-level improvement (e.g., phrasing, flow)
6. Generate Critique
Structure output as:
## ABT Narrative Assessment ### Overall Verdict [One sentence: Strong/Adequate/Weak narrative structure] ### AND (Context & Literature) [Assessment of framing and citations] - Severity: [Fatal/Significant/Minor or None] ### BUT (Knowledge Gap) [Assessment of gap identification and significance] - Severity: [Fatal/Significant/Minor or None] ### THEREFORE (Resolution) [Assessment of method-gap fit and implications] - Severity: [Fatal/Significant/Minor or None] ### Citation Verification [Summary of citation checks; flag any issues] ### Key Recommendations **High-level**: [1-2 sentences on most important improvement] **Specific suggestions**: 1. [Concise, actionable suggestion] 2. [Concise, actionable suggestion] 3. [Concise, actionable suggestion]
Field Calibration: Environmental/Urban Science
When evaluating citation coverage, consider these domain norms:
- •Urban climate papers typically cite 20-40 references; introductions draw on 8-15 key works
- •Essential literature includes foundational works (Oke, Stewart & Oke LCZ) plus recent advances
- •Interdisciplinary framing is valued—connections to public health, energy, planning strengthen the AND
- •Methods sections should reference validation studies and data sources
Common fatal flaws in this field:
- •Ignoring scale mismatches (e.g., claiming city-level implications from point measurements)
- •Citing modeling studies as observational evidence
- •Missing recent high-impact papers in rapidly evolving subfields (heat exposure, urban scaling)
Important Notes
- •Critique only: Do not rewrite the document. Provide assessment and suggestions.
- •Constructive tone: Frame feedback to help improve the work, not dismiss it.
- •Acknowledge strengths: Note what works well alongside areas for improvement.
- •Uncertainty: If unable to verify a citation, note this rather than assuming incorrectness.