Paper Review
A comprehensive framework for reviewing academic papers, providing structured, constructive feedback following academic review standards.
When to Use
Use this skill when the user asks to:
- •Review an academic paper
- •Provide feedback on research work
- •Evaluate a paper for publication
- •Assess the quality of academic research
Review Structure
1. Paper Overview
Title: [Paper title] Authors: [Author list] Venue/Journal: [Target venue if known] Research Area: [Field/subfield]
Summary: Provide a 3-4 sentence summary of the paper's main contribution.
2. Strengths
List the paper's strong points (aim for 3-5 items):
- •Strength 1: Description and why it matters
- •Strength 2: Description and why it matters
- •Continue as needed
3. Weaknesses
Identify areas for improvement (be specific and constructive):
Major Issues
Issues that significantly impact the paper's quality or validity:
- •Issue 1: Detailed description and suggested fix
- •Issue 2: Detailed description and suggested fix
Minor Issues
Smaller problems that should be addressed:
- •Issue 1: Brief description
- •Issue 2: Brief description
4. Detailed Comments
Organize detailed feedback by paper section:
Abstract & Introduction
- •Comment on clarity, motivation, and positioning
Related Work
- •Assess coverage and comparison to existing work
Methodology
- •Evaluate soundness and appropriateness of methods
- •Check for sufficient detail for reproducibility
Experiments & Results
- •Review experimental design
- •Assess whether results support claims
- •Check statistical rigor
Discussion & Conclusion
- •Evaluate interpretation of results
- •Check if limitations are discussed
5. Technical Correctness
Assess the technical quality:
- •Are the methods sound?
- •Are the results properly validated?
- •Are there any logical flaws or errors?
6. Clarity & Presentation
Evaluate writing and presentation:
- •Is the paper well-written and organized?
- •Are figures and tables clear and informative?
- •Is the paper self-contained?
7. Originality & Significance
Assess contribution:
- •Novelty: How original is this work?
- •Impact: How significant is the contribution?
- •Relevance: Is this work important to the field?
8. Specific Questions for Authors
List any questions that need clarification:
- •Question 1
- •Question 2
9. Recommendation
Provide an overall assessment:
Rating: [Strong Accept / Accept / Weak Accept / Borderline / Weak Reject / Reject / Strong Reject]
Confidence: [High / Medium / Low]
Justification: 2-3 sentences explaining your recommendation.
Review Guidelines
Be Constructive
- •Focus on improving the work, not criticizing authors
- •Provide specific, actionable suggestions
- •Acknowledge good aspects before critiquing
Be Fair and Objective
- •Base feedback on technical merit
- •Avoid personal bias
- •Consider the paper's goals and target venue
Be Thorough
- •Read carefully and check details
- •Don't just focus on obvious issues
- •Consider both technical and presentation aspects
Be Clear
- •Use precise language
- •Provide examples when possible
- •Organize feedback logically
Common Issues to Check
- • Insufficient comparison with baselines
- • Missing ablation studies
- • Overclaimed results
- • Unclear methodology
- • Missing error bars or statistical tests
- • Poor writing or organization
- • Insufficient related work coverage
- • Missing reproducibility details
- • Unclear figures or tables
Tone
Maintain a professional, respectful tone throughout. Remember that reviews should be:
- •Constructive: Help authors improve their work
- •Specific: Point to exact locations and provide concrete suggestions
- •Fair: Recognize both strengths and weaknesses
- •Professional: Be courteous and respectful