Systematic Debugging
Core Principle
NO FIXES WITHOUT ROOT CAUSE INVESTIGATION FIRST.
Never apply symptom-focused patches that mask underlying problems. Understand WHY something fails before attempting to fix it.
The Four-Phase Framework
Phase 1: Root Cause Investigation
Before touching any code:
- •Read error messages thoroughly - Every word matters
- •Reproduce the issue consistently - If you can't reproduce it, you can't verify a fix
- •Examine recent changes - What changed before this started failing?
- •Gather diagnostic evidence - Logs, stack traces, state dumps
- •Trace data flow - Follow the call chain to find where bad values originate
Root Cause Tracing Technique:
code
1. Observe the symptom - Where does the error manifest? 2. Find immediate cause - Which code directly produces the error? 3. Ask "What called this?" - Map the call chain upward 4. Keep tracing up - Follow invalid data backward through the stack 5. Find original trigger - Where did the problem actually start?
Key principle: Never fix problems solely where errors appear—always trace to the original trigger.
Phase 2: Pattern Analysis
- •Locate working examples - Find similar code that works correctly
- •Compare implementations completely - Don't just skim
- •Identify differences - What's different between working and broken?
- •Understand dependencies - What does this code depend on?
Phase 3: Hypothesis and Testing
Apply the scientific method:
- •Formulate ONE clear hypothesis - "The error occurs because X"
- •Design minimal test - Change ONE variable at a time
- •Predict the outcome - What should happen if hypothesis is correct?
- •Run the test - Execute and observe
- •Verify results - Did it behave as predicted?
- •Iterate or proceed - Refine hypothesis if wrong, implement if right
Phase 4: Implementation
- •Create failing test case - Captures the bug behavior
- •Implement single fix - Address root cause, not symptoms
- •Verify test passes - Confirms fix works
- •Run full test suite - Ensure no regressions
- •If fix fails, STOP - Re-evaluate hypothesis
Critical rule: If THREE or more fixes fail consecutively, STOP. This signals architectural problems requiring discussion, not more patches.
Red Flags - Process Violations
Stop immediately if you catch yourself thinking:
- •"Quick fix for now, investigate later"
- •"One more fix attempt" (after multiple failures)
- •"This should work" (without understanding why)
- •"Let me just try..." (without hypothesis)
- •"It works on my machine" (without investigating difference)
Warning Signs of Deeper Problems
Consecutive fixes revealing new problems in different areas indicates architectural issues:
- •Stop patching
- •Document what you've found
- •Discuss with team before proceeding
- •Consider if the design needs rethinking
Common Debugging Scenarios
Installation Failures
code
1. Read the FULL error message and stack trace 2. Check bash version (macOS has bash 3.2) 3. Verify Homebrew is installed and up to date 4. Check for permission issues (sudo, Touch ID) 5. Review learning/LEARNING_LOG.md for known patterns
Script Errors
code
1. Capture the full error output 2. Check shebang (use #!/usr/bin/env bash, not #!/bin/bash) 3. Verify strict mode is enabled (set -euo pipefail) 4. Check for bash 4+ features on macOS (associative arrays, etc.) 5. Review LL-001 in learning log for bash version issues
"It worked before"
code
1. Use git bisect to find the breaking commit 2. Compare the change with previous working version 3. Identify what assumption changed 4. Fix at the source of the assumption violation
Debugging Checklist
Before claiming a bug is fixed:
- • Root cause identified and documented
- • Hypothesis formed and tested
- • Fix addresses root cause, not symptoms
- • Failing test created that reproduces bug (if applicable)
- • Test now passes with fix (if applicable)
- • Full test suite passes (if applicable)
- • No "quick fix" rationalization used
- • Fix is minimal and focused
- • Learning log updated if new pattern discovered
Integration with Other Skills
- •bash-scripting: Use when debugging shell script issues
- •homebrew-layers: Use when debugging package installation issues