Add Mortgage Rate Parser
This skill guides you through adding a new bank parser to extract mortgage rates from HTML pages or PDF documents.
When to Use
- •Implementing a new bank's rate parser
- •The bank has a public rate disclosure (HTML or PDF)
- •The bank is listed in
BankIdenum or needs to be added
Quick Steps
- •Download fixture to
fixtures/{bank_id}/ - •Analyze structure - extract text from PDF or inspect HTML
- •Implement parser in
packages/updater/src/parsers/{bank_id}.ts - •Register parser in
packages/updater/src/parsers/index.ts - •Write tests in
packages/updater/src/parsers/{bank_id}.test.ts - •Update PROGRESS.md
Key Files
- •Parser interface:
packages/updater/src/parsers/types.ts - •HTML example:
packages/updater/src/parsers/bancolombia.ts - •PDF example:
packages/updater/src/parsers/scotiabank.ts - •CloudFront WAF example:
packages/updater/src/parsers/banco-de-occidente.ts - •Utilities:
packages/updater/src/utils/numbers.ts
Commands
bash
# Run tests for a specific parser
pnpm --filter @compara-tasa/updater test -- --run {bank_id}
# Run all tests
pnpm --filter @compara-tasa/updater test -- --run
# Type check
pnpm typecheck
# Run the updater
pnpm --filter @compara-tasa/updater build && pnpm update-rates
Detailed Instructions
Read content.md in this skill folder for:
- •Fixture download commands
- •PDF text extraction script
- •Complete parser template
- •Test template
- •Rate type examples
- •Utility function reference
- •Common issues and solutions
- •CloudFront WAF bypass using Playwright + stealth plugin