Trading Data Pipeline
Run the repository's data pipeline in this order:
- •Activate virtual environment:
source .venv/bin/activate. - •Download data:
make run-download. - •Validate data:
make run-validate. - •Read report:
artifacts/reports/data_quality.json.
If make is unavailable, run scripts directly:
- •
python src/data/download_data.py - •
python src/data/validate_data.py
When reporting results, include:
- •Input symbol, timeframe, and date range from
configs/config.yaml. - •Row count and first/last timestamp from
artifacts/raw/BTCUSDT_15m.csv. - •Validation status and errors from
artifacts/reports/data_quality.json.
If download fails:
- •Confirm internet access and exchange name in config.
- •Confirm symbol format required by CCXT (
BTC/USDT). - •Retry once, then report the exact exception and failing step.
For quick command references, read references/commands.md.