ML Alpha
objective
Develop machine-learning alpha models with robust validation, calibration, and deployment controls.
workflow
- •define target construction and purged train-validation splits.
- •engineer predictive features with leakage and survivorship safeguards.
- •train and calibrate models with benchmark challengers.
- •evaluate alpha net of costs under realistic execution assumptions.
- •deploy only when live monitoring and drift controls are configured.
required diagnostics
- •precision, calibration, and information-coefficient stability.
- •feature drift and target drift diagnostics.
- •out-of-sample decay and horizon-specific performance.
- •cost-adjusted edge versus simple baseline models.
- •live-versus-backtest discrepancy monitoring.
risk controls
- •enforce purged validation and embargo rules.
- •enforce model registry and reproducible training artifacts.
- •enforce rollback trigger on live calibration breakdown.
outputs
- •run
python scripts/ml_alpha_diagnostics.py input.csv --output diagnostics.jsonand keep the json artifact. - •write an implementation memo using
references/ml-alpha-playbook.mdwith assumptions, tests, limits, and rollout plan.
resources
- •use
scripts/ml_alpha_diagnostics.pyfor deterministic diagnostics. - •use
references/ml-alpha-playbook.mdfor the domain checklist and delivery structure.