AgentSkillsCN

ml-systems

机器学习系统——从数据工程到部署与运维，全面掌握生产级机器学习系统的构建知识。基于哈佛大学机器学习系统课程和 Chip Huyen 的《设计机器学习系统》。

SKILL.md
--- frontmatter
name: ml-systems
description: Machine Learning Systems - comprehensive knowledge for building production ML systems from data engineering through deployment and operations. Based on Harvard ML Systems course and Designing ML Systems by Chip Huyen.

ML Systems

Building production-ready machine learning systems.

Overview

This skill category covers the complete ML system lifecycle:

  1. •Foundations - Core concepts, architectures, paradigms
  2. •Data Engineering - Data collection, quality, feature engineering
  3. •Model Development - Training, evaluation, frameworks
  4. •Performance - Optimization, acceleration, efficiency
  5. •Deployment - Serving, edge deployment, scaling
  6. •Operations - MLOps, monitoring, reliability

Categories

Foundations

  • •ml-systems-fundamentals - Core ML systems concepts
  • •deep-learning-primer - Deep learning foundations
  • •dnn-architectures - Neural network architectures
  • •deployment-paradigms - Deployment patterns

Data Engineering

  • •data-engineering - Data pipelines and quality
  • •training-data - Training data management
  • •feature-engineering - Feature creation and stores

Model Development

  • •ml-workflow - ML development workflow
  • •model-development - Model training and selection
  • •ml-frameworks - Framework best practices

Performance

  • •efficient-ai - Efficiency techniques
  • •model-optimization - Quantization, pruning, distillation
  • •ai-accelerators - Hardware acceleration

Deployment

  • •model-deployment - Production deployment
  • •inference-optimization - Inference optimization
  • •edge-deployment - Edge and mobile deployment

Operations

  • •mlops - ML operations and lifecycle
  • •robust-ai - Reliability and robustness

Key Principles

  1. •Data-Centric AI - Focus on data quality over model complexity
  2. •Iterative Development - Start simple, iterate based on metrics
  3. •Production-First - Design for deployment from the start
  4. •Monitoring - Continuous monitoring and improvement
  5. •Reproducibility - Version everything (data, code, models)

References

  • •Harvard CS 329S: Machine Learning Systems Design
  • •Designing Machine Learning Systems by Chip Huyen
  • •MLOps: Continuous Delivery and Automation Pipelines