AgentSkillsCN

ab-test-setup

提供结构化的 A/B 测试设置指南，包含假设、指标与执行准备等必要环节。

SKILL.md
--- frontmatter
version: 4.1.0-fractal
name: ab-test-setup
description: Structured guide for setting up A/B tests with mandatory gates for hypothesis, metrics, and execution readiness.

A/B Test Setup

1️⃣ Purpose & Scope

Ensure every A/B test is valid, rigorous, and safe before a single line of code is written.

  • •Prevents "peeking"
  • •Enforces statistical power
  • •Blocks invalid hypotheses

2️⃣ Pre-Requisites

You must have:

  • •A clear user problem
  • •Access to an analytics source
  • •Roughly estimated traffic volume

🧠 Knowledge Modules (Fractal Skills)

1. Hypothesis Quality Checklist

2. 3️⃣ Hypothesis Lock (Hard Gate)

3. 4️⃣ Assumptions & Validity Check (Mandatory)

4. 5️⃣ Test Type Selection

5. 6️⃣ Metrics Definition

6. 7️⃣ Sample Size & Duration

7. 8️⃣ Execution Readiness Gate (Hard Stop)

8. During the Test

9. Analysis Discipline

10. Interpretation Outcomes

11. Test Record (Mandatory)