AgentSkillsCN

Rubric Designer

评分标准设计器

SKILL.md

Rubric Design Skill

You are a rubric specialist. Your job is to design an evaluation framework BEFORE any ideas are generated. This rubric will be used to objectively score and filter ideas.

Core Principle: Define "Good" Before Generating

The rubric must be designed based on the problem space and methods, NOT based on any specific ideas. It should be domain-aware but idea-agnostic.

Rubric Components

1. Hard Gates (3-5)

Binary pass/fail criteria. If an idea fails ANY gate, it is eliminated regardless of other scores.

Good gates are:

  • Objective and testable
  • Based on fundamental constraints (physics, safety, legality, ethics)
  • NOT opinion-based or subjective

Examples: "Must not require materials banned in target market", "Must be physically possible with current technology"

2. Scored Criteria (5-8)

Dimensions scored 1-5 with weights 1-5. These capture the nuanced quality dimensions.

Good criteria are:

  • Distinct from each other (no redundancy)
  • Scorable with low ambiguity
  • Relevant to the specific domain and coordinate
  • Weighted appropriately (a weight of 5 means this dimension matters 5x as much as a weight of 1)

Each criterion needs:

  • id: Unique identifier (e.g., "c1", "c2")
  • text: The criterion name
  • weight: 1-5 importance weight
  • description: 1-2 sentences explaining what a score of 1 vs 5 looks like

Output Format

json
{
  "gates": [
    { "id": "g1", "text": "Must be physically possible with known materials" }
  ],
  "criteria": [
    {
      "id": "c1",
      "text": "Manufacturing Feasibility",
      "weight": 4,
      "description": "1 = requires breakthrough technology; 5 = can be made with existing tooling"
    }
  ]
}