AgentSkillsCN

thesis-disagreement-report

生成关键词与LLM分歧的报告，为改进关键词启发式方法提供指导。

SKILL.md
--- frontmatter
name: thesis-disagreement-report
description: Generate a report of keyword-vs-LLM disagreements to guide improvements
  to keyword heuristics.
user-invocable: false
allowed-tools:
- Bash
- Read

thesis-disagreement-report

When to use

  • •You want to find where keyword gating is too permissive or too strict compared to LLM.

Inputs

  • •days window.
  • •keyword threshold for treating keyword_score as 'match'.
  • •optional output path.

Workflow

  1. •Run: python -m ops.cli quality thesis-disagreement-report --days 30 --keyword-threshold 0.4 --out /tmp/report.md.
  2. •Review examples and adjust keyword rules or negative keywords accordingly.

Outputs

  • •Markdown report listing example signal_ids for keyword FP/FN.

Guardrails

  • •Disagreement does not imply keyword is wrong; validate against real outcomes whenever possible.

References

  • •references/reference.md
  • •docs/QUALITY_OPS_ARCHITECTURE.md