AgentSkillsCN

Prompt Lab CLI

对LLM提示词进行测试与迭代。进行A/B测试、版本控制以及输出对比。免费的提示词工程工具。

SKILL.md
--- frontmatter
name: Prompt Lab CLI
description: Test and iterate on LLM prompts. A/B testing, version control, output comparison. Free prompt engineering tool.
tags: [llm, prompts, ai, testing, gpt, claude, cli, machine-learning]

Prompt Lab CLI

Iterate on prompts like a pro.

Test. Compare. Version. Ship better prompts.

Quick Start

bash
npm install -g promptlab-cli
bash
# Test prompt
promptlab run "Explain quantum computing simply"

# Compare versions
promptlab compare prompt-v1.txt prompt-v2.txt

# A/B test
promptlab ab --variants prompts/

Commands

Run Prompts

bash
# Basic run
promptlab run "Your prompt here"

# From file
promptlab run -f prompt.txt

# With variables
promptlab run -f template.txt --var topic="AI"

# Multiple models
promptlab run "prompt" --models gpt-4,claude-3

Compare Outputs

bash
# Compare two prompts
promptlab compare v1.txt v2.txt

# Side-by-side view
promptlab compare v1.txt v2.txt --side-by-side

# Save comparison
promptlab compare v1.txt v2.txt -o comparison.md

Version Control

bash
# Save prompt version
promptlab save "My prompt" --name summarizer --version 1.0

# List versions
promptlab list --name summarizer

# Rollback
promptlab use summarizer@0.9

A/B Testing

bash
# Run A/B test
promptlab ab --variants ./prompts/ --runs 10

# With evaluation metric
promptlab ab --variants ./prompts/ --eval "relevance,clarity"

# Export results
promptlab ab --variants ./prompts/ -o results.csv

Prompt Templates

yaml
# template.yaml
name: summarizer
version: 1.2
template: |
  Summarize the following text in {{style}} style:
  
  {{content}}
variables:
  style: "concise"

When to Use This

  • •Prompt engineering
  • •LLM app development
  • •A/B testing prompts
  • •Version control
  • •Team collaboration

Built by LXGIC Studios

🔗 GitHub · Twitter