Systematic Prompt Evaluation & Optimization
Score and optimize Claude prompts with structured testing frameworks
What You Can Do
Systematically evaluate your Claude prompts using quantitative scoring frameworks to identify weaknesses in clarity, task alignment, and output quality. You'll receive detailed optimization recommendations with A/B testing guidance to improve prompt effectiveness and consistency across different use cases and input variations.
Features
Evaluate prompts on clarity, specificity, task alignment, and output quality with calibrated rubrics
Identify specific weaknesses (ambiguous instructions, missing context, over-complexity) with actionable feedback
Compare original vs. optimized prompts side-by-side with statistical significance insights
Track prompt performance across dimensions (coherence, accuracy, consistency, relevance)
Get step-by-step rewrites targeting the weakest areas with before/after examples
Access proven prompt patterns for common tasks (classification, summarization, code generation)
Score multiple prompts simultaneously to identify relative strengths and find optimization patterns
Example Output
Example 1: Prompt Score Report
| Dimension | Score | Feedback |
|---|---|---|
| Clarity | 3/5 | Instructions use vague terms like "good" and "relevant" without definition |
| Specificity | 2/5 | Missing format requirements and example output structure |
| Task Alignment | 4/5 | Core task is clear but edge cases are undefined |
| Output Quality | 3/5 | No guardrails for response length, tone, or accuracy |
Top 3 Weaknesses: (1) Ambiguous success criteria, (2) Missing output format specification, (3) No constraints on edge cases
Example 2: Optimization Comparison
Before:
Summarize this text in a few sentences
After:
Summarize the following text in 2-3 sentences. Focus on the main argument and key evidence. Maintain neutral tone. Do not add information not in the original text.
Expected improvement: Output consistency increases from 65% match rate to 89%; fewer off-topic additions; meets length requirements 100% of the time.
Example 3: A/B Test Results
Prompt A (original) scored 3.2/5 across 5 test cases.
Prompt B (optimized) scored 4.6/5 across the same test cases.
43% improvement in overall quality with clearer instructions and defined constraints.
What's Included
- SKILL.md: Complete systematic evaluation framework with scoring methodology
- Prompt Scoring Rubric: Calibrated dimensions (clarity, specificity, alignment, quality) with detailed criteria
- A/B Testing Worksheet: Side-by-side comparison template for original vs. optimized prompts
- Optimization Checklist: Prioritized improvements ranked by impact on output quality
- Sample Prompt Library: Proven high-scoring prompts for classification, summarization, and code generation
- Weakness Diagnostic Guide: Flowchart to identify root causes of low scores
Who It's For
- Prompt engineers — Optimize production Claude implementations and validate prompt quality before deployment
- AI/ML product managers — Validate prompt effectiveness across use cases and compare variations systematically
- Technical writers — Create Claude integration documentation with quality-assured examples
- Customer success teams — Debug underperforming customer prompts with structured diagnostics
- Developers — Build Claude-powered applications with consistent, high-quality output requirements
Best For
- Evaluating production prompts — Score and validate prompts before deployment to catch weaknesses early
- Comparing prompt variations — Test multiple approaches and identify the most effective version statistically
- Diagnosing edge-case failures — Pinpoint why prompts underperform on specific inputs or scenarios
- Building reusable templates — Create team-standard prompts with proven quality scores
- Training prompt engineering — Learn best practices by analyzing high-scoring prompts and understanding optimization patterns
You might also like
You can build production-grade vector search systems that retrieve semantically similar documents in sub-millisecond time using AgentDB's optimized HNSW indexing. The skill enables you to implement RAG pipelines, semantic search engines, and intelligent knowledge bases with configurable embedding dimensions, distance metrics (cosine, Euclidean, dot product), and similarity thresholds—all with built-in quantization and caching for massive performance gains.
by moonwell-fi
You'll systematically diagnose data quality problems by developing structured root cause analysis frameworks, calculating the true business impact, and creating reproducible validation tests. This skill walks you through hypothesis-driven investigation, data lineage analysis, and remediation planning — turning data issues into documented fixes and preventive measures.
by moonwell-fi
You can systematically evaluate and improve your RAG pipelines using Claude as a design partner. You'll analyze retrieval quality, identify bottlenecks in your embedding and chunking strategies, and receive actionable recommendations to reduce hallucinations and improve context relevance. By the end, you'll have a data-driven optimization plan tailored to your specific use case and performance metrics.
by moonwell-fi
You'll build comprehensive data quality test suites that validate transformations, detect anomalies, and document standards across your dbt and SQL pipelines. This skill generates production-ready test configurations, anomaly detection protocols, and validation rules that catch data issues before they impact analytics.
by moonwell-fi
You can convert complex datasets and business metrics into polished, executive-ready reports that stakeholders trust and act on. Claude generates data-driven narratives, executive summaries, actionable insights, and visualization recommendations tailored to your audience's priorities. Your reports will tell a cohesive story that connects metrics to business outcomes, eliminating confusion and accelerating decision-making.
by moonwell-fi
You can rapidly compile, organize, and format disparate health economic evidence—from clinical trials to cost-effectiveness analyses—into structured, regulatory-compliant dossiers. This skill maps your evidence to specific payer and HTA requirements, automatically generates evidence hierarchies, and produces submission-ready dossier outlines with formatting that meets regulatory standards for NICE, EUnetHTA, and other major bodies.
by moonwell-fi
You can structure comprehensive health technology assessments (HTAs) that organize clinical evidence, economic analyses, and regulatory considerations into evidence-based coverage recommendations. This skill helps you synthesize clinical trial data, health economic models, and real-world evidence into clear, defensible payer coverage determinations. You'll generate professional HTA reports that align with major frameworks like ICER, CADTH, and NICE standards.
by moonwell-fi
This skill automatically documents your entire analytics infrastructure by analyzing data sources, transformations, and outputs. You'll generate production-ready data dictionaries with field definitions, lineage maps showing data flow across systems, and transformation documentation that explains logic and dependencies. Save weeks of manual documentation work while keeping your analytics stack discoverable as it evolves.
by moonwell-fi