Prompt Engineer
Design, test, and optimize prompts for reliable LLM performance
What You Can Do
You can transform underperforming or inconsistent prompts into reliable, production-ready specifications that work across diverse inputs and use cases. This skill guides you through diagnosing prompt failures, applying evidence-based optimization techniques (chain-of-thought reasoning, few-shot examples, output constraints), testing variants systematically, and documenting final prompts for team-wide reproducibility. You'll move beyond trial-and-error to engineering prompts that scale reliably across different model versions and maintain quality with thousands of inputs.
Features
structure prompts to break problems into logical steps for improved reasoning and transparency
craft and validate examples that demonstrate desired behavior patterns
define JSON, markdown, or custom schemas to ensure consistent, parseable results
create controlled test suites to compare prompt versions and measure performance gains
establish baseline metrics and track improvements across iterations
identify why prompts fail (ambiguous instructions, missing context, wrong model assumptions) and target fixes
generate final prompt specs with clear instructions, examples, constraints, and usage guidelines
test and adapt prompts for different LLM versions and families
Example Output
Example 1: Customer Support Classification Prompt
Input: Raw customer ticket text with high variability
Optimized prompt output:
## Classification Prompt Specification
### Purpose
Classify support tickets into: Billing, Technical, Product Feedback, Account Access
### Chain-of-Thought Structure
1. Identify the primary problem statement
2. Note any secondary concerns
3. Match against category definitions
4. Assign confidence score (0-1)
### Few-Shot Examples
- Ticket: "Can't log in after password reset" → Account Access (0.95)
- Ticket: "Charge appeared twice on invoice" → Billing (0.92)
### Output Format
{"category": "string", "confidence": 0.0-1.0, "reasoning": "2-3 sentences"}
### Quality Baseline
- Accuracy target: 92%+
- Consistency: 95%+ same-class agreement on retest
Example 2: Data Extraction Prompt Test Results
Variant A (baseline): 78% accuracy on 50-document sample Variant B (added CoT + constraints): 89% accuracy Variant C (added few-shot examples): 94% accuracy
Recommendation: Use Variant C across production pipeline
Example 3: JSON Structured Output Prompt
Input: Product review text Output:
{
"sentiment": "positive",
"topics": ["durability", "price"],
"actionable_feedback": true,
"priority_level": "medium",
"summary": "Customer praised build quality but flagged cost as concern"
}
What's Included
- SKILL.md: core instruction file with methodology and examples
- Prompt Testing Framework: template for creating and comparing prompt variants with consistency metrics
- Chain-of-Thought Design Checklist: step-by-step guide for structuring reasoning prompts
- Few-Shot Example Generator: worksheet for crafting representative examples and validating coverage
- Output Schema Templates: pre-built JSON and markdown structures for common tasks (classification, extraction, summarization)
- Specification Documentation Template: final prompt specification format for handoff and team use
Who It's For
- Prompt engineers designing and optimizing prompts for production LLM applications
- AI/ML teams scaling prompt quality across multiple use cases and models
- Product managers ensuring consistent AI feature performance at scale
- Data scientists building reliable extraction and classification pipelines
- Operations leads documenting and standardizing prompts across teams
Best For
- Diagnosing and fixing inconsistent or underperforming prompts
- Engineering customer-facing prompts (support, recommendations, content generation)
- Building data extraction and classification pipelines at scale
- Testing and comparing prompt variants with measurable quality metrics
- Documenting production prompts for reproducibility and team handoff
- Optimizing prompts for reliability across different model versions
You might also like
You'll systematically diagnose data quality problems by developing structured root cause analysis frameworks, calculating the true business impact, and creating reproducible validation tests. This skill walks you through hypothesis-driven investigation, data lineage analysis, and remediation planning — turning data issues into documented fixes and preventive measures.
by moonwell-fi
You'll build comprehensive data quality test suites that validate transformations, detect anomalies, and document standards across your dbt and SQL pipelines. This skill generates production-ready test configurations, anomaly detection protocols, and validation rules that catch data issues before they impact analytics.
by moonwell-fi
You can design multi-dimensional evaluation strategies tailored to your model's specific capabilities and use cases, create representative test sets that expose edge cases and failure modes, implement automated scoring mechanisms for reproducible results, and generate benchmark comparison reports that contextualize performance within industry standards. This skill transforms ad-hoc testing into systematic, evidence-based model assessment—essential for production deployment decisions and ongoing performance monitoring.
by moonwell-fi
You can convert complex datasets and business metrics into polished, executive-ready reports that stakeholders trust and act on. Claude generates data-driven narratives, executive summaries, actionable insights, and visualization recommendations tailored to your audience's priorities. Your reports will tell a cohesive story that connects metrics to business outcomes, eliminating confusion and accelerating decision-making.
by moonwell-fi
This skill walks you through the complete dataset preparation workflow for fine-tuning Claude models. You'll validate training data quality, detect and fix formatting errors, identify data imbalances, and generate validation reports to ensure your fine-tuned model performs reliably in production.
by moonwell-fi
This skill provides a systematic framework for preparing training data, benchmarking model performance, identifying deployment risks, and calculating true ROI before committing fine-tuning investments. You'll validate datasets, run structured evaluations against baseline Claude models, test edge cases, and iterate toward production-ready fine-tuned versions. The framework ensures your fine-tuned models deliver meaningful improvements while maintaining safety and cost-effectiveness.
by moonwell-fi
Diagnose root causes of model performance failures, select optimal evaluation metrics based on your use case and data characteristics, and design comprehensive evaluation strategies. You'll get systematic workflows for analyzing failure modes, statistical significance testing, threshold optimization, and cross-validation planning—turning vague model problems into actionable fixes.
by moonwell-fi
You can build production-grade vector search systems that retrieve semantically similar documents in sub-millisecond time using AgentDB's optimized HNSW indexing. The skill enables you to implement RAG pipelines, semantic search engines, and intelligent knowledge bases with configurable embedding dimensions, distance metrics (cosine, Euclidean, dot product), and similarity thresholds—all with built-in quantization and caching for massive performance gains.
by moonwell-fi