Production ML Deployment Architecture & System Diagnostics
Design production ML systems, diagnose failures, optimize architecture
What You Can Do
This skill helps you architect production-grade ML deployments, diagnose failures in distributed systems, and optimize performance bottlenecks through systematic architectural analysis. You'll design resilient inference pipelines, troubleshoot data flow issues, and identify optimization opportunities using proven MLOps patterns. Get actionable recommendations grounded in architecture-first thinking rather than point fixes.
Features
Build containerized inference pipelines with load balancing, auto-scaling, and multi-region strategies
Systematically trace failures across distributed components (data ingestion, model serving, orchestration)
Analyze latency, throughput, and resource utilization across GPU/CPU/memory/networking
Design redundancy, circuit breakers, fallback strategies, and graceful degradation patterns
Set up metrics, traces, logs, and alerting hierarchies for production systems
Right-size infrastructure, identify wasteful patterns, and balance performance vs. cloud spend
Design data validation, feature engineering workflows, and data quality monitoring
Example Output
Example 1: Deployment Architecture for Real-Time Inference
Component Topology:
┌─────────────────┐
│ Load Balancer │ (health check every 5s)
└────────┬────────┘
│
┌────┴────┐
│ │
┌───▼──┐ ┌───▼──┐
│ Pod 1 │ │ Pod 2 │ (auto-scale 2-10 pods based on QPS)
└───┬──┘ └───┬──┘
│ │
└────┬─────┘
│
┌────▼──────────┐
│ Feature Store │ (cached, 500ms TTL)
└────┬──────────┘
│
┌────▼──────────┐
│ Model Server │ (TorchServe + GPU)
└────────────────┘
Key Decisions:
• p95 latency: 120ms (50ms model, 30ms network, 40ms cache)
• Failover: Circuit breaker opens after 5 errors
• Auto-scale trigger: CPU > 70% for 2 minutes
Example 2: Production Failure Diagnosis
Issue: Inference latency spiked to 2s; error rate hit 15%
Root Cause Chain:
- Feature Store cache eviction (Redis memory full)
- Cache misses → DB fallback queries
- DB bottleneck → slow feature fetches
- Model server queued requests → timeout after 30s
- Client retries → cascading failures
Immediate Fix: Increased Redis memory, implemented cache prewarming Prevention: Set alerts at 80% memory; implement bulkhead isolation for feature store timeouts
Example 3: Cost Optimization Plan
Current: 4x GPU instances, $12k/month (avg utilization 25%)
Optimizations:
- Reduce to 2x GPU + spot pricing (-60% cost)
- Implement request batching (collect 32 predictions)
- Add CPU fallback for low-latency requests
- Cache 80% of prediction outputs
Result: $4.8k/month (60% savings) with p95 latency unchanged
What's Included
- SKILL.md file: Complete skill with decision trees, diagnostic workflows, and architecture templates
- Deployment Architecture Templates: Reference blueprints for single-region, multi-region, and edge ML deployments
- Failure Diagnosis Checklist: Systematic protocol to trace issues across data ingestion, model serving, and orchestration layers
- Performance Analysis Worksheet: Structured format to collect latency, throughput, and resource utilization metrics
- Monitoring Setup Guide: SLO definitions, alerting thresholds, and dashboard templates for production ML systems
- Resilience Pattern Library: Circuit breakers, bulkheads, timeouts, retry logic, and graceful degradation patterns
- Cost Analysis Template: Cloud resource costing model and optimization opportunities worksheet
Who It's For
- ML/Platform Engineers — deploying and maintaining production ML systems at scale
- DevOps/SRE teams — managing infrastructure reliability and performance optimization
- ML Research Leaders — scaling experimental models to production workloads
- Solutions Architects — designing enterprise ML deployment strategies
- System Performance Engineers — optimizing latency-sensitive ML workloads
Best For
- Architecting containerized ML inference systems at scale
- Diagnosing and resolving production outages in ML pipelines
- Optimizing GPU utilization and reducing compute costs
- Designing multi-region or edge ML deployment strategies
- Implementing monitoring and observability for production ML systems
You might also like
Analyze Solidity and other smart contract code for security vulnerabilities, gas inefficiencies, and best practice violations. Get detailed reports with risk scoring, remediation suggestions, and optimization recommendations. Whether you're auditing before deployment or reviewing third-party contracts, this skill identifies critical issues faster than manual review.
You can systematically diagnose database performance bottlenecks by sharing your schema, slow query logs, and execution plans with Claude. It identifies root causes—missing indexes, inefficient joins, lock contention—and provides prioritized recommendations with ready-to-implement SQL. Skip the manual log analysis and get tuning strategies tailored to your workload.
This skill provides a structured approach to analyzing process problems, identifying root causes, and recommending capacity optimizations. You'll get clear bottleneck identification, data-driven recommendations, and a framework to validate whether your solutions actually work. Perfect for diagnosing why workflows are slow and finding the leverage points that matter most.
Use Claude to systematically analyze your database queries, execution plans, and schema to identify performance bottlenecks. The skill generates actionable optimization recommendations with SQL rewrites, index strategies, and configuration tuning. You'll receive detailed before-and-after performance analysis to validate improvements and prioritize work by impact.
This skill evaluates your research protocols against institutional review board requirements, identifies compliance gaps, and generates the documentation needed for IRB submission. You receive a detailed assessment report, risk analysis, and ready-to-use documentation templates tailored to your specific research design.
Conduct organized security assessments using Claude as your strategic partner. You'll develop comprehensive test plans, identify vulnerabilities through systematic reconnaissance, document findings with professional rigor, and map security gaps to compliance frameworks. Claude helps you maintain audit trails, prioritize risks by business impact, and generate executive reports.
You can systematically evaluate cloud platforms, document architectural decisions with tradeoffs, and validate designs against security and compliance requirements. This skill accelerates architecture reviews, ensures consistency across teams, and reduces the cycles needed to reach approval on complex infrastructure decisions.
You can architect multi-node ROS control systems from scratch, including node design patterns, communication flows, and real-time constraints. You'll debug complex node interactions using publisher/subscriber analysis, service call tracing, and action server diagnostics. You can optimize motion controllers through PID tuning, trajectory planning validation, and performance profiling to achieve precise, responsive robotic behavior.