MLOps System Diagnostic & Troubleshooting
Diagnose ML pipeline failures in minutes with structured log analysis
What You Can Do
You can rapidly identify root causes of training failures, data pipeline breakdowns, and model serving issues by analyzing logs, metrics, and infrastructure state. Claude examines your system events, resource utilization patterns, and error traces to pinpoint performance bottlenecks, data quality problems, and deployment misconfigurations—then recommends targeted remediation steps.
Features
Convert unstructured logs into searchable diagnostic timelines with event correlation
Trace failures back to their origin (data, compute, configuration, dependency)
Spot training slowdowns, GPU utilization issues, and I/O contention
Detect schema drift, missing values, distribution anomalies in training data
Analyze latency, throughput, and error rates in inference pipelines
Correlate errors across microservices, workers, and cloud infrastructure
Identify memory leaks, CPU saturation, disk space issues, and network congestion
Create step-by-step remediation guides from diagnostic findings
Example Output
Example 1: Training Failure Diagnosis
Symptom: Training job OOM-killed after 2 hours
Claude Analysis:
✓ Identified: Batch size 256 + gradient accumulation 4 = effective batch 1024
✓ Bottleneck: GPU memory 80GB insufficient for model + optimizer state
✓ Timeline: Memory usage grew 15% per epoch (no weight decay regularization)
✓ Recommendation: Reduce batch to 128, enable gradient checkpointing, add L2 regularization
Example 2: Data Pipeline Stall
Symptom: Daily ETL hangs, training waits 6+ hours for data
Claude Analysis:
✓ Root cause: CSV read operation on 500GB file via single process
✓ Bottleneck: S3 download bandwidth 50MB/s (3 hours), parsing 200MB/s (50 mins)
✓ Contributing factor: No partitioning strategy; full scan on every run
✓ Recommendation: Enable columnar format (Parquet), add time-range partitioning, parallelize reads (8 workers)
✓ Expected speedup: 6h → 45 min
Example 3: Model Serving Latency
Symptom: p95 inference latency 500ms (target 50ms)
Claude Analysis:
✓ Profiled request breakdown: Model inference 15ms + preprocessing 350ms + postprocessing 100ms
✓ Bottleneck: Preprocessing serializes NLP tokenization on CPU
✓ Issue: Model deployed on single GPU; 100 concurrent requests queue
✓ Recommendation: Batch tokenization, add GPU queue, deploy 4 replicas behind load balancer
✓ Expected p95 latency: 500ms → 65ms
What's Included
- SKILL.md: Full diagnostic workflows with decision trees for training, data, and serving failures
- Log Analysis Template: Structured checklist for parsing and correlating events
- Performance Profiling Guide: Step-by-step GPU/CPU/memory/I/O analysis framework
- Data Quality Verification Checklist: Schema, completeness, distribution validation
- Incident Response Runbook: Diagnostic questions and remediation workflow
- Metrics Collection Checklist: Essential metrics to capture for future debugging
- Troubleshooting Decision Tree: Flowchart to narrow failure category quickly
- Post-Incident Review Template: Lessons learned and prevention measures
Who It's For
- ML Engineers — Diagnosing failed training runs and production model issues
- MLOps Engineers — Troubleshooting infrastructure, pipeline orchestration, and resource constraints
- Data Engineers — Identifying data quality issues, ETL bottlenecks, and schema problems
- Platform/DevOps Teams — Debugging distributed systems, Kubernetes deployments, cloud service issues
- Incident Response Teams — Rapidly responding to model serving outages and training failures
Best For
- Training job failures — OOM errors, convergence issues, data loading timeouts, GPU/TPU utilization problems
- Data pipeline breakdowns — ETL stalls, schema drift, missing data, slow ingestion, partitioning issues
- Model serving incidents — High latency, throughput degradation, error spikes, cold start delays
- Performance optimization — Identifying and resolving bottlenecks in training, inference, and data pipelines
- Infrastructure debugging — Resource contention, Kubernetes pod evictions, cloud quota issues, network congestion
You might also like
Analyze Solidity and other smart contract code for security vulnerabilities, gas inefficiencies, and best practice violations. Get detailed reports with risk scoring, remediation suggestions, and optimization recommendations. Whether you're auditing before deployment or reviewing third-party contracts, this skill identifies critical issues faster than manual review.
You can systematically diagnose database performance bottlenecks by sharing your schema, slow query logs, and execution plans with Claude. It identifies root causes—missing indexes, inefficient joins, lock contention—and provides prioritized recommendations with ready-to-implement SQL. Skip the manual log analysis and get tuning strategies tailored to your workload.
This skill provides a structured approach to analyzing process problems, identifying root causes, and recommending capacity optimizations. You'll get clear bottleneck identification, data-driven recommendations, and a framework to validate whether your solutions actually work. Perfect for diagnosing why workflows are slow and finding the leverage points that matter most.
Use Claude to systematically analyze your database queries, execution plans, and schema to identify performance bottlenecks. The skill generates actionable optimization recommendations with SQL rewrites, index strategies, and configuration tuning. You'll receive detailed before-and-after performance analysis to validate improvements and prioritize work by impact.
You'll design and implement mobile features with architectural rigor, cross-platform considerations, and edge-case handling built-in. This skill generates complete system designs, platform-specific implementation strategies, performance optimization approaches, and testing frameworks. The output is production-ready guidance spanning iOS and Android with security, offline resilience, and deployment strategies included.
Design and optimize injectable formulations by analyzing your active pharmaceutical ingredient (API), selecting compatible excipients, and predicting stability outcomes. You'll receive systematic workflows that guide you through API characterization, formulation architecture, and risk mitigation—enabling faster development cycles and regulatory-ready documentation.
You'll develop systematic approaches to injectable formulation design, from API selection through sterilization strategy. Claude helps you troubleshoot failed batches by analyzing root causes, recommends regulatory pathways (505(b)(2), ANDA, NDA), and provides science-backed solutions for stability, compatibility, and manufacturability challenges.
You can architect multi-node ROS control systems from scratch, including node design patterns, communication flows, and real-time constraints. You'll debug complex node interactions using publisher/subscriber analysis, service call tracing, and action server diagnostics. You can optimize motion controllers through PID tuning, trajectory planning validation, and performance profiling to achieve precise, responsive robotic behavior.