RunComfy AI Media Skills
AI music, video, and image generation suite for Claude agents using RunComfy
What You Can Do
Access RunComfy's full suite of AI media models directly from Claude. Generate music with ACE Step (tag-driven composition, inpainting, outpainting at $0.0002/s), create talking-head and avatar videos with OmniHuman, Wan 2-7, HappyHorse, and Seedance v2. Edit images, generate videos, perform face-swaps, and inpaint media. Skills classify user intent automatically and pick the right model, invoke via RunComfy CLI, and retrieve outputs into your workflow.
Features
Tag-driven composition (genre, mood, instruments, BPM), multilingual lyric support (50+ languages via ACE Step 1.5), audio inpainting (regenerate time ranges), audio outpainting (extend before/after), 5-240 seconds per call. Cost: $0.0002-0.0003/s (27x cheaper than ElevenLabs Music).
Routes across OmniHuman (audio-driven full-body from portrait), Wan 2-7 (scene-controlled with audio_url), HappyHorse (text-to-video or image-to-video with in-pass audio), and Seedance v2 Pro (cinematic multi-modal). Automatic intent classification picks the right model.
Multiple models including Flux Kontext, GPT Image Edit, Nano Banana 2, and nano-banana-edit. Generate, edit, and manipulate images with straightforward JSON schemas.
Text-to-video, image-to-video, video inpainting, video editing. Models include HappyHorse 1.0 (Arena top-ranked), Seedance v2, Kling 3.0, Seedance v2 Minimax, and WAN 2-7.
Skills analyze user requests (cost-sensitive vs premium, photoreal vs stylized, cinematic vs simple, script vs audio file) and automatically select the optimal model and endpoint. No manual model ID selection needed.
Fixed seeds for reproducibility, detailed cost tables per endpoint, cheap-draft patterns (iterate with ACE Step base then polish), and explicit pricing guidance throughout.
Token stored with mode 0600, JSON-only input (no shell injection), input boundary validation, outbound endpoint allowlist, guidance on third-party content risks and lyrics provenance.
Unified command interface (`runcomfy run <model_id> --input '...' --output-dir ./out`). One-line install, automatic polling, automatic file downloads, structured exit codes (0-77) for reliable error handling.
Example Output
Generate background music for a game loop:
runcomfy run acestep-ai/ace-step/text-to-audio \
--input '{"tags": "lo-fi hip-hop, mellow, vinyl crackle, rhodes piano, soft drums, 75 BPM", "lyrics": "[inst]", "duration": 90}' \
--output-dir ./out
ACE Step generates a 90-second loopable background track with consistent groove and seamless loop structure. Cost: approximately 1.8 cents.
Create a talking-head video from existing voiceover:
runcomfy run bytedance/omnihuman/api \
--input '{"image_url": "https://your-cdn.example/presenter.jpg", "audio_url": "https://your-cdn.example/voiceover.mp3"}' \
--output-dir ./out
OmniHuman syncs the portrait to the audio with natural mouth movements and gestures. One call, no prompt required, output ready for immediate use.
Extend a short musical hook into a complete track:
runcomfy run acestep-ai/ace-step/audio-outpaint \
--input '{"audio": "https://your-cdn.example/hook-30s.mp3", "tags": "indie pop, electric guitar, drums, build-up, fade outro", "extend_before_duration": 30, "extend_after_duration": 60}' \
--output-dir ./out
ACE Step outpainting adds 30 seconds of intro and 60 seconds of outro to the original hook, creating a full 2-minute production-ready track.
What's Included
- 30+ AI Skills: ACE Step music generation, OmniHuman avatar, Wan 2-7 video, HappyHorse talking-head, Seedance cinematic, plus image generation, video editing, inpainting, face-swap, and specialized models.
- Documented Prompting Patterns: Tag combinations for music, lyric markers for structured vocals, scene descriptions for video, model-specific tips (e.g., quote scripts for HappyHorse, match tags for inpaint blending).
- Intent Classification Logic: Built-in classification to analyze whether user has pre-recorded audio vs needs generation, photoreal vs stylized, single-shot vs cinematic, and route to optimal model automatically.
- Cost Analysis & Comparison Tables: Pricing breakdown per endpoint, ACE Step vs ElevenLabs Music tradeoff matrix, cheap-draft patterns, and model-specific cost estimates with Gaussian distributions.
- Security & Privacy Guidance: Best practices for token storage, input boundary analysis (JSON prevents shell injection), third-party content risk assessment, and lyrics provenance confirmation.
- Exit Code Reference: Structured error codes (0 success, 64 bad args, 65 schema mismatch, 69 upstream error, 75 retryable timeout, 77 auth failed) for reliable error handling in automation.
Who It's For
- Content Creators
- Game & Interactive Developers
- Video Producers & Editors
- Music Producers & Sound Designers
- Marketing & UGC Creative Teams
Best For
- Batch media generation at scale
- Multi-language dubbed content pipelines
- Iterative creative workflows and drafting
- Cost-sensitive background media production
- Avatar and talking-head video workflows
You might also like
Build customized weight management strategies and behavioral coaching plans tailored to each client's unique health context. Generate motivational scripts, progress tracking systems, and client communications that support sustainable lifestyle change. Use Claude's analytical capabilities to develop evidence-based interventions grounded in behavioral psychology and nutrition science.
You develop structured acupuncture treatment plans by conducting thorough TCM assessments and selecting evidence-informed point protocols tailored to each patient's pain presentation and constitution. Claude helps you differentiate syndromes, sequence treatments, personalize protocols based on patient factors, and document clinical progress systematically. This ensures consistent, high-quality treatment planning that integrates traditional principles with modern clinical practice.
The Lark CLI is the official command-line interface for Lark (飞书), packed with 35+ AI agent skills and 200+ commands. Automate workflows across your entire Lark workspace: manage approvals and attendance, develop custom applications with Miaoda, query and analyze multi-dimensional base tables, handle documents and sheets, schedule meetings, send messages, manage mail and tasks, and integrate with external APIs. Built for both humans and AI agents with comprehensive business domain coverage.
Create evidence-based acupuncture treatment plans that synthesize Traditional Chinese Medicine diagnostics with Western medical findings and patient history. You'll generate customized protocols with specific point recommendations, patient education materials, and professional clinical documentation ready for patient handoff and insurance submission.
Create production-ready mobile app designs by describing what you want in plain language. Use chat-based requests to design screens, iterate with follow-up messages, and export code implementations for HTML, React Native, and SwiftUI. Features include live design preview in the Sleek editor, component screenshot generation, and built-in design references to seed your visual style.
This comprehensive collection includes 79 dedicated agent skills for all major Azure services and operations. You can automate Azure resource deployment and management, query infrastructure and logs with natural language using Kusto Graph and IRQL, analyze security events and detect threats, configure identity and access management through Entra ID, monitor application performance with Application Insights, manage storage and messaging services, execute cloud migration workflows, validate compliance policies, and query Azure resources by metadata or properties.
Create comprehensive, evidence-based nutrition programs that respect cultural preferences, address health disparities, and engage community stakeholders. You'll develop implementation plans complete with budgets, timelines, educational materials, and evaluation metrics that ensure your program achieves measurable health outcomes while building community buy-in and long-term sustainability.
Generate comprehensive, personalized wellness plans tailored to individual client health profiles, goals, and lifestyles. You provide client information and Claude creates detailed, evidence-based plans including nutrition protocols, exercise routines, behavioral strategies, and progress tracking tools. Plans are customized for remote delivery with built-in accountability and monitoring mechanisms.