Agent skill · creative production · sundial-org
ai-video-gen
End-to-end AI video generation - create videos from text prompts using image generation, video synthesis, voice-over, and editing. Supports OpenAI DALL-E, Replicate models, LumaAI, Runway, and FFmpeg editing.
Why this skill is useful
Adds multiple executable scripts for end-to-end AI video generation that integrate various AI models and tools not commonly known to the AI.
What it needs
Requires ffmpeg, openai, pillow, python-dotenv, replicate, requests installed locally. Requires elevenlabs, lumaai, openai, replicate, runway account access. About 2k tokens when loaded. Last updated 2026-03-07. 639 stars on the source repository.
What this skill does
AI Video Generation Skill Generate complete videos from text descriptions using AI. Capabilities 1. Image Generation - DALL-E 3, Stable Diffusion, Flux 2. Video Generation - LumaAI, Runway, Replicate models 3. Voice-over - OpenAI TTS, ElevenLabs 4. Video Editing - FFmpeg assembly, transitions, overlays Quick Start Setup Required API Keys Add to your environment or .env file: Install Dependencies FFmpeg Already installed via winget. Usage Examples 1. Text to Video (Full Pipeline) 2. Multiple Scenes 3. Image Sequence to Video Workflow Options Budget Mode (FREE) Image: Stable Diffusion (local or free API) Video: Open source models Voice: OpenAI TTS (cheap) or free TTS Edit: FFmpeg Quality Mode (Paid) Image: DALL-E 3 or Midjourney Video: Runway Gen-3 or LumaAI Voice: ElevenLabs Edit: FFmpeg + effects Scripts Reference generatevideo.py - Main end-to-end generator imagestovideo.py - Convert image sequence to video addvoiceover.py - Add narration to existing video multiscene.py - Create multi-scene videos editvideo.py - Apply effects, transitions, overlays API Cost Estimates DALL-E 3: ~$0.04-0.08 per image Replicate: ~$0.01-0.10 per generation LumaAI: $0-0.50 per 5sec (free tier available) Runway: ~$0.05 per second OpenAI TTS: ~$0.015 per 1K characters ElevenLabs: ~$0.30 per 1K characters (better quality) Examples See examples/ folder for sample outputs and prompts.
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills sundial-org/ai-video-gen