Agent skill · writing content · samhvw8
ai-multimodal
Multimodal AI processing via Google Gemini API (2M tokens context). Capabilities: audio (transcription, 9.5hr max, summarization, music analysis), images (captioning, OCR, object detection, segmentation, visual Q&A), video (scene detection, 6hr max, YouTube URLs, temporal analysis), documents (PDF extraction, tables, forms, charts), image generation (text-to-image, editing). Actions: transcribe, analyze, extract, caption, detect, segment, generate from media. Keywords: Gemini API, audio transcription, image captioning, OCR, object detection, video analysis, PDF extraction, text-to-image, multimodal, speech recognition, visual Q&A, scene detection, YouTube transcription, table extraction, form processing, image generation, Imagen. Use when: transcribing audio/video, analyzing images/screenshots, extracting data from PDFs, processing YouTube videos, generating images from text, implementing multimodal AI features.
Why this skill is useful
Adds executable scripts for audio transcription, image generation, and document extraction using the Google Gemini API that extend the AI's capabilities.
What it needs
Requires bash installed locally. Requires google-ai-studio, vertex-ai account access. About 6k tokens when loaded. Last updated 2025-12-09. 10 stars on the source repository.
What this skill does
AI Multimodal Processing Skill Process audio, images, videos, documents, and generate images using Google Gemini's multimodal API. Unified interface for all multimedia content understanding and generation. Core Capabilities Audio Processing Transcription with timestamps (up to 9.5 hours) Audio summarization and analysis Speech understanding and speaker identification Music and environmental sound analysis Text-to-speech generation with controllable voice Image Understanding Image captioning and description Object detection with bounding boxes (2.0+) Pixel-level segmentation (2.5+) Visual question answering Multi-image comparison (up to 3,600 images) OCR and text extraction Video Analysis Scene detection and summarization Video Q&A with temporal understanding Transcription with visual descriptions YouTube URL support Long video processing (up to 6 hours) Frame-level analysis Document Extraction Native PDF vision processing (up to 1,000 pages) Table and form extraction Chart and diagram analysis Multi-page document understanding Structured data output (JSON schema) Format conversion (PDF to HTML/JSON) Image Generation Text-to-image generation Image editing and modification Multi-image composition (up to 3 images) Iterative refinement Multiple aspect ratios (1:1, 16:9, 9:16, 4:3, 3:4) Controllable style and quality Capability Matrix Task Audio Image Video Document Generation ------ :-----: :-----: :-----: :--------: :----------: Transcription ✓ - ✓ - - Summarization ✓ ✓ ✓ ✓ - Q&A ✓ ✓ ✓ ✓ - Object Detection - ✓ ✓ - - Text Extraction - ✓ - ✓ - Structured Output ✓ ✓ ✓ ✓ - Creation TTS - - - ✓ Timestamps ✓ - ✓ - - Segmentation - ✓ - - - Model Selection Guide Gemini 2.5 Series (Recommended) gemini-2.5-pro: Highest quality, all features, 1M-2M context gemini-2.5-flash: Best balance, all features, 1M-2M context gemini-2.5-flash-lite: Lightweight, segmentation support gemini-2.5-flash-image: Image generation only Feature Requirements Segmentation: Requires 2.5+ models Object D …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills samhvw8/ai-multimodal