Luma AI MCP Server: Unleash AI-Powered Video & Image Creation

The Luma AI MCP (Model Context Protocol) Server connects cutting-edge AI video and image generation capabilities to your workflow. By integrating with Luma AI’s Dream Machine API, this server empowers you to create, manage, and manipulate AI-generated visual content directly within your preferred AI assistant environments, such as Claude Desktop.

Understanding MCP and its Significance

Before diving deeper, let’s clarify the core concept: MCP, or Model Context Protocol. MCP is an open standard that streamlines how applications provide contextual information to Large Language Models (LLMs). Think of it as a universal translator, enabling LLMs to access and understand data from diverse sources. In the context of the Luma AI MCP Server, it acts as a bridge, allowing AI models to tap into Luma’s powerful AI engine for video and image creation.

Key Features and Capabilities

The Luma AI MCP Server boasts a comprehensive suite of tools for AI-driven content generation:

• Text-to-Video Generation: Transform your textual ideas into captivating videos. Simply provide a text prompt, and the server will generate a video based on your description.
• Advanced Video Generation with Keyframes: Fine-tune your video creations using keyframes. Control the starting and ending frames with image or video references for precise results.
• Image-to-Video Conversion: Breathe life into your static images by converting them into dynamic videos.
• Video Extension and Interpolation: Seamlessly extend existing videos or create smooth transitions between different video clips.
• Image Generation with Reference Images: Guide the image generation process by providing reference images, ensuring the output aligns with your desired style and composition.
• Audio Addition to Videos: Enhance your videos with AI-generated audio tracks, adding another layer of immersion and engagement.
• Video Upscaling: Increase the resolution of your videos to enhance visual quality and clarity.
• Credit Management: Keep track of your Luma AI API credits and manage your usage effectively.
• Generation Tracking and Status Checking: Monitor the progress of your generations and receive updates on their status.

Diving into the Tools: A Detailed Look

The Luma AI MCP Server provides a set of meticulously crafted tools to cater to diverse creative needs:

1. ping: This tool serves as a simple health check for the Luma AI API. It verifies if the API is running and accessible, ensuring a stable connection for subsequent operations. No parameters are required.
2. create_generation: This is the core tool for initiating video generation. It accepts various parameters to customize the output:
   • prompt (string, required): The text description that guides the video generation. Be as descriptive as possible to achieve the desired outcome.
   • model (string, optional): Specifies the AI model to use. Options include “ray-1-6”, “ray-2” (default, known for best quality), and “ray-flash-2” (optimized for speed).
   • resolution (string, optional): Defines the video resolution. Available choices are “540p”, “720p”, “1080p”, and “4k”.
   • duration (string, optional): Sets the video duration. Currently, only “5s” and “9s” are supported.
   • aspect_ratio (string, optional): Determines the video’s aspect ratio (e.g., “16:9”, “1:1”, “9:16”).
   • loop (boolean, optional): Creates a looping video if set to true.
   • keyframes (object, optional): Enables advanced video generation by specifying start and end frames using image or video references.
3. get_generation: This tool retrieves the status of a specific generation based on its unique generation_id. The output provides information on the generation’s state (queued, dreaming, completed, or failed), the failure reason (if applicable), and the video URL (if completed).
4. list_generations: This tool provides a list of all your generations, with options to limit the number of results (limit) and offset the starting point (offset).
5. delete_generation: This tool allows you to remove unwanted generations by specifying their generation_id. This helps maintain a clean and organized workspace.
6. upscale_generation: This tool enhances the resolution of a completed video generation. You must specify the generation_id and the target resolution (“540p”, “720p”, “1080p”, or “4k”). Note that the target resolution must be higher than the original, and each generation can only be upscaled once.
7. add_audio: This tool adds AI-generated audio to a video generation. You need to provide the generation_id and a prompt for the audio. Optional parameters include negative_prompt and callback_url.
8. generate_image: This tool generates images from text prompts, optionally incorporating reference images for style, character, or overall composition. Key parameters include prompt, model (“photon-1” or “photon-flash-1”), aspect_ratio, and various reference image options (image_ref, style_ref, character_ref, modify_image_ref).
9. get_credits: This tool retrieves your current Luma AI API credit balance in USD cents.
10. get_camera_motions: This tool lists all the supported camera motions available for video generation.

Use Cases: Transforming Industries

The Luma AI MCP Server unlocks a wide array of use cases across various industries:

• Marketing & Advertising: Create engaging video ads, product demos, and social media content with ease.
• Education & E-learning: Develop interactive educational videos and visual aids to enhance learning experiences.
• Entertainment & Gaming: Generate stunning visual effects, character animations, and game cinematics.
• Content Creation: Produce high-quality videos for YouTube, TikTok, and other platforms.
• Architecture & Design: Visualize architectural designs and create virtual tours.
• Scientific Visualization: Generate visualizations of complex data and scientific concepts.

Integrating with Claude Desktop: A Step-by-Step Guide

Seamlessly integrate the Luma AI MCP Server with Claude Desktop to access its powerful capabilities directly within your conversations:

1. Obtain your Luma API Key: Sign up or log in to Luma AI (https://lumalabs.ai) to retrieve your unique API key.

2. Configure Claude Desktop: Modify the Claude Desktop configuration file:

   • macOS: ~/Library/Application Support/Claude/claude_desktop_config.json
   • Windows: %APPDATA%Claudeclaude_desktop_config.json

   Add the following JSON snippet, replacing placeholders with your actual values:

   { “mcpServers”: { “luma”: { “command”: “uv”, “args”: [ “run”, “–project”, “/path/to/your/luma-ai-mcp-server”, “-m”, “luma_ai_mcp_server” ], “env”: { “LUMA_API_KEY”: “your-luma-api-key-here” } } } }

   • Replace /path/to/your/luma-ai-mcp-server with the correct path to your server directory.
   • Replace your-luma-api-key-here with your actual Luma API key.

3. Restart Claude Desktop: Restart Claude Desktop to apply the changes.

4. Start Creating! You can now use Luma AI tools directly within your Claude Desktop conversations.

Troubleshooting Common Issues

Encountering problems? Here are some quick solutions:

• API Key Verification: Double-check that your API key is correct.
• Path Accuracy: Ensure the path to the server directory is accurate.
• Log Analysis: View logs for detailed error messages: tail -n 20 -f ~/Library/Logs/Claude/mcp*.log

Advanced Video Generation Techniques

The Luma AI API empowers you with advanced video generation techniques through keyframes:

• Starting from an Image: Provide frame0 with type: "image" and an image URL to initiate the video from a specific image.
• Ending with an Image: Provide frame1 with type: "image" and an image URL to conclude the video with a specific image.
• Extending a Video: Provide frame0 with type: "generation" and a generation ID to extend an existing video.
• Reverse Extending a Video: Provide frame1 with type: "generation" and a generation ID to reverse extend an existing video.
• Interpolating Between Videos: Provide both frame0 and frame1 with type: "generation" and generation IDs to create a smooth transition between two videos.

Important API Limitations and Notes

Be mindful of these limitations and notes when using the Luma AI API:

• Duration Restrictions: Only “5s” and “9s” durations are currently supported.
• Resolution Options: Valid resolutions include “540p”, “720p”, “1080p”, and “4k”.
• Model Selection:
  • Video Generation: Choose between “ray-2” (default, best quality), “ray-flash-2” (faster), and “ray-1-6” (legacy).
  • Image Generation: Choose between “photon-1” (default, best quality) and “photon-flash-1” (faster).
• Generation Types: Supports video, image, and advanced (keyframes) generations.
• Aspect Ratios: Offers various aspect ratios, including “1:1”, “16:9”, “9:16”, “4:3”, “3:4”, “21:9”, and “9:21”.
• Generation States: Generations can be in one of the following states: “queued”, “dreaming”, “completed”, or “failed”.
• Upscaling Requirements: Video generations must be in a “completed” state to be upscaled, and the target resolution must be higher than the original.
• API Key Dependency: An API key is essential and must be set in the environment variables.
• API Version: Utilizes Dream Machine API v1.

UBOS: Enhancing AI Agent Development

While the Luma AI MCP Server empowers individual video and image creation, UBOS (https://ubos.tech) provides a comprehensive platform for developing and orchestrating AI Agents at scale. UBOS enables you to:

• Orchestrate AI Agents: Manage and coordinate multiple AI Agents to achieve complex tasks.
• Connect to Enterprise Data: Seamlessly integrate AI Agents with your existing data sources.
• Build Custom AI Agents: Create tailored AI Agents using your own LLM models.
• Develop Multi-Agent Systems: Design and deploy sophisticated systems with interconnected AI Agents.

By combining the creative power of the Luma AI MCP Server with the robust AI Agent development capabilities of UBOS, you can unlock unprecedented potential for innovation and automation within your organization.

In conclusion, the Luma AI MCP Server is a game-changer for anyone looking to harness the power of AI for video and image creation. Its ease of use, combined with its advanced features, makes it an indispensable tool for creatives, marketers, educators, and anyone seeking to bring their ideas to life through stunning visual content. And with UBOS, you can take your AI Agent development to the next level, building intelligent systems that transform your business processes.