Runwayml + Luma AI

🚀 Runway MCP Server

This project provides a service for video and image generation and editing. It allows users to generate videos from images, edit existing videos, generate images based on text prompts, and create video animations.

🚀 Quick Start

📦 Installation

To use this service, follow these steps to install and run the server:

1. Clone the code repository

   git clone https://github.com/your-username/runway-mcp-server.git
   cd runway-mcp-server
   

2. Install dependencies

   npm install
   

3. Start the server

   node index.js
   

By default, the server will run on http://localhost:3000. If necessary, modify the configuration in config.json.

✨ Features

🛠️ Tool List

Here is a complete list of available tools:

1. Video Generation (RunwayML)

• Tool Name: generate_video_from_image
• Parameters:
  • prompt: Description of the content to be generated
  • duration: Duration of the generated video (in seconds)
  • model: Model to use (optional, default is runwayml/generative)
    • Available values: runwayml/generative, runwayml/paint
• Return: URL of the generated video

2. Video Editing (Adobe)

• Tool Name: edit_video
• Parameters:
  • source_url: URL of the video to be edited
  • operations: List of operations (in JSON array format)

    [
      {
        "type": "trim",
        "start": 0,
        "end": 10
      },
      {
        "type": "add_audio",
        "audio_url": "your-audio-url"
      }
    ]
    

• Return: URL of the edited video

3. Image Generation (Luma)

• Tool Name: luma_generate_image
• Parameters:
  • prompt: Description of the image to be generated
  • aspect_ratio: Aspect ratio (optional, default is 16:9)
  • image_ref: URL of the reference image (optional)
• Return: URL of the generated image

4. Video Animation (Luma)

• Tool Name: luma_generate_video
• Parameters:
  • prompt_image: URL of the image to be animated
  • duration: Duration of the animation (in seconds)
  • aspect_ratio: Aspect ratio (optional, default is 16:9)
• Return: URL of the animated video

💻 Usage Examples

Example 1: Generate a Simple Animated Video

Goal: Create a short video showcasing product features.

Steps:

1. Generate a product image

   {
     "tool_name": "luma_generate_image",
     "arguments": {
       "prompt": "A futuristic smartphone with glowing interface features.",
       "aspect_ratio": "9:16"
     }
   }
   

2. Convert the image to a video

   {
     "tool_name": "luma_generate_video",
     // Assume there are other parameters here in the original, but not fully provided
   }