Scenic MCP Experimental

🚀 Scenic MCP - Input Control for Scenic Applications

A Model Context Protocol (MCP) server that enables external keyboard and mouse input injection into Scenic GUI applications.

🚀 Quick Start

Scenic MCP is a powerful server that allows you to inject external keyboard and mouse inputs into Scenic GUI applications. It provides a seamless way to interact with Scenic applications using MCP-compatible clients.

✨ Features

• Keyboard Input: Send text and special keys to Scenic applications
• Mouse Control: Move cursor and click at specific coordinates
• MCP Integration: Works with any MCP-compatible client (Claude Desktop, etc.)
• Real-time Communication: TCP-based connection for low-latency input
• Scenic Compatible: Uses proper Scenic ViewPort input routing

📦 Installation

Step 1: Add to your Scenic application's mix.exs

defp deps do
  [
    {:scenic_mcp, path: "../scenic_mcp"}
  ]
end

Step 2: Add to your application's supervision tree

Actually you shouldn't need to do this...

Step 3: Install Node.js dependencies

cd scenic_mcp
npm install

💻 Usage Examples

Basic Usage

The server provides these MCP tools:

connect_scenic

Test connection to the Scenic application.

get_scenic_status

Check server status and available commands.

send_keys

Send keyboard input to the Scenic application.

Parameters:

• text (string): Text to type (each character sent as individual key press)
• key (string): Special key name (enter, escape, tab, backspace, delete, up, down, left, right, home, end, page_up, page_down, f1-f12)
• modifiers (array): Modifier keys (ctrl, shift, alt, cmd, meta)

send_mouse_move

Move mouse cursor to specific coordinates.

Parameters:

• x (number): X coordinate
• y (number): Y coordinate

send_mouse_click

Click mouse at specific coordinates.

Parameters:

• x (number): X coordinate
• y (number): Y coordinate
• button (string): Mouse button (left, right, middle) - default: left

Advanced Usage

Here are some examples of using these tools:

Send text

{
  "action": "send_keys",
  "text": "hello world"
}

Send special key

{
  "action": "send_keys", 
  "key": "enter"
}

Send key with modifiers

{
  "action": "send_keys",
  "key": "c",
  "modifiers": ["ctrl"]
}

Move mouse

{
  "action": "send_mouse_move",
  "x": 100,
  "y": 200
}

Click mouse

{
  "action": "send_mouse_click",
  "x": 150,
  "y": 250,
  "button": "left"
}

📚 Documentation

Architecture

MCP Client (Claude Desktop)
    ↓
TypeScript MCP Server (scenic_mcp)
    ↓ (TCP port 9999)
Elixir GenServer Bridge
    ↓ (Scenic.ViewPort.Input.send/2)
Scenic ViewPort
    ↓
Your Scenic Application

Development

Start the Elixir server

cd your_scenic_app
mix run --no-halt

Test the MCP server

cd scenic_mcp
node src/index.ts

Requirements

• Elixir/OTP 24+
• Node.js 18+
• Scenic 0.11+

📄 License

This project is licensed under the MIT License.