Computer Control

🚀 Computer Control MCP

The MCP server provides computer control functions such as mouse, keyboard, OCR, etc., using PyAutoGUI, RapidOCR, and ONNXRuntime. Similar to Anthropic's 'computer - use'. It has no external dependencies.

⚠️ Important Note

This project has only been tested on Windows. It may also work on other platforms.

🚀 Quick Start

Setup MCP with uvx

{
  "mcpServers": {
    "computer-control-mcp": {
      "command": "uvx",
      "args": ["computer-control-mcp@latest"]
    }
  }
}

Global Installation via pip

pip install computer-control-mcp

Run the Server

computer-control-mcp # Instead of using uvx computer-control-mcp, this way you can use the latest version. You can also use `uv cache clean` to clear the cache and then use `uvx` again to get the latest version.

✨ Features

• Control mouse movement and clicks.
• Input text at the current cursor position.
• Capture screenshots of the entire screen or specific windows, optionally save them to the download directory.
• Extract text from screenshots using OCR (Optical Character Recognition).
• List and activate windows.
• Press keyboard keys.
• Perform drag - and - drop operations.

💻 Usage Examples

Available Tools

Mouse Control

• click_screen(x: int, y: int): Click at the specified screen coordinates.
• move_mouse(x: int, y: int): Move the mouse cursor to the specified coordinates.
• drag_mouse(from_x: int, from_y: int, to_x: int, to_y: int, duration: float = 0.5): Drag the mouse from one position to another.

Keyboard Control

• type_text(text: str): Input the specified text at the current cursor position.
• press_key(key: str): Press the specified keyboard key.

Screen and Window Management

• take_screenshot(title_pattern: str = None, use_regex: bool = False, threshold: int = 60, with_ocr_text_and_coords: bool = False, scale_percent_for_ocr: int = 100, save_to_downloads: bool = False): Capture a screen or window, optionally with OCR.
• get_screen_size(): Get the current screen resolution.
• list_windows(): List all open windows.
• activate_window(title_pattern: str, use_regex: bool = False, threshold: int = 60): Bring the specified window to the foreground.

🚧 Development

Set Up the Development Environment

# Clone the repository
git clone https://github.com/AB498/computer-control-mcp.git
cd computer-control-mcp

# Install in development mode
pip install -e .

# Start the server
python -m computer_control_mcp.core

Run Tests

python -m pytest

📚 Documentation

Check the API Reference for detailed information about available functions and classes.

📄 License

MIT

📞 More Information or Help

• Email (abcd49800@gmail.com)
• Discord Link