The MCP Company

🚀 OpenHands Clone for MCPAgent

This project is a clone of OpenHands from commit 91cd647f207ccf30c09e1ebf99ac6c3c22cfda64, with some modifications for implementing MCPAgent.

🚀 Quick Start

📦 Installation

Make sure you are in this directory (cd OpenHands from the root of the repo) before running the setup process. Follow these instructions to set up a development environment for evaluation. Here is a summary:

• Ensure that Docker and Poetry are installed, and you have python==3.12 and NodeJS >= 22.x.
• On Ubuntu, you also need build-essential (sudo apt install build-essential). On WSL, you need netcat (apt install netcat).
• Run make build. This process will take some time to complete.

💻 Usage Examples

Run Evaluations

For experiments with tool retrieval or an oracle tool set, first ensure that the correct MCP server is running before proceeding (instructions are here). Also, for all experiments, set your LLM configuration (e.g., model name, authentication token, etc.) in config.toml under the [llm.agent] key.

TheAgentCompany Tasks

Agent with access to Browser tool

Make the following changes to the config.toml file:

• Under [agent], set system_prompt_filename='system_prompt_cua.j2'

From this directory, run bash run_all_agc.sh cua

Agent with access to oracle tool set

Make the following changes to the config.toml file:

• Under [agent], set system_prompt_filename='system_prompt_gt_tools.j2'
• Under [agent], set enable_browsing=false
• Uncomment the following lines:

[mcp]
sse_servers = ["http://localhost:7879/sse"]

From this directory, run bash run_all_agc.sh gt_tools

Agent with tool retrieval (MCPAgent)

Make the following changes to the config.toml file:

• Under [agent], set system_prompt_filename='system_prompt_find_tools.j2'
• Under [agent], set enable_browsing=false
• Uncomment the following lines:

[mcp]
sse_servers = ["http://localhost:7879/sse"]

From this directory, run bash run_all_agc.sh dense_retrieval

Azure Tasks

Ensure that the MCP server with tool retrieval is running. Set your LLM configuration (e.g., model name, authentication token, etc.) in config.toml under the [llm.agent] key.

Make the following changes to the config.toml file:

• Under [agent], set system_prompt_filename='system_prompt_find_tools.j2'
• Under [agent], set enable_browsing=false
• Uncomment the following lines:

[mcp]
sse_servers = ["http://localhost:7879/sse"]

From this directory, run RUN_AZURE_TASKS=true bash run_all_agc.sh dense_retrieval