MCP Protocol Validator

🚀 MCP Protocol Testing Framework

The MCP (Machine Communication Protocol) is a standard protocol for communication between machines. This testing framework aims to verify whether servers implementing the MCP protocol comply with the specifications and provides detailed test reports and result analysis.

🚀 Quick Start

Initialization Process

The testing process is as follows:

1. Initiate an initialization request.
2. The server responds with the initialization completion status.
3. Obtain and verify the tool list.

Tool List Retrieval

Call the list_tools() command to get information about available tools. The server should return all supported tools and their detailed descriptions.

✨ Features

Overview of Testing Framework Functions

• Protocol Version Detection: Automatically identify the currently used protocol version (default is MCP v1.0).
• Transport Layer Adaptation: Support both file - based and HTTP - based transport layer communication.
• Test Case Management: Built - in multiple sets of standardized test cases covering all functional modules required by the protocol.
• Result Analysis: Provide detailed test reports, including pass rate statistics, failure cause analysis, etc.

Detailed Function Description

Basic Command Interfaces

1. initialize()
2. list_tools()
3. execute_tool(tool_id, input_data)
4. shutdown()

Tool Management

• Support dynamic tool registration.
• Each tool must define clear operation instructions and input - output specifications.

💻 Usage Examples

Basic Usage

The following is a typical testing process:

# Initialize the connection
test.initialize()

# Get the list of available tools
tools = test.list_tools()
print(f"Available tools: {tools}")

# Execute the specified tool
input_data = {"key": "value"}
result = test.execute_tool("tool_id", input_data)
print(f"Execution result: {result}")

# Close the connection
test.shutdown()

📚 Documentation

Test Options

Basic Test Mode

# Standard test process
python -m mcp_testing.scripts.compliance_report --server-command "path/to/server"

# Specify the protocol version
python -m mcp_testing.scripts.compliance_report --protocol-version 1.0

Advanced Options

• --spec-coverage: Only test the functional points within the scope of the specification coverage.
• --auto-detect: Automatically identify the server's configuration parameters and capabilities.
• --output-dir: Specify the location of the output report.

Report Generation

After the test is completed, a detailed HTML report will be automatically generated, including:

1. Test overview
2. Specific cases of passes and failures
3. Protocol coverage analysis
4. Performance indicator statistics

Error Handling Mechanism

• Retry Strategy: Automatically retry for network fluctuations and temporary errors (default is 3 retries).
• Timeout Control: Each operation has an independent timeout setting to prevent long - term suspension.
• Exception Capture: Record all exceptions in detail and provide stack traces.

Dependency Management

Ensure that the following Python packages are installed:

pip install mcp-testing http-client jsonrpc

Configuration File

You can optionally configure a configuration file mcp_config.json with the following content:

{
    "protocol_version": "1.0",
    "server_url": "http://localhost:8080",
    "timeout": 30,
    "retries": 3
}

Execution Environment Requirements

• Operating System: Linux/Unix or Windows (Linux is recommended).
• Python Version: 3.8 or higher.
• Memory: At least 2GB is recommended.

Usage Steps

1. Install the dependency packages:

pip install -r requirements.txt

2. Configure the testing environment:
   • Modify the configuration file mcp_config.json.
   • Set the necessary environment variables.
3. Execute the test script:

python -m mcp_testing.run_tests

Output Report Example

The generated HTML report will include the following content:

• A summary table of test case execution results.
• Detailed failure logs and error analysis.
• A visual protocol coverage chart.

Compatibility Description

This framework has passed tests for multiple versions of the MCP protocol and is compatible with the following versions:

• MCP v1.0 (latest)
• MCP v0.9
• MCP v0.8

Appendix

Error Codes

Common errors and their handling methods:

# Server did not respond
raise ConnectionTimeout("Server did not respond in time")

# Invalid request format
raise InvalidRequestError("Malformed request format")

Usage Tip

💡 Usage Tip

• Regularly update the test case library to adapt to protocol changes.
• Adjust the timeout settings and retry strategy according to actual needs.

Contact Information

If you need feedback or technical support, please contact:

• Email: support@mcp - testing.com
• Phone: +86 - 123 - 4567890