Paint Ai Agent

🚀 Drawing Agent for Microsoft Paint

A Python-based automation tool that leverages Google's Gemini AI to control Microsoft Paint via natural language instructions. This project enables users to draw shapes, insert text, and manage colors in MS Paint using simple English commands.

🚀 Quick Start

1. Launch the drawing agent:

python talk2mcp.py

2. Enter natural language instructions, for example:

• "Draw a red circle in the center"
• "Write 'Hello World' at the top and display it in black"
• "Draw a blue rectangle on the right"

3. To exit the program, enter 'quit'

✨ Features

• Control MS Paint with natural language
• Automatically draw shapes (circles, rectangles, lines)
• Insert text with position control
• Select and manage colors
• Manage windows and position the canvas
• Maintain detailed logs and handle errors
• Implement a position calibration system

📦 Installation

1. Clone the repository:

git clone [repository URL]
cd paint-drawing-agent

2. Install the required dependencies:

pip install -r requirements.txt

3. Create a .env file in the project root directory and add your Google API key:

GOOGLE_API_KEY=your_api_key_here

📚 Documentation

Project Structure

paint-drawing-agent/
├── talk2mcp.py           # Main application file
├── tools/                # Core automation tools
│   ├── __init__.py
│   └── paint_commands.py # Paint automation commands
├── calibration_profiles/ # Stored calibration data
├── LLM_LOGS/            # AI interaction logs
├── logs/                # Application logs
└── requirements.txt     # Project dependencies

Calibration

The system uses a calibration system to precisely locate Paint interface elements. To recalibrate:

1. Run the calibration script:

python enhanced_calibrate.py

2. Follow the on-screen instructions to calibrate the tool positions

Logging

The system maintains multiple types of logs:

• Application logs: /logs/paint_agent_[timestamp].log
• AI interaction logs: /LLM_LOGS/session_log.json
• Calibration logs: /calibration_profiles/

Error Handling

The system includes comprehensive error handling capabilities, including:

• Window management issues
• Drawing operation failures
• AI communication errors
• Position calibration problems

Contribution Guidelines

1. Fork the repository
2. Create a feature branch
3. Commit your changes
4. Push to the branch
5. Create a pull request

Troubleshooting

Common issues and solutions:

1. Paint window not found
   • Ensure that MS Paint is installed
   • Manually run Paint and try again
2. Drawing position issues
   • Rerun the calibration program
   • Check if the screen resolution matches the calibration
3. AI communication errors
   • Verify the API key in the .env file
   • Check your internet connection

💻 Usage Examples

Basic Usage

> Draw a red circle in the center
> Write 'Hello World' at the top and display it in black
> Draw a blue rectangle at coordinates 400,300
> Draw a green line from the top to the bottom

📄 License

[Place your license information here]

Acknowledgments

• Google Gemini AI for natural language processing
• PyAutoGUI for GUI automation
• Win32GUI for Windows interaction