MCPChatbot Example

This project demonstrates how to integrate the Model Context Protocol (MCP) with customized LLM (e.g. Qwen), creating a powerful chatbot that can interact with various tools through MCP servers. The implementation showcases the flexibility of MCP by enabling LLMs to use external tools seamlessly.

[!TIP] For Chinese version, please refer to README_ZH.md.

Overview

Chatbot Streamlit Example

Workflow Tracer Example

• 🚩 Update (2025-04-11):
  • Added chatbot streamlit example.
• 🚩 Update (2025-04-10):
  • More complex LLM response parsing, supporting multiple MCP tool calls and multiple chat iterations.
  • Added single prompt examples with both regular and streaming modes.
  • Added interactive terminal chatbot examples.

This project includes:

• Simple/Complex CLI chatbot interface
• Integration with some builtin MCP Server like (Markdown processing tools)
• Support for customized LLM (e.g. Qwen) and Ollama
• Example scripts for single prompt processing in both regular and streaming modes
• Interactive terminal chatbot with regular and streaming response modes

Requirements

• Python 3.10+
• Dependencies (automatically installed via requirements):
  • python-dotenv
  • mcp[cli]
  • openai
  • colorama

Installation

1. Clone the repository:

   git clone git@github.com:keli-wen/mcp_chatbot.git
   cd mcp_chatbot
   

2. Set up a virtual environment (recommended):

   cd folder
   
   # Install uv if you don't have it already
   pip install uv
   
   # Create a virtual environment and install dependencies
   uv venv .venv --python=3.10
   
   # Activate the virtual environment
   # For macOS/Linux
   source .venv/bin/activate
   # For Windows
   .venv\Scripts\activate
   
   # Deactivate the virtual environment
   deactivate
   

3. Install dependencies:

   pip install -r requirements.txt
   # or use uv for faster installation
   uv pip install -r requirements.txt
   

4. Configure your environment:

   • Copy the .env.example file to .env:

     cp .env.example .env
     

   • Edit the .env file to add your Qwen API key (just for demo, you can use any LLM API key, remember to set the base_url and api_key in the .env file) and set the paths:

     LLM_MODEL_NAME=your_llm_model_name_here
     LLM_BASE_URL=your_llm_base_url_here
     LLM_API_KEY=your_llm_api_key_here
     OLLAMA_MODEL_NAME=your_ollama_model_name_here
     OLLAMA_BASE_URL=your_ollama_base_url_here
     MARKDOWN_FOLDER_PATH=/path/to/your/markdown/folder
     RESULT_FOLDER_PATH=/path/to/your/result/folder
     

Important Configuration Notes ⚠️

Before running the application, you need to modify the following:

1. MCP Server Configuration: Edit mcp_servers/servers_config.json to match your local setup:

   {
       "mcpServers": {
           "markdown_processor": {
               "command": "/path/to/your/uv",
               "args": [
                   "--directory",
                   "/path/to/your/project/mcp_servers",
                   "run",
                   "markdown_processor.py"
               ]
           }
       }
   }