Best Local models tools

1. 1
   LocalAI

   Open-source local AI engine with MCP support

   github.com/mudler/LocalAI
   49,553 ★
2. 2
   LM Studio (MCP host) ↗HOSTED / DOCS

   Acts as an MCP host since 0.3.17; uses the mcp.json format

   lmstudio.ai/docs/app/mcp
   n/a
3. 3
   LM Studio CLI ↗

   lms CLI for LM Studio

   github.com/lmstudio-ai/lms
   5,352 ★
4. 4
   fast-agent

   Agent framework that works with Ollama and local models

   github.com/evalstate/fast-agent
   3,936 ★
5. 5
   ollama-mcp-bridge ↗

   Lets local Ollama models use MCP tools · No push since Apr 2025

   github.com/patruff/ollama-mcp-bridge
   985 ★
6. 6
   mcp-client-for-ollama

   TUI MCP client for Ollama

   github.com/jonigl/mcp-client-for-ollama
   830 ★
7. 7
   ollama-mcp

   MCP server that exposes Ollama

   github.com/rawveg/ollama-mcp
   175 ★
8. 8
   MCPHost ↗ARCHIVED

   CLI host for LLMs with MCP tools

   github.com/mark3labs/mcphost
   1,594 ★

More from the index

Tools whose name, description or GitHub topics match this topic, ranked by live GitHub stars. Keyword-matched, not reviewed by hand.

1. O

   #1Open Webui

   User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

   MCP serverAI & LLM toolingMemory & knowledge+105 this week

   $pip install open-webui

   ★ 156k
2. C

   #2Chatbox

   Powerful AI Client

   PluginAI & LLM tooling+8 this week

   $git clone https://github.com/chatboxai/chatbox

   ★ 42k
3. P

   #3PDFMathTranslate

   [EMNLP 2025 Demo] PDF scientific paper translation with preserved formats - 基于 AI 完整保留排版的 PDF 文档全文双语翻译，支持 Google/DeepL/Ollama/OpenAI 等服务，提供 CLI/GUI/MCP/Docker/Zotero

   MCP serverAI & LLM toolingDev tools+32 this week

   $pip install uv

   ★ 37.6k
4. M

   #4MaxKB

   MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。

   MCP serverAI & LLM toolingMemory & knowledge+6 this week

   $docker run -d --name=maxkb --restart=always -p 8080:8080 -v ~/.maxkb:/opt/maxkb 1panel/maxkb

   ★ 23k
5. F

   #5FunASR

   Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.

   MCP serverMedia & audioAI & LLM tooling+14 this week

   $pip install torch torchaudio

   ★ 20.7k
6. O

   #6Opencodex

   Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code

   PluginAI & LLM toolingFrameworks & SDKs+45 this week

   $npm install -g @bitkyc08/opencodex

   ★ 17.5k
7. D

   #7Docker Android

   Android in docker solution with noVNC supported, video recording, mcp server and AI-agent

   MCP serverCloud & infraDev tools+8 this week

   $docker run -d -p 6080:6080 -e EMULATOR_DEVICE="Samsung Galaxy S10" -e WEB_VNC=true --device /dev/kvm --name android-container budtmo/docker-android:emulator_11.0

   ★ 16k
8. B

   #8BrowserOS

   The open-source Agentic browser; alternative to ChatGPT Atlas, Perplexity Comet, Dia.

   MCP serverAI & LLM toolingMobile & desktop

   $brew install --cask browseros-neo

   ★ 13.9k
9. A

   #9AI Research SKILLs

   Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research…

   Agent skillAI & LLM tooling+24 this week

   $/plugin marketplace add orchestra-research/AI-research-SKILLs

   ★ 13.6k
10. H

    #10Html Anything

    The agentic HTML editor — your local AI agent writes the HTML, you ship it. 75 Skills × 9 Surfaces (magazine · deck · poster · XHS / tweet · prototype · data report ·…

    Agent skillAI & LLM toolingDesign & frontend+13 this week

    $git clone https://github.com/nexu-io/html-anything

    ★ 9.1k
11. O

    #11Open Codesign

    Open-source Claude Design alternative. One-click import your Claude Code / Codex API key. Prompt → prototype / slides / PDF. Multi-model (Claude, GPT, Gemini, Kimi, GLM,…

    PluginAI & LLM toolingDesign & frontend

    $brew install --cask opencoworkai/tap/open-codesign

    ★ 8.1k
12. O

    #12Osaurus

    Own your AI. The native macOS harness for AI agents -- any model, persistent memory, autonomous execution, cryptographic identity. Built in Swift. Fully offline. Open source.

    MCP serverAI & LLM toolingMobile & desktop+2 this week

    $brew install --cask osaurus

    ★ 8.1k
13. O

    #13Open Multi Agent

    Self-hosted TypeScript agent runtime with durable approvals and verifiable run records. Own it, approve it, audit it.

    MCP serverAI & LLM toolingSecurity

    $npm install @open-multi-agent/core

    ★ 7k
14. C

    #14Codecompanion.Nvim

    AI Coding, Vim Style

    PluginAI & LLM tooling

    $git clone https://github.com/olimorris/codecompanion.nvim

    ★ 6.9k
15. L

    #15Lemonade

    Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

    MCP serverAI & LLM toolingChat & social+4 this week

    $git clone https://github.com/lemonade-sdk/lemonade

    ★ 5.9k
16. U

    #16UltraRAG

    A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

    MCP serverAI & LLM toolingMemory & knowledge

    $pip install uv==0.12.0

    ★ 5.7k
17. K

    #17Kiln

    Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

    MCP serverAI & LLM toolingMobile & desktop

    $pip install kiln-ai

    ★ 5.2k
18. D

    #18Deep Research

    Use any LLMs (Large Language Models) for Deep Research. Support SSE API and MCP server.

    MCP serverAI & LLM tooling+1 this week

    $docker run -d --name deep-research -p 3333:3000 xiangfa/deep-research

    ★ 4.7k
19. K

    #19Koog

    Koog is a JVM (Java and Kotlin) framework for building predictable, fault-tolerant and enterprise-ready AI agents across all platforms – from backend services to Android and…

    MCP serverAI & LLM toolingMobile & desktop

    $git clone https://github.com/JetBrains/koog

    ★ 4.6k
20. C

    #20Claude Octopus

    Run multiple AI models against the same research, design, or coding task. Surface disagreements before you ship.

    PluginAI & LLM toolingDesign & frontend+4 this week

    $claude plugin install octo@nyldn-plugins

    ★ 4.2k
21. R

    #21Rapid MLX

    Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding…

    MCP serverAI & LLM toolingMobile & desktop

    $brew install rapid-mlx

    ★ 4k
22. P

    #22Pipeshub AI

    The open-source context layer for AI agents. PipesHub turns your company's knowledge (Slack, Drive, Jira, GitHub, Microsoft 365 and 40+ connectors) into a permission-aware…

    MCP serverMemory & knowledgeDev tools

    $git clone https://github.com/pipeshub-ai/pipeshub-ai

    ★ 3.8k
23. C

    #23Claude Code Local

    Run Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server. 6 fighters incl. Muse-Glimmer 30B (now multimodal — reads images, abliterated),…

    PluginAI & LLM toolingMobile & desktop

    $git clone https://github.com/nicedreamzapp/claude-code-local

    ★ 3.4k
24. A

    #24Atomic Agent

    Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.

    MCP serverAI & LLM toolingBrowser automation

    $git clone https://github.com/AtomicBot-ai/atomic-agent

    ★ 3.3k
25. E

    #25EchoBird

    Manage ChatGPT, Codex CLI, and Claude Code accounts and track quota in one place. Use multi-model smart routing with priority and automatic failover. Install AI tools and…

    PluginAI & LLM tooling

    $git clone https://github.com/edison7009/EchoBird

    ★ 3.3k