Atomic Chat

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, on your machine.

         

Getting Started · Hugging Face · Discord · X / Twitter · Bug Reports

---

📦 Download

Desktop

   

Mobile

 

---

🔌 Use It as an API

Atomic Chat runs an OpenAI-compatible server at http://localhost:1337/v1 — a drop-in replacement for the OpenAI SDK. Load a model in the app, then point any client at it:

curl http://localhost:1337/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "<model-id-loaded-in-atomic-chat>",
    "messages": [{ "role": "user", "content": "Say hello in one word" }]
  }'

from openai import OpenAI

# Atomic Chat is OpenAI API-compatible — only the base_url changes.
client = OpenAI(base_url="http://localhost:1337/v1", api_key="not-needed")

resp = client.chat.completions.create(
    model="<model-id-loaded-in-atomic-chat>",
    messages=[{"role": "user", "content": "Say hello in one word"}],
)
print(resp.choices[0].message.content)

Bound to 127.0.0.1 by default; set host: 0.0.0.0 to expose it on your LAN. Works with any agent, CLI, or IDE plugin that speaks the OpenAI API — see Launch With below.

---

✨ Features

Local models

• Run open-weight LLMs locally from HuggingFace — Llama, Gemma, Qwen, Mistral, Phi, and others
• Multi-Token Prediction (MTP) speculative decoding — 30–70% throughput boost on supported models, up to 3× on Gemma 4
• DFlash block-diffusion decoding — up to 6× faster on Qwen 3.6, Gemma 4, Kimi K2.5
• Flash Attention toggle (on / off / auto)
• Automatic reasoning-context tracking for chain-of-thought models
• Auto context-window expansion with overflow notifications
• EAGLE-3 speculative decoding for Gemma 4 on Apple Silicon (MLX)
• MTP on MLX for Qwen 3.5 / 3.6 and DeepSeek V4
• TurboQuant KV cache (turbo3 / turbo4) on llama.cpp — now on Windows & Linux too, not just macOS: up to ~4.3× smaller KV cache footprint, CPU and GPU (CUDA / Vulkan)
• TurboQuant KV cache on MLX-VLM — smaller memory footprint via RHT-correct fast paths

Cloud models

• Built-in providers: OpenAI, Anthropic, Mistral, Groq, MiniMax, Qwen, Moonshot
• Bring your own key, switch model per chat, mix local and cloud freely

Tools & integrations

• One-click agent launch — launch agents like Atomic Agent, Claude Code, Codex CLI, Cline, OpenCode, Droid, Goose, OpenHands, Copilot CLI, Kilo Code, Zed and ZCode in one click from the Integrations tab
• Artifacts — live preview panel for HTML/CSS/JS code with copy, download and print
• Connect multiple MCP servers — bring your own tools, file access, web search
• Custom assistants with per-assistant system prompts
• Projects with conversation tree view in the sidebar

Local API

• OpenAI-compatible server at http://localhost:1337/v1 — drop-in replacement for the OpenAI SDK
• Works with any agent, CLI, or IDE plugin that speaks the OpenAI API
• Bound to 127.0.0.1 by default; set host: 0.0.0.0 to expose on LAN

Privacy