#1Lemonade
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
Tag
#llm-inference
MCP servers, skills and plugins tagged “llm-inference” on GitHub.
9 entries · real GitHub data
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding…
Your Cheat Sheet for AI Engineering Interview – Questions and Answers.
- #4MTPLX
The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP…
Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V
Context-Engine MCP - Agentic Context Compression Suite
Context optimization for AI coding agents — lower token cost and latency without sacrificing accuracy.
- #8Neura
Neura lets you run long, tool heavy coding sessions without blowing up token costs by compressing old context into references and only restoring exact data when needed,…
Fetch only relevant tools for the current conversation and save cost while increasing the precision of your LLM Response
