Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding…
Tag
#continuous-batching
MCP servers, skills and plugins tagged “continuous-batching” on GitHub.
2 entries · real GitHub data
- #2Vllm Mlx
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code…
