Back to Tool
M

mlx-serve

Tool Oct 12, 2026

An open-source local inference server for language and media models, with a macOS app and Linux NVIDIA builds.

Visit primary link 2 sources attached

What happened lately

mlx-serve timeline

mlx-serve is an open-source inference server built around local AI models. Its project README describes support for MLX and GGUF models, OpenAI- and Anthropic-compatible APIs, and a macOS application for chat and media generation. The October 12 version 26.10.2 release adds Linux packages for NVIDIA hardware, alongside expanded video-storyboard, music and sound-effect workflows. The developers also describe a browser-based console that brings chat and media creation together.

The release notes make performance and reliability claims based on the team’s own tests. Hardware requirements vary by platform and model; the README lists an NVIDIA driver, CUDA toolkit and other dependencies for the Linux downloads. Those claims and requirements should be evaluated against the user’s own setup.