mlx-serve
An open-source local inference server for language and media models, with a macOS app and Linux NVIDIA builds.
What happened lately
mlx-serve timeline
mlx-serve is an open-source inference server built around local AI models. Its project README describes support for MLX and GGUF models, OpenAI- and Anthropic-compatible APIs, and a macOS application for chat and media generation. The October 12 version 26.10.2 release adds Linux packages for NVIDIA hardware, alongside expanded video-storyboard, music and sound-effect workflows. The developers also describe a browser-based console that brings chat and media creation together.
The release notes make performance and reliability claims based on the team’s own tests. Hardware requirements vary by platform and model; the README lists an NVIDIA driver, CUDA toolkit and other dependencies for the Linux downloads. Those claims and requirements should be evaluated against the user’s own setup.