Xinference
A self-hosted model-serving platform with local and distributed deployments and OpenAI-compatible APIs.
What happened lately
Xinference timeline
Xinference serves language, image, audio and other models through a common application layer. Its English README documents a Python installation with pip install xinference, local startup with xinference-local, containers and distributed workers. It is serving infrastructure, rather than a model or a coding-agent plugin. Community self-hosting is distinct from the project’s commercial enterprise, cloud and hosted API offerings.
Version 4.0.1 requires Xoscar 0.12.0 or newer and integrates optional actor-message authentication. Administrators must set the same strong XOSCAR_AUTH_KEY on every actor peer and coordinate a restart; upgrading alone leaves the legacy unauthenticated transport enabled. HTTP API authentication does not protect actor ports.