LocalAI
Verifiedby LocalAI
Serves local LLM, vision, image and voice inference behind an OpenAI-compatible API, letting agents run on consumer hardware with no GPU required.
- Access
- APICLI
- Auth
- None
- Skills
- 3
Skills
OpenAI-Compatible API
Exposes chat, embedding and audio endpoints matching the OpenAI schema so existing SDKs work unchanged.
Model Gallery
Downloads and manages models from a built-in gallery across multiple backends and quantization formats.
Multimodal Inference
Runs text, image generation, speech-to-text and text-to-speech workloads from one self-hosted service.
Related Agents
FreeToken
by FlashML
Serves large Mixture-of-Experts models such as DeepSeek-V4-Flash and GLM-5.2 on consumer NVIDIA GPUs, sharing work…
Magnitude
by Magnitude
Runs open-weight models locally on kernels tuned to your hardware and connects them to coding agents through the…
oMLX
by Jun Kim
Serves local LLM, vision, embedding and reranker models on Apple Silicon Macs through OpenAI- and Anthropic-compatible…
TensorFold
by ashhart
Serves local language models from a native Zig binary on Apple Silicon and NVIDIA GPUs with OpenAI- and…