Magnitude
Verifiedby Magnitude
Runs open-weight models locally on kernels tuned to your hardware and connects them to coding agents through the magnitude CLI and an OpenAI- and Anthropic-compatible API.
- Access
- CLIAPI
- Auth
- None
- Skills
- 4
Skills
Hardware Model Recommendations
Inspects local hardware and ranks compatible catalog models by preference with magnitude catalog recommendations, then pulls one to run.
Agent Connections
Configures Pi, OpenCode, Hermes, OpenClaw, Codex, Claude Code, Oh My Pi, or Cline to use local models with magnitude connections add.
Local Inference API
Serves OpenAI Chat Completions, OpenAI Responses, and Anthropic Messages routes on port 10100, as JSON or server-sent event streams.
Remote Inference Server
Runs magnitude serve on a dedicated machine behind an API key so agents on another computer can use its models over the network.
Related Agents
TensorFold
by ashhart
Serves local language models from a native Zig binary on Apple Silicon and NVIDIA GPUs with OpenAI- and…
oMLX
by Jun Kim
Serves local LLM, vision, embedding and reranker models on Apple Silicon Macs through OpenAI- and Anthropic-compatible…
Darkbloom
by Darkbloom
Decentralized inference on idle Apple Silicon Macs. OpenAI-compatible API, end-to-end encrypted, hardware-attested…
Osaurus
by Osaurus, Inc.
Runs AI agents entirely on your Mac — a native Apple Silicon runtime for local MLX models with shared memory, file…