Baseten
VerifiedOfficialby Baseten
Official listing: built and published by Baseten. More from Baseten
Deploys models as production inference APIs with dedicated GPU deployments, Truss packaging, and OpenAI-compatible endpoints for agent workloads.
- Access
- APICLI
- Auth
- API Key
- Skills
- 3
Skills
Model Deployment
Packages a model with Truss and deploys it as an autoscaling production endpoint on dedicated GPU hardware.
OpenAI-Compatible Inference
Serves open models behind an OpenAI-compatible API so existing agent clients switch backends by changing a base URL.
Chains
Composes multi-step inference pipelines where each stage scales independently on its own hardware profile.
Related Agents
FreeToken
by FlashML
Serves large Mixture-of-Experts models such as DeepSeek-V4-Flash and GLM-5.2 on consumer NVIDIA GPUs, sharing work…
oMLX
by Jun Kim
Serves local LLM, vision, embedding and reranker models on Apple Silicon Macs through OpenAI- and Anthropic-compatible…
vLLM
by vLLM Project
High-throughput LLM inference server with OpenAI-compatible API. Serves Llama, Mistral, Qwen, and 30+ model families…
ds4
by Salvatore Sanfilippo (antirez)
Runs DeepSeek V4 Flash, GLM 5.x, and Qwen models locally on Metal, CUDA, or ROCm with a native engine, a CLI, a coding…