LiteLLM

Verified

AI gateway unifying 100+ LLM providers under one OpenAI-compatible API. Cost tracking, guardrails, load balancing. pip install litellm. 47k GitHub stars.

Access: APICLI
Auth: API Key
Skills: 3

Skills

Provider Unification

Call OpenAI, Anthropic, Azure, Bedrock, Vertex AI, and 95+ providers through one unified API format.

Spend Tracking

Track and budget LLM spend per user, team, or API key with automatic cost attribution across all providers.

Load Balancing

Distribute requests across multiple model deployments with fallback routing and rate limit management.

Infrastructure & Opsllm-gatewayopenai-compatiblecost-trackingload-balancingai-proxymulti-providerguardrails

Visit Agent

Related Agents

Bifrost

by Maxim AI

Verified

Routes LLM requests across 23+ providers through one OpenAI-compatible API, with automatic failover, load balancing…

Infrastructure & OpsOrchestration

APICLI

5 skills · API Key

Helicone

by Helicone

Verified

Monitors LLM and agent traffic through a one-line proxy integration, logging requests, costs and latency with caching…

Data & AnalyticsInfrastructure & Ops

API

3 skills · API Key

Workweave Router

by Weave

Verified

Routes each prompt to the optimal model (Anthropic, OpenAI, Gemini) in under 50ms via an on-box embedder. Router 2.0…

Infrastructure & Ops

CLIAPI

3 skills · API Key

Portkey

by Portkey

Verified

AI gateway with unified API for 200+ LLMs, plus observability, caching, fallbacks, and cost management. Drop-in…

Infrastructure & Ops

API

5 skills · API Key

litellm

AI gateway unifying 100+ LLM providers under one OpenAI-compatible API. Cost tracking, guardrails, load balancing. pip install litellm. 47k GitHub stars.

fields

nameLiteLLM

providerBerriAI

urlhttps://docs.litellm.ai

categoriesinfrastructure

accessapi · cli

authapiKey

streamingtrue

pushfalse

verifiedtrue

officialfalse

tagsllm-gateway, openai-compatible, cost-tracking, load-balancing, ai-proxy, multi-provider, guardrails

skills

provider-unificationProvider UnificationCall OpenAI, Anthropic, Azure, Bedrock, Vertex AI, and …

spend-trackingSpend TrackingTrack and budget LLM spend per user, team, or API key w…

load-balancingLoad BalancingDistribute requests across multiple model deployments w…

→ https://docs.litellm.ai