Layer A · Model Gateways & Routing
LiteLLM
Open-source LLM proxy and gateway with broad provider coverage, budgets, and key-level spend controls.
Last checked . Visit LiteLLM
At a glance
- Category
- Model Gateways & Routing
- Control layer
- A: Build and run
- Five-Layer model
- Usage Transparency
- Status
- Active
- Typical buyers
- Engineering and platform, FinOps
- Delivery
- Open source, Self-hosted
Buyer fit
Best for engineering teams that want a flexible, open-source gateway with strong multi-provider support and budget enforcement. Python concurrency limits matter at very high throughput, so validate performance requirements before committing at scale. The open-source model reduces lock-in risk significantly.
Market outlook
De facto open-source default in the gateway category. Strong community adoption creates durability, but commercial model maturity is still developing.
What to check
- Budget and rate controls per key, team, and model provide granular spend governance.
- Broad provider coverage includes OpenAI, Anthropic, Azure, AWS Bedrock, Google, and many others.
- Self-hosted deployment option supports data sovereignty and air-gapped environments.
Sources
The map describes vendors from public sources; it does not rate, rank or recommend them, and no listing is paid for. Confirm pricing and capabilities with the vendor. See how the map is built.
By Ed Epstein, who works at IBM. The postings on this site are my own and don't necessarily represent IBM's positions, strategies or opinions. About and disclosure · Methodology