- vendor
- BerriAI
- whatItIs
- Open-source LLM proxy exposing one OpenAI-compatible endpoint over 100+ providers with load balancing, fallbacks, and virtual keys.
- hosting
- both
- pricingModel
- open-source + LiteLLM Cloud managed tier
- modelProviders
- 100+ providers (Bedrock, Azure, OpenAI, VertexAI, Anthropic, vLLM, NIM)
- stateModel
- stateless per-request; virtual keys + spend per user/project
- toolModel
- OpenAI-compatible API (unified)
- includesBrowser
- false
- includesMemory
- false
- longRunning
- per-request
- hitlSupport
- false
- observability
- admin UI + cost tracking + LangSmith/Helicone integrations
- maturity
- ga
- launched
- 2022
- notes
- Config-file normalization, PII masking, prompt caching. Self-host via Docker/CLI; cloud tier available.