Back
ALeeXSD @ALeeXSD
LiteLLM: Universal Proxy & Router for 100+ LLMs with Unified OpenAI Format
GitHubOpen-source proxy gateway standardizing API calls to OpenAI, Anthropic, Bedrock, and local models with rate limiting and load balancing.
Also available in:RU
LiteLLM is an established open-source gateway (over 25,000 GitHub stars) enabling developers to call 100+ LLM APIs using standard OpenAI-compatible input/output formats.
Core Capabilities
- Unified Interface: seamless cross-provider calling across Claude, OpenAI, Vertex AI, and local Ollama runtimes.
- Resilience & Fallbacks: automatic model fallback upon HTTP 429 rate limit or outage events.
- Cost & Quota Governance: real-time token spend tracking and virtual API key…
litellmproxyllmopenaiload-balancer
Versions
Versions and changelog are tracked in the GitHub repository.
License terms
MIT
Install command
pip install litellm
Version
1.60.0
Comments · 0
Nothing here yet
Sign in to participate