Zawap
Back

ALeeXSD @ALeeXSD

LiteLLM: Universal Proxy & Router for 100+ LLMs with Unified OpenAI Format

GitHub

Open-source proxy gateway standardizing API calls to OpenAI, Anthropic, Bedrock, and local models with rate limiting and load balancing.

Also available in:RU
LiteLLM is an established open-source gateway (over 25,000 GitHub stars) enabling developers to call 100+ LLM APIs using standard OpenAI-compatible input/output formats. Core Capabilities - Unified Interface: seamless cross-provider calling across Claude, OpenAI, Vertex AI, and local Ollama runtimes. - Resilience & Fallbacks: automatic model fallback upon HTTP 429 rate limit or outage events. - Cost & Quota Governance: real-time token spend tracking and virtual API key…
litellmproxyllmopenaiload-balancer
0
Versions

Versions and changelog are tracked in the GitHub repository.

License terms

MIT

Install command

pip install litellm

Version

1.60.0

Comments · 0

Nothing here yet

Sign in to participate