Load Balance across
Azure OpenAI
Vertex AI
Bedrock
OpenAI
Azure OpenAI
Vertex AI
Bedrock
OpenAI
Azure OpenAI
Vertex AI
Bedrock
OpenAI
Azure OpenAI
Vertex AI
Bedrock
OpenAI
Load Balance across
Azure OpenAI
Vertex AI
Bedrock
OpenAI
Azure OpenAI
Vertex AI
Bedrock
OpenAI
Azure OpenAI
Vertex AI
Bedrock
OpenAI
Azure OpenAI
Vertex AI
Bedrock
OpenAI
Load Balance across
Azure OpenAI
Vertex AI
Bedrock
OpenAI
Azure OpenAI
Vertex AI
Bedrock
OpenAI
Azure OpenAI
Vertex AI
Bedrock
OpenAI
Azure OpenAI
Vertex AI
Bedrock
OpenAI
LiteLLM handles loadbalancing, fallbacks and spend tracking across 100+ LLMs. All in the OpenAI format
LiteLLM handles loadbalancing, fallbacks and spend tracking across 100+ LLMs. All in the OpenAI format
LiteLLM handles loadbalancing, fallbacks and spend tracking across 100+ LLMs. All in the OpenAI format
🚅 LiteLLM
40,000+
docker pulls
20M+
requests served
99%
uptime
150+
contributors
Add Model
Load Balance
Create Keys
Track Spend