​v1.67.4-stable is live now. Here are the key highlights of this release:

• Improved User Management: This release enables search and filtering across users, keys, teams, and models.

• Responses API Load Balancing: Route requests across provider regions and ensure session continuity.

• UI Session Logs: Group several requests to LiteLLM into a session.

v1.67.0-stable is live now, here are the key highlights of this release​

• SCIM Integration: Enables identity providers (Okta, Azure AD, OneLogin, etc.) to automate user and team (group) provisioning, updates, and deprovisioning

• Team and Tag based usage tracking: You can now see usage and spend by team and tag at 1M+ spend logs.

• Unified Responses API: Support for calling Anthropic, Gemini, Groq, etc. via OpenAI's new Responses API.

v1.66.0-stable is live now, here are the key highlights of this release:​

• Realtime API Cost Tracking: Track cost of realtime API calls

• Microsoft SSO Auto-sync: Auto-sync groups and group members from Azure Entra ID to LiteLLM

• Unified File IDs: Use the same file id across LLM API providers.

• xAI grok-3: Added support for xai/grok-3 models

LiteLLM v1.65.4-stable is live. Here are the key highlights of this release:

• Preventing DB Deadlocks: Enables spend tracking by key/team/user to work at 10k+ RPS.

• Usage Tab: Enables viewing spend by model and customizing date range.

v1.65.0-stable is live now. Here are the key highlights of this release:

• MCP Support: Support for adding and using MCP servers on the LiteLLM proxy.

• UI view total usage after 1M+ logs: You can now view usage analytics after crossing 1M+ logs in DB.

These are the changes since -v1.63.11-stable:

• LLM Translation Improvements (MCP Support and Bedrock Application Profiles)

• Perf improvements for Usage-based Routing

• Streaming guardrail support via websockets

• Azure OpenAI client perf fix (from previous release)

These are the changes since v1.63.2-stable.

This covers:

• [Beta] Responses API Support

• Snowflake Cortex Support, Amazon Nova Image Generation

• UI - Credential Management, re-use credentials when adding new models

• UI - Test Connection to LLM Provider before adding a model

These are the changes since v1.61.20-stable.

This release is primarily focused on:

• LLM Translation improvements (more thinking content improvements)

• UI improvements (Error logs now shown on UI)

v1.63.0 fixes Anthropic 'thinking' response on streaming to return the signature block. Github Issue

It also moves the response structure from signature_delta to signature to be the same as Anthropic. Anthropic Docs

These are the changes since v1.61.13-stable.

This release is primarily focused on:

• LLM Translation improvements (claude-3-7-sonnet + 'thinking'/'reasoning_content' support)

• UI improvements (add model flow, user management, etc)

alerting, prometheus, secret management, management endpoints, ui, prompt management, finetuning, batch

langfuse, management endpoints, ui, prometheus, secret management

docker image, security, vulnerability

deepgram, fireworks ai, vision, admin ui, dependency upgrades

guardrails, logging, virtual key management, new models

key management, budgets/rate limits, logging, guardrails

batches, guardrails, team management, custom auth

A new LiteLLM Stable release just went out. Here are 5 updates since v1.52.2-stable.

langfuse, fallbacks, new models, azure_storage