Compare features

Pass-through Endpoints

Useful for migrating existing projects to the proxy. The request is passed to the provider's endpoint and the response is then passed back to the client. No translation is done.

Cost Tracking

Cost Tracking

Logging

Logging

End-user Tracking

End-user Tracking

Using LiteLLM Virtual Keys/Authentication

Using LiteLLM Virtual Keys/Authentication

Logging

LLM Observability Tools (Langfuse, Langsmith, etc.)

LLM Observability Tools (Langfuse, Langsmith, etc.)

Datadog Logging

Datadog Logging

S3 Logging

S3 Logging

GCS Logging

GCS Logging

Azure Data Lake

Azure Data Lake

Key/Team-based Logging

Key/Team-based Logging

Alerting/Monitoring

Slack/Discord/Teams/Email/ Webhook

Slack/Discord/Teams/Email/ Webhook

Pagerduty Alerting

Pagerduty Alerting

Prometheus Metrics

Prometheus Metrics

Authentication

Virtual Keys

Virtual Keys

Custom Auth

Custom Auth

OIDC/JWT Auth

OIDC/JWT Auth

Virtual Key Rotation

Virtual Key Rotation

Write Key to Secret Manager

Write Key to Secret Manager

CRUD Endpoints + UI

Create / Manage Users

Create / Manage Users

Create / Manage Teams

Create / Manage Teams

Create / Manage Orgs

Create / Manage Orgs

Assign Team Admins

Assign Team Admins

Assign Org Admins

Assign Org Admins

Control Model Access

Restrict Models by Key/User/Team

Restrict Models by Key/User/Team

Model Access Groups

Model Access Groups

Team-only Models

Team-only Models

Admin UI

Internal User Self-serve

Internal User Self-serve

SSO

SSO

Auto-add SSO User to Teams

Auto-add SSO User to Teams

Spend Tracking

Track Spend by Model/Key/User/Team

Track Spend by Model/Key/User/Team

Track Spend for Org

Track Spend for Org

Track Spend for Custom Tags

Track Spend for Custom Tags

API endpoints for Spend Reporting

API endpoints for Spend Reporting

Budgets + Rate Limits

Set Budgets by Key/User/Team

Set Budgets by Key/User/Team

Set Rate Limits by Key/User/Team

Set Rate Limits by Key/User/Team

Temporary Budget Increase

Temporary Budget Increase

Budget/Rate Limit Tiers

Budget/Rate Limit Tiers

Guardrails

Set Guardrails per request

Set Guardrails per request

Default-on Guardrails

Default-on Guardrails

Set Guardrails by Key/Team

Set Guardrails by Key/Team