mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-19 00:01:29 +00:00
* fix: SSO PKCE support fails in multi-pod Kubernetes deployments * fix: virutal key grace period from env/UI * fix: refactor, race condition handle, fstring sql injection * fix: add async call to avoid server pauses * Update tests/test_litellm/proxy/management_endpoints/test_ui_sso.py Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> * fix: add await in tests * add modify test to perform async run * Update tests/test_litellm/proxy/management_endpoints/test_ui_sso.py Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> * Update tests/test_litellm/proxy/management_endpoints/test_ui_sso.py Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> * fix grace period with better error handling on frontend and as per best practices * Update tests/test_litellm/proxy/management_endpoints/test_ui_sso.py Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> * fix: as per request changes * Update litellm/proxy/utils.py Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> * Fix errors when callbacks are invoked for file delete operations: * Fix errors when callbacks are invoked for file operations * Fix: pass deployment credentials to afile_retrieve in managed_files post-call hook * Fix: bypass managed files access check in batch polling by calling afile_content directly * Update tests/test_litellm/proxy/management_endpoints/test_ui_sso.py Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> * fix: afile_retrieve returns unified ID for batch output files * fix: batch retrieve returns unified input_file_id * fix(chatgpt): drop unsupported responses params for Codex Co-authored-by: Cursor <cursoragent@cursor.com> * test(chatgpt): ensure Codex request filters unsupported params Co-authored-by: Cursor <cursoragent@cursor.com> * Fix deleted managed files returning 403 instead of 404 * Add comments * Update litellm/proxy/utils.py Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> * fix: thread deployment model_info through batch cost calculation batch_cost_calculator only checked the global cost map, ignoring deployment-level custom pricing (input_cost_per_token_batches etc.). Add optional model_info param through the batch cost chain and pass it from CheckBatchCost. * fix(deps): add pytest-postgresql for db schema migration tests The test_db_schema_migration.py test requires pytest-postgresql but it was missing from dependencies, causing import errors: ModuleNotFoundError: No module named 'pytest_postgresql' Added pytest-postgresql ^6.0.0 to dev dependencies to fix test collection errors in proxy_unit_tests. This is a pre-existing issue, not related to PR #21277. Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com> * fix(test): replace caplog with custom handler for parallel execution The cost calculation log level tests were failing when run with pytest-xdist parallel execution because caplog doesn't work reliably across worker processes. This causes "ValueError: I/O operation on closed file" errors. Solution: Replace caplog fixture with a custom LogRecordHandler that directly attaches to the logger. This approach works correctly in parallel execution because each worker process has its own handler instance. Fixes test failures in PR #21277 when running with --dist=loadscope. Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com> * fix(test): correct async mock for video generation logging test The test was failing with AuthenticationError because the mock wasn't intercepting the actual HTTP handler calls. This caused real API calls with no API key, resulting in 401 errors. Root cause: The test was patching the wrong target using string path 'litellm.videos.main.base_llm_http_handler' instead of using patch.object on the actual handler instance. Additionally, it was mocking the sync method instead of async_video_generation_handler. Solution: Use patch.object with side_effect pattern on the correct async handler method, following the same pattern used in test_video_generation_async(). Fixes test failure in PR #21277 when running with --dist=loadscope. Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com> * fix(test): add cleanup fixture and no_parallel mark for MCP tests Two MCP server tests were failing when run with pytest-xdist parallel execution (--dist=loadscope): - test_mcp_routing_with_conflicting_alias_and_group_name - test_oauth2_headers_passed_to_mcp_client Both tests showed assertion failures where mocks weren't being called (0 times instead of expected 1 time). Root cause: These tests rely on global_mcp_server_manager singleton state and complex async mocking that doesn't work reliably with parallel execution. Each worker process can have different state and patches may not apply correctly. Solution: 1. Added autouse fixture to clean up global_mcp_server_manager registry before and after each test for better isolation 2. Added @pytest.mark.no_parallel to these specific tests to ensure they run sequentially, avoiding parallel execution issues This approach maintains test reliability while allowing other tests in the file to still benefit from parallelization. Fixes test failures exposed by PR #21277. Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com> * Regenerate poetry.lock with Poetry 2.3.2 Updated lock file to use Poetry 2.3.2 (matching main branch standard). This addresses Greptile feedback about Poetry version mismatch. Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com> * Remove unused pytest import and add trailing newline - Removed unused pytest import (caplog fixture was removed) - Added missing trailing newline at end of file Addresses Greptile feedback (minor style issues). Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com> * Remove redundant import inside test method The module litellm.videos.main is already imported at the top of the file (line 21), so the import inside the test method is redundant. Addresses Greptile feedback (minor style issue). Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com> * Fix converse anthropic usage object according to v1/messages specs * Add routing based on if reasoning is supported or not * add fireworks_ai/accounts/fireworks/models/kimi-k2p5 in model map * Removed stray .md file * fix(bedrock): clamp thinking.budget_tokens to minimum 1024 Bedrock rejects thinking.budget_tokens values below 1024 with a 400 error. This adds automatic clamping in the LiteLLM transformation layer so callers (e.g. router with reasoning_effort="low") don't need to know about the provider-specific minimum. Fixes #21297 Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * fix: improve Langfuse test isolation to prevent flaky failures (#21093) The test was creating fresh mocks but not fully isolating from setUp state, causing intermittent CI failures with 'Expected generation to be called once. Called 0 times.' Instead of creating fresh mocks, properly reset the existing setUp mocks to ensure clean state while maintaining proper mock chain configuration. * feat(s3): add support for virtual-hosted-style URLs (#21094) Add s3_use_virtual_hosted_style parameter to support AWS S3 virtual-hosted-style URL format (bucket.endpoint/key) alongside the existing path-style format (endpoint/bucket/key). This enables compatibility with S3-compatible services like MinIO and aligns with AWS S3 official terminology. * Addressed greptile comments to extract common helpers and return 404 * Allow effort="max" for Claude Opus 4.6 (#21112) * fix(aiohttp): prevent closing shared ClientSession in AiohttpTransport (#21117) When a shared ClientSession is passed to LiteLLMAiohttpTransport, calling aclose() on the transport would close the shared session, breaking other clients still using it. Add owns_session parameter (default True for backwards compatibility) to AiohttpTransport and LiteLLMAiohttpTransport. When a shared session is provided in http_handler.py, owns_session=False is set to prevent the transport from closing a session it does not own. This aligns AiohttpTransport with the ownership pattern already used in AiohttpHandler (aiohttp_handler.py). * perf(spend): avoid duplicate daily agent transaction computation (#21187) * fix: proxy/batches_endpoints/endpoints.py:309:11: PLR0915 Too many statements (54 > 50) * fix mypy * Add doc for OpenAI Agents SDK with LiteLLM * Add doc for OpenAI Agents SDK with LiteLLM * Update docs/my-website/sidebars.js Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> * fix mypy * Update tests/test_litellm/proxy/_experimental/mcp_server/test_mcp_server.py Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> * Add blog fffor Managing Anthropic Beta Headers * Add blog fffor Managing Anthropic Beta Headers * correct the time * Fix: Exclude tool params for models without function calling support (#21125) (#21244) * Fix tool params reported as supported for models without function calling (#21125) JSON-configured providers (e.g. PublicAI) inherited all OpenAI params including tools, tool_choice, function_call, and functions — even for models that don't support function calling. This caused an inconsistency where get_supported_openai_params included "tools" but supports_function_calling returned False. The fix checks supports_function_calling in the dynamic config's get_supported_openai_params and removes tool-related params when the model doesn't support it. Follows the same pattern used by OVHCloud and Fireworks AI providers. * Style: move verbose_logger to module-level import, remove redundant try/except Address review feedback from Greptile bot: - Move verbose_logger import to top-level (matches project convention) - Remove redundant try/except around supports_function_calling() since it already handles exceptions internally via _supports_factory() * fix(index.md): cleanup str * fix(proxy): handle missing DATABASE_URL in append_query_params (#21239) * fix: handle missing database url in append_query_params * Update litellm/proxy/proxy_cli.py Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> --------- Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> * fix(mcp): revert StreamableHTTPSessionManager to stateless mode (#21323) PR #19809 changed stateless=True to stateless=False to enable progress notifications for MCP tool calls. This caused the mcp library to enforce mcp-session-id headers on all non-initialize requests, breaking MCP Inspector, curl, and any client without automatic session management. Revert to stateless=True to restore compatibility with all MCP clients. The progress notification code already handles missing sessions gracefully (defensive checks + try/except), so no other changes are needed. Fixes #20242 * UI - Content Filters, help edit/view categories and 1-click add categories + go to next page (#21223) * feat(ui/): allow viewing content filter categories on guardrail info * fix(add_guardrail_form.tsx): add validation check to prevent adding empty content filter guardrails * feat(ui/): improve ux around adding new content filter categories easy to skip adding a category, so make it a 1-click thing * Fix OCI Grok output pricing (#21329) * fix(proxy): fix master key rotation Prisma validation errors _rotate_master_key() used jsonify_object() which converts Python dicts to JSON strings. Prisma's Python client rejects strings for Json-typed fields — it requires prisma.Json() wrappers or native dicts. This affected three code paths: - Model table (create_many): litellm_params and model_info converted to strings, plus created_at/updated_at were None (non-nullable DateTime) - Config table (update): param_value converted to string - Credentials table (update): credential_values/credential_info converted to strings Fix: replace jsonify_object() with model_dump(exclude_none=True) + prisma.Json() wrappers for all Json fields. Wrap model delete+insert in a Prisma transaction for atomicity. Add try/except around MCP server rotation to prevent non-critical failures from blocking the entire rotation. --------- Co-authored-by: Harshit Jain <harshitjain0562@gmail.com> Co-authored-by: Harshit Jain <48647625+Harshit28j@users.noreply.github.com> Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> Co-authored-by: Ephrim Stanley <ephrim.stanley@point72.com> Co-authored-by: Jay Prajapati <79649559+jayy-77@users.noreply.github.com> Co-authored-by: Cursor <cursoragent@cursor.com> Co-authored-by: Julio Quinteros Pro <jquinter@gmail.com> Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com> Co-authored-by: Sameer Kankute <sameer@berri.ai> Co-authored-by: mjkam <mjkam@naver.com> Co-authored-by: Fly <48186978+tuzkiyoung@users.noreply.github.com> Co-authored-by: Kristoffer Arlind <13228507+KristofferArlind@users.noreply.github.com> Co-authored-by: Constantine <Runixer@gmail.com> Co-authored-by: Emerson Gomes <emerson.gomes@thalesgroup.com> Co-authored-by: Atharva Jaiswal <92455570+AtharvaJaiswal005@users.noreply.github.com> Co-authored-by: Krrish Dholakia <krrishdholakia@gmail.com> Co-authored-by: Vincent Koc <vincentkoc@ieee.org> Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
976 lines
No EOL
37 KiB
Text
976 lines
No EOL
37 KiB
Text
datasource client {
|
|
provider = "postgresql"
|
|
url = env("DATABASE_URL")
|
|
}
|
|
|
|
generator client {
|
|
provider = "prisma-client-py"
|
|
binaryTargets = ["native", "debian-openssl-1.1.x", "debian-openssl-3.0.x", "linux-musl", "linux-musl-openssl-3.0.x"]
|
|
}
|
|
|
|
// Budget / Rate Limits for an org
|
|
model LiteLLM_BudgetTable {
|
|
budget_id String @id @default(uuid())
|
|
max_budget Float?
|
|
soft_budget Float?
|
|
max_parallel_requests Int?
|
|
tpm_limit BigInt?
|
|
rpm_limit BigInt?
|
|
model_max_budget Json?
|
|
budget_duration String?
|
|
budget_reset_at DateTime?
|
|
created_at DateTime @default(now()) @map("created_at")
|
|
created_by String
|
|
updated_at DateTime @default(now()) @updatedAt @map("updated_at")
|
|
updated_by String
|
|
organization LiteLLM_OrganizationTable[] // multiple orgs can have the same budget
|
|
keys LiteLLM_VerificationToken[] // multiple keys can have the same budget
|
|
end_users LiteLLM_EndUserTable[] // multiple end-users can have the same budget
|
|
tags LiteLLM_TagTable[] // multiple tags can have the same budget
|
|
team_membership LiteLLM_TeamMembership[] // budgets of Users within a Team
|
|
organization_membership LiteLLM_OrganizationMembership[] // budgets of Users within a Organization
|
|
}
|
|
|
|
// Models on proxy
|
|
model LiteLLM_CredentialsTable {
|
|
credential_id String @id @default(uuid())
|
|
credential_name String @unique
|
|
credential_values Json
|
|
credential_info Json?
|
|
created_at DateTime @default(now()) @map("created_at")
|
|
created_by String
|
|
updated_at DateTime @default(now()) @updatedAt @map("updated_at")
|
|
updated_by String
|
|
}
|
|
|
|
// Models on proxy
|
|
model LiteLLM_ProxyModelTable {
|
|
model_id String @id @default(uuid())
|
|
model_name String
|
|
litellm_params Json
|
|
model_info Json?
|
|
created_at DateTime @default(now()) @map("created_at")
|
|
created_by String
|
|
updated_at DateTime @default(now()) @updatedAt @map("updated_at")
|
|
updated_by String
|
|
}
|
|
|
|
|
|
// Agents on proxy
|
|
model LiteLLM_AgentsTable {
|
|
agent_id String @id @default(uuid())
|
|
agent_name String @unique
|
|
litellm_params Json?
|
|
agent_card_params Json
|
|
agent_access_groups String[] @default([])
|
|
created_at DateTime @default(now()) @map("created_at")
|
|
created_by String
|
|
updated_at DateTime @default(now()) @updatedAt @map("updated_at")
|
|
updated_by String
|
|
}
|
|
|
|
model LiteLLM_OrganizationTable {
|
|
organization_id String @id @default(uuid())
|
|
organization_alias String
|
|
budget_id String
|
|
metadata Json @default("{}")
|
|
models String[]
|
|
spend Float @default(0.0)
|
|
model_spend Json @default("{}")
|
|
object_permission_id String?
|
|
created_at DateTime @default(now()) @map("created_at")
|
|
created_by String
|
|
updated_at DateTime @default(now()) @updatedAt @map("updated_at")
|
|
updated_by String
|
|
litellm_budget_table LiteLLM_BudgetTable? @relation(fields: [budget_id], references: [budget_id])
|
|
teams LiteLLM_TeamTable[]
|
|
users LiteLLM_UserTable[]
|
|
keys LiteLLM_VerificationToken[]
|
|
members LiteLLM_OrganizationMembership[] @relation("OrganizationToMembership")
|
|
object_permission LiteLLM_ObjectPermissionTable? @relation(fields: [object_permission_id], references: [object_permission_id])
|
|
}
|
|
|
|
// Model info for teams, just has model aliases for now.
|
|
model LiteLLM_ModelTable {
|
|
id Int @id @default(autoincrement())
|
|
model_aliases Json? @map("aliases")
|
|
created_at DateTime @default(now()) @map("created_at")
|
|
created_by String
|
|
updated_at DateTime @default(now()) @updatedAt @map("updated_at")
|
|
updated_by String
|
|
team LiteLLM_TeamTable?
|
|
}
|
|
|
|
|
|
// Assign prod keys to groups, not individuals
|
|
model LiteLLM_TeamTable {
|
|
team_id String @id @default(uuid())
|
|
team_alias String?
|
|
organization_id String?
|
|
object_permission_id String?
|
|
admins String[]
|
|
members String[]
|
|
members_with_roles Json @default("{}")
|
|
metadata Json @default("{}")
|
|
max_budget Float?
|
|
soft_budget Float?
|
|
spend Float @default(0.0)
|
|
models String[]
|
|
max_parallel_requests Int?
|
|
tpm_limit BigInt?
|
|
rpm_limit BigInt?
|
|
budget_duration String?
|
|
budget_reset_at DateTime?
|
|
blocked Boolean @default(false)
|
|
created_at DateTime @default(now()) @map("created_at")
|
|
updated_at DateTime @default(now()) @updatedAt @map("updated_at")
|
|
model_spend Json @default("{}")
|
|
model_max_budget Json @default("{}")
|
|
router_settings Json? @default("{}")
|
|
team_member_permissions String[] @default([])
|
|
access_group_ids String[] @default([])
|
|
policies String[] @default([])
|
|
model_id Int? @unique // id for LiteLLM_ModelTable -> stores team-level model aliases
|
|
allow_team_guardrail_config Boolean @default(false) // if true, team admin can configure guardrails for this team
|
|
litellm_organization_table LiteLLM_OrganizationTable? @relation(fields: [organization_id], references: [organization_id])
|
|
litellm_model_table LiteLLM_ModelTable? @relation(fields: [model_id], references: [id])
|
|
object_permission LiteLLM_ObjectPermissionTable? @relation(fields: [object_permission_id], references: [object_permission_id])
|
|
}
|
|
|
|
// Audit table for deleted teams - preserves spend and team information for historical tracking
|
|
model LiteLLM_DeletedTeamTable {
|
|
id String @id @default(uuid())
|
|
team_id String // Original team_id
|
|
team_alias String?
|
|
organization_id String?
|
|
object_permission_id String?
|
|
admins String[]
|
|
members String[]
|
|
members_with_roles Json @default("{}")
|
|
metadata Json @default("{}")
|
|
max_budget Float?
|
|
soft_budget Float?
|
|
spend Float @default(0.0)
|
|
models String[]
|
|
max_parallel_requests Int?
|
|
tpm_limit BigInt?
|
|
rpm_limit BigInt?
|
|
budget_duration String?
|
|
budget_reset_at DateTime?
|
|
blocked Boolean @default(false)
|
|
model_spend Json @default("{}")
|
|
model_max_budget Json @default("{}")
|
|
router_settings Json? @default("{}")
|
|
team_member_permissions String[] @default([])
|
|
access_group_ids String[] @default([])
|
|
policies String[] @default([])
|
|
model_id Int? // id for LiteLLM_ModelTable -> stores team-level model aliases
|
|
allow_team_guardrail_config Boolean @default(false)
|
|
|
|
// Original timestamps from team creation/updates
|
|
created_at DateTime? @map("created_at")
|
|
updated_at DateTime? @map("updated_at")
|
|
|
|
// Deletion metadata
|
|
deleted_at DateTime @default(now()) @map("deleted_at")
|
|
deleted_by String? @map("deleted_by") // User who deleted the team
|
|
deleted_by_api_key String? @map("deleted_by_api_key") // API key hash that performed the deletion
|
|
litellm_changed_by String? @map("litellm_changed_by") // From litellm-changed-by header if provided
|
|
|
|
@@index([team_id])
|
|
@@index([deleted_at])
|
|
@@index([organization_id])
|
|
@@index([team_alias])
|
|
@@index([created_at])
|
|
}
|
|
|
|
// Track spend, rate limit, budget Users
|
|
model LiteLLM_UserTable {
|
|
user_id String @id
|
|
user_alias String?
|
|
team_id String?
|
|
sso_user_id String? @unique
|
|
organization_id String?
|
|
object_permission_id String?
|
|
password String?
|
|
teams String[] @default([])
|
|
user_role String?
|
|
max_budget Float?
|
|
spend Float @default(0.0)
|
|
user_email String?
|
|
models String[]
|
|
metadata Json @default("{}")
|
|
max_parallel_requests Int?
|
|
tpm_limit BigInt?
|
|
rpm_limit BigInt?
|
|
budget_duration String?
|
|
budget_reset_at DateTime?
|
|
allowed_cache_controls String[] @default([])
|
|
policies String[] @default([])
|
|
model_spend Json @default("{}")
|
|
model_max_budget Json @default("{}")
|
|
created_at DateTime? @default(now()) @map("created_at")
|
|
updated_at DateTime? @default(now()) @updatedAt @map("updated_at")
|
|
|
|
// relations
|
|
litellm_organization_table LiteLLM_OrganizationTable? @relation(fields: [organization_id], references: [organization_id])
|
|
organization_memberships LiteLLM_OrganizationMembership[]
|
|
invitations_created LiteLLM_InvitationLink[] @relation("CreatedBy")
|
|
invitations_updated LiteLLM_InvitationLink[] @relation("UpdatedBy")
|
|
invitations_user LiteLLM_InvitationLink[] @relation("UserId")
|
|
object_permission LiteLLM_ObjectPermissionTable? @relation(fields: [object_permission_id], references: [object_permission_id])
|
|
}
|
|
|
|
model LiteLLM_ObjectPermissionTable {
|
|
object_permission_id String @id @default(uuid())
|
|
mcp_servers String[] @default([])
|
|
mcp_access_groups String[] @default([])
|
|
mcp_tool_permissions Json? // Tool-level permissions for MCP servers. Format: {"server_id": ["tool_name_1", "tool_name_2"]}
|
|
vector_stores String[] @default([])
|
|
agents String[] @default([])
|
|
agent_access_groups String[] @default([])
|
|
teams LiteLLM_TeamTable[]
|
|
verification_tokens LiteLLM_VerificationToken[]
|
|
organizations LiteLLM_OrganizationTable[]
|
|
users LiteLLM_UserTable[]
|
|
}
|
|
|
|
// Holds the MCP server configuration
|
|
model LiteLLM_MCPServerTable {
|
|
server_id String @id @default(uuid())
|
|
server_name String?
|
|
alias String?
|
|
description String?
|
|
url String?
|
|
transport String @default("sse")
|
|
auth_type String?
|
|
credentials Json? @default("{}")
|
|
created_at DateTime? @default(now()) @map("created_at")
|
|
created_by String?
|
|
updated_at DateTime? @default(now()) @updatedAt @map("updated_at")
|
|
updated_by String?
|
|
mcp_info Json? @default("{}")
|
|
mcp_access_groups String[]
|
|
allowed_tools String[] @default([])
|
|
extra_headers String[] @default([])
|
|
static_headers Json? @default("{}")
|
|
// Health check status
|
|
status String? @default("unknown")
|
|
last_health_check DateTime?
|
|
health_check_error String?
|
|
// Stdio-specific fields
|
|
command String?
|
|
args String[] @default([])
|
|
env Json? @default("{}")
|
|
authorization_url String?
|
|
token_url String?
|
|
registration_url String?
|
|
allow_all_keys Boolean @default(false)
|
|
available_on_public_internet Boolean @default(false)
|
|
}
|
|
|
|
// Generate Tokens for Proxy
|
|
model LiteLLM_VerificationToken {
|
|
token String @id
|
|
key_name String?
|
|
key_alias String?
|
|
soft_budget_cooldown Boolean @default(false) // key-level state on if budget alerts need to be cooled down
|
|
spend Float @default(0.0)
|
|
expires DateTime?
|
|
models String[]
|
|
aliases Json @default("{}")
|
|
config Json @default("{}")
|
|
router_settings Json? @default("{}")
|
|
user_id String?
|
|
team_id String?
|
|
permissions Json @default("{}")
|
|
max_parallel_requests Int?
|
|
metadata Json @default("{}")
|
|
blocked Boolean?
|
|
tpm_limit BigInt?
|
|
rpm_limit BigInt?
|
|
max_budget Float?
|
|
budget_duration String?
|
|
budget_reset_at DateTime?
|
|
allowed_cache_controls String[] @default([])
|
|
allowed_routes String[] @default([])
|
|
policies String[] @default([])
|
|
access_group_ids String[] @default([])
|
|
model_spend Json @default("{}")
|
|
model_max_budget Json @default("{}")
|
|
budget_id String?
|
|
organization_id String?
|
|
object_permission_id String?
|
|
created_at DateTime? @default(now()) @map("created_at")
|
|
created_by String?
|
|
updated_at DateTime? @default(now()) @updatedAt @map("updated_at")
|
|
updated_by String?
|
|
rotation_count Int? @default(0) // Number of times key has been rotated
|
|
auto_rotate Boolean? @default(false) // Whether this key should be auto-rotated
|
|
rotation_interval String? // How often to rotate (e.g., "30d", "90d")
|
|
last_rotation_at DateTime? // When this key was last rotated
|
|
key_rotation_at DateTime? // When this key should next be rotated
|
|
litellm_budget_table LiteLLM_BudgetTable? @relation(fields: [budget_id], references: [budget_id])
|
|
litellm_organization_table LiteLLM_OrganizationTable? @relation(fields: [organization_id], references: [organization_id])
|
|
object_permission LiteLLM_ObjectPermissionTable? @relation(fields: [object_permission_id], references: [object_permission_id])
|
|
|
|
// SELECT COUNT(*) FROM (SELECT "public"."LiteLLM_VerificationToken"."token" FROM "public"."LiteLLM_VerificationToken" WHERE ("public"."LiteLLM_VerificationToken"."user_id" = $1 AND ("public"."LiteLLM_VerificationToken"."team_id" IS NULL OR "public"."LiteLLM_VerificationToken"."team_id" <> $2)) OFFSET $3 ) AS "sub"
|
|
// SELECT ... FROM "public"."LiteLLM_VerificationToken" WHERE "public"."LiteLLM_VerificationToken"."user_id" = $1 OFFSET $2
|
|
@@index([user_id, team_id])
|
|
|
|
// SELECT ... FROM "public"."LiteLLM_VerificationToken" WHERE "public"."LiteLLM_VerificationToken"."team_id" = $1 OFFSET $2
|
|
@@index([team_id])
|
|
|
|
// SELECT ... FROM "public"."LiteLLM_VerificationToken" WHERE (("public"."LiteLLM_VerificationToken"."expires" IS NULL OR "public"."LiteLLM_VerificationToken"."expires" > $1) AND "public"."LiteLLM_VerificationToken"."budget_reset_at" < $2) OFFSET $3
|
|
@@index([budget_reset_at, expires])
|
|
}
|
|
|
|
// Deprecated keys during grace period - allows old key to work until revoke_at
|
|
model LiteLLM_DeprecatedVerificationToken {
|
|
id String @id @default(uuid())
|
|
token String // Hashed old key
|
|
active_token_id String // Current token hash in LiteLLM_VerificationToken
|
|
revoke_at DateTime // When the old key stops working
|
|
created_at DateTime @default(now()) @map("created_at")
|
|
|
|
@@unique([token])
|
|
@@index([token, revoke_at])
|
|
@@index([revoke_at])
|
|
}
|
|
|
|
// Audit table for deleted keys - preserves spend and key information for historical tracking
|
|
model LiteLLM_DeletedVerificationToken {
|
|
id String @id @default(uuid())
|
|
token String // Original token (hashed)
|
|
key_name String?
|
|
key_alias String?
|
|
soft_budget_cooldown Boolean @default(false)
|
|
spend Float @default(0.0)
|
|
expires DateTime?
|
|
models String[]
|
|
aliases Json @default("{}")
|
|
config Json @default("{}")
|
|
user_id String?
|
|
team_id String?
|
|
permissions Json @default("{}")
|
|
max_parallel_requests Int?
|
|
metadata Json @default("{}")
|
|
blocked Boolean?
|
|
tpm_limit BigInt?
|
|
rpm_limit BigInt?
|
|
max_budget Float?
|
|
budget_duration String?
|
|
budget_reset_at DateTime?
|
|
allowed_cache_controls String[] @default([])
|
|
allowed_routes String[] @default([])
|
|
policies String[] @default([])
|
|
access_group_ids String[] @default([])
|
|
model_spend Json @default("{}")
|
|
model_max_budget Json @default("{}")
|
|
router_settings Json? @default("{}")
|
|
budget_id String?
|
|
organization_id String?
|
|
object_permission_id String?
|
|
created_at DateTime? // Original creation timestamp
|
|
created_by String? // Original creator
|
|
updated_at DateTime? // Last update timestamp before deletion
|
|
updated_by String? // Last user who updated before deletion
|
|
rotation_count Int? @default(0)
|
|
auto_rotate Boolean? @default(false)
|
|
rotation_interval String?
|
|
last_rotation_at DateTime?
|
|
key_rotation_at DateTime?
|
|
|
|
// Deletion metadata
|
|
deleted_at DateTime @default(now()) @map("deleted_at")
|
|
deleted_by String? @map("deleted_by") // User who deleted the key
|
|
deleted_by_api_key String? @map("deleted_by_api_key") // API key hash that performed the deletion
|
|
litellm_changed_by String? @map("litellm_changed_by") // From litellm-changed-by header if provided
|
|
|
|
@@index([token])
|
|
@@index([deleted_at])
|
|
@@index([user_id])
|
|
@@index([team_id])
|
|
@@index([organization_id])
|
|
@@index([key_alias])
|
|
@@index([created_at])
|
|
}
|
|
|
|
model LiteLLM_EndUserTable {
|
|
user_id String @id
|
|
alias String? // admin-facing alias
|
|
spend Float @default(0.0)
|
|
allowed_model_region String? // require all user requests to use models in this specific region
|
|
default_model String? // use along with 'allowed_model_region'. if no available model in region, default to this model.
|
|
budget_id String?
|
|
litellm_budget_table LiteLLM_BudgetTable? @relation(fields: [budget_id], references: [budget_id])
|
|
blocked Boolean @default(false)
|
|
}
|
|
|
|
// Track tags with budgets and spend
|
|
model LiteLLM_TagTable {
|
|
tag_name String @id
|
|
description String?
|
|
models String[]
|
|
model_info Json? // maps model_id to model_name
|
|
spend Float @default(0.0)
|
|
budget_id String?
|
|
litellm_budget_table LiteLLM_BudgetTable? @relation(fields: [budget_id], references: [budget_id])
|
|
created_at DateTime @default(now()) @map("created_at")
|
|
created_by String?
|
|
updated_at DateTime @default(now()) @updatedAt @map("updated_at")
|
|
}
|
|
|
|
// store proxy config.yaml
|
|
model LiteLLM_Config {
|
|
param_name String @id
|
|
param_value Json?
|
|
}
|
|
|
|
// View spend, model, api_key per request
|
|
model LiteLLM_SpendLogs {
|
|
request_id String @id
|
|
call_type String
|
|
api_key String @default ("") // Hashed API Token. Not the actual Virtual Key. Equivalent to 'token' column in LiteLLM_VerificationToken
|
|
spend Float @default(0.0)
|
|
total_tokens Int @default(0)
|
|
prompt_tokens Int @default(0)
|
|
completion_tokens Int @default(0)
|
|
startTime DateTime // Assuming start_time is a DateTime field
|
|
endTime DateTime // Assuming end_time is a DateTime field
|
|
completionStartTime DateTime? // Assuming completionStartTime is a DateTime field
|
|
model String @default("")
|
|
model_id String? @default("") // the model id stored in proxy model db
|
|
model_group String? @default("") // public model_name / model_group
|
|
custom_llm_provider String? @default("") // litellm used custom_llm_provider
|
|
api_base String? @default("")
|
|
user String? @default("")
|
|
metadata Json? @default("{}")
|
|
cache_hit String? @default("")
|
|
cache_key String? @default("")
|
|
request_tags Json? @default("[]")
|
|
team_id String?
|
|
organization_id String?
|
|
end_user String?
|
|
requester_ip_address String?
|
|
messages Json? @default("{}")
|
|
response Json? @default("{}")
|
|
session_id String?
|
|
status String?
|
|
mcp_namespaced_tool_name String?
|
|
agent_id String?
|
|
proxy_server_request Json? @default("{}")
|
|
@@index([startTime])
|
|
@@index([end_user])
|
|
@@index([session_id])
|
|
}
|
|
|
|
// View spend, model, api_key per request
|
|
model LiteLLM_ErrorLogs {
|
|
request_id String @id @default(uuid())
|
|
startTime DateTime // Assuming start_time is a DateTime field
|
|
endTime DateTime // Assuming end_time is a DateTime field
|
|
api_base String @default("")
|
|
model_group String @default("") // public model_name / model_group
|
|
litellm_model_name String @default("") // model passed to litellm
|
|
model_id String @default("") // ID of model in ProxyModelTable
|
|
request_kwargs Json @default("{}")
|
|
exception_type String @default("")
|
|
exception_string String @default("")
|
|
status_code String @default("")
|
|
}
|
|
|
|
// Beta - allow team members to request access to a model
|
|
model LiteLLM_UserNotifications {
|
|
request_id String @id
|
|
user_id String
|
|
models String[]
|
|
justification String
|
|
status String // approved, disapproved, pending
|
|
}
|
|
|
|
model LiteLLM_TeamMembership {
|
|
// Use this table to track the Internal User's Spend within a Team + Set Budgets, rpm limits for the user within the team
|
|
user_id String
|
|
team_id String
|
|
spend Float @default(0.0)
|
|
budget_id String?
|
|
litellm_budget_table LiteLLM_BudgetTable? @relation(fields: [budget_id], references: [budget_id])
|
|
@@id([user_id, team_id])
|
|
}
|
|
|
|
model LiteLLM_OrganizationMembership {
|
|
// Use this table to track Internal User and Organization membership. Helps tracking a users role within an Organization
|
|
user_id String
|
|
organization_id String
|
|
user_role String?
|
|
spend Float? @default(0.0)
|
|
budget_id String?
|
|
created_at DateTime? @default(now()) @map("created_at")
|
|
updated_at DateTime? @default(now()) @updatedAt @map("updated_at")
|
|
|
|
// relations
|
|
user LiteLLM_UserTable @relation(fields: [user_id], references: [user_id])
|
|
organization LiteLLM_OrganizationTable @relation("OrganizationToMembership", fields: [organization_id], references: [organization_id])
|
|
litellm_budget_table LiteLLM_BudgetTable? @relation(fields: [budget_id], references: [budget_id])
|
|
|
|
|
|
|
|
@@id([user_id, organization_id])
|
|
@@unique([user_id, organization_id])
|
|
}
|
|
|
|
model LiteLLM_InvitationLink {
|
|
// use this table to track invite links sent by admin for people to join the proxy
|
|
id String @id @default(uuid())
|
|
user_id String
|
|
is_accepted Boolean @default(false)
|
|
accepted_at DateTime? // when link is claimed (user successfully onboards via link)
|
|
expires_at DateTime // till when is link valid
|
|
created_at DateTime // when did admin create the link
|
|
created_by String // who created the link
|
|
updated_at DateTime // when was invite status updated
|
|
updated_by String // who updated the status (admin/user who accepted invite)
|
|
|
|
// Relations
|
|
liteLLM_user_table_user LiteLLM_UserTable @relation("UserId", fields: [user_id], references: [user_id])
|
|
liteLLM_user_table_created LiteLLM_UserTable @relation("CreatedBy", fields: [created_by], references: [user_id])
|
|
liteLLM_user_table_updated LiteLLM_UserTable @relation("UpdatedBy", fields: [updated_by], references: [user_id])
|
|
}
|
|
|
|
|
|
model LiteLLM_AuditLog {
|
|
id String @id @default(uuid())
|
|
updated_at DateTime @default(now())
|
|
changed_by String @default("") // user or system that performed the action
|
|
changed_by_api_key String @default("") // api key hash that performed the action
|
|
action String // create, update, delete
|
|
table_name String // on of LitellmTableNames.TEAM_TABLE_NAME, LitellmTableNames.USER_TABLE_NAME, LitellmTableNames.PROXY_MODEL_TABLE_NAME,
|
|
object_id String // id of the object being audited. This can be the key id, team id, user id, model id
|
|
before_value Json? // value of the row
|
|
updated_values Json? // value of the row after change
|
|
}
|
|
|
|
// Track daily user spend metrics per model and key
|
|
model LiteLLM_DailyUserSpend {
|
|
id String @id @default(uuid())
|
|
user_id String?
|
|
date String
|
|
api_key String
|
|
model String?
|
|
model_group String?
|
|
custom_llm_provider String?
|
|
mcp_namespaced_tool_name String?
|
|
endpoint String?
|
|
prompt_tokens BigInt @default(0)
|
|
completion_tokens BigInt @default(0)
|
|
cache_read_input_tokens BigInt @default(0)
|
|
cache_creation_input_tokens BigInt @default(0)
|
|
spend Float @default(0.0)
|
|
api_requests BigInt @default(0)
|
|
successful_requests BigInt @default(0)
|
|
failed_requests BigInt @default(0)
|
|
created_at DateTime @default(now())
|
|
updated_at DateTime @updatedAt
|
|
|
|
@@unique([user_id, date, api_key, model, custom_llm_provider, mcp_namespaced_tool_name, endpoint])
|
|
@@index([date])
|
|
@@index([user_id])
|
|
@@index([api_key])
|
|
@@index([model])
|
|
@@index([mcp_namespaced_tool_name])
|
|
@@index([endpoint])
|
|
}
|
|
|
|
// Track daily organization spend metrics per model and key
|
|
model LiteLLM_DailyOrganizationSpend {
|
|
id String @id @default(uuid())
|
|
organization_id String?
|
|
date String
|
|
api_key String
|
|
model String?
|
|
model_group String?
|
|
custom_llm_provider String?
|
|
mcp_namespaced_tool_name String?
|
|
endpoint String?
|
|
prompt_tokens BigInt @default(0)
|
|
completion_tokens BigInt @default(0)
|
|
cache_read_input_tokens BigInt @default(0)
|
|
cache_creation_input_tokens BigInt @default(0)
|
|
spend Float @default(0.0)
|
|
api_requests BigInt @default(0)
|
|
successful_requests BigInt @default(0)
|
|
failed_requests BigInt @default(0)
|
|
created_at DateTime @default(now())
|
|
updated_at DateTime @updatedAt
|
|
|
|
@@unique([organization_id, date, api_key, model, custom_llm_provider, mcp_namespaced_tool_name, endpoint])
|
|
@@index([date])
|
|
@@index([organization_id])
|
|
@@index([api_key])
|
|
@@index([model])
|
|
@@index([mcp_namespaced_tool_name])
|
|
@@index([endpoint])
|
|
}
|
|
|
|
// Track daily end user (customer) spend metrics per model and key
|
|
model LiteLLM_DailyEndUserSpend {
|
|
id String @id @default(uuid())
|
|
end_user_id String?
|
|
date String
|
|
api_key String
|
|
model String?
|
|
model_group String?
|
|
custom_llm_provider String?
|
|
mcp_namespaced_tool_name String?
|
|
endpoint String?
|
|
prompt_tokens BigInt @default(0)
|
|
completion_tokens BigInt @default(0)
|
|
cache_read_input_tokens BigInt @default(0)
|
|
cache_creation_input_tokens BigInt @default(0)
|
|
spend Float @default(0.0)
|
|
api_requests BigInt @default(0)
|
|
successful_requests BigInt @default(0)
|
|
failed_requests BigInt @default(0)
|
|
created_at DateTime @default(now())
|
|
updated_at DateTime @updatedAt
|
|
@@unique([end_user_id, date, api_key, model, custom_llm_provider, mcp_namespaced_tool_name, endpoint])
|
|
@@index([date])
|
|
@@index([end_user_id])
|
|
@@index([api_key])
|
|
@@index([model])
|
|
@@index([mcp_namespaced_tool_name])
|
|
@@index([endpoint])
|
|
}
|
|
|
|
// Track daily agent spend metrics per model and key
|
|
model LiteLLM_DailyAgentSpend {
|
|
id String @id @default(uuid())
|
|
agent_id String?
|
|
date String
|
|
api_key String
|
|
model String?
|
|
model_group String?
|
|
custom_llm_provider String?
|
|
mcp_namespaced_tool_name String?
|
|
endpoint String?
|
|
prompt_tokens BigInt @default(0)
|
|
completion_tokens BigInt @default(0)
|
|
cache_read_input_tokens BigInt @default(0)
|
|
cache_creation_input_tokens BigInt @default(0)
|
|
spend Float @default(0.0)
|
|
api_requests BigInt @default(0)
|
|
successful_requests BigInt @default(0)
|
|
failed_requests BigInt @default(0)
|
|
created_at DateTime @default(now())
|
|
updated_at DateTime @updatedAt
|
|
@@unique([agent_id, date, api_key, model, custom_llm_provider, mcp_namespaced_tool_name, endpoint])
|
|
@@index([date])
|
|
@@index([agent_id])
|
|
@@index([api_key])
|
|
@@index([model])
|
|
@@index([mcp_namespaced_tool_name])
|
|
@@index([endpoint])
|
|
}
|
|
|
|
// Track daily team spend metrics per model and key
|
|
model LiteLLM_DailyTeamSpend {
|
|
id String @id @default(uuid())
|
|
team_id String?
|
|
date String
|
|
api_key String
|
|
model String?
|
|
model_group String?
|
|
custom_llm_provider String?
|
|
mcp_namespaced_tool_name String?
|
|
endpoint String?
|
|
prompt_tokens BigInt @default(0)
|
|
completion_tokens BigInt @default(0)
|
|
cache_read_input_tokens BigInt @default(0)
|
|
cache_creation_input_tokens BigInt @default(0)
|
|
spend Float @default(0.0)
|
|
api_requests BigInt @default(0)
|
|
successful_requests BigInt @default(0)
|
|
failed_requests BigInt @default(0)
|
|
created_at DateTime @default(now())
|
|
updated_at DateTime @updatedAt
|
|
|
|
@@unique([team_id, date, api_key, model, custom_llm_provider, mcp_namespaced_tool_name, endpoint])
|
|
@@index([date])
|
|
@@index([team_id])
|
|
@@index([api_key])
|
|
@@index([model])
|
|
@@index([mcp_namespaced_tool_name])
|
|
@@index([endpoint])
|
|
}
|
|
|
|
// Track daily team spend metrics per model and key
|
|
model LiteLLM_DailyTagSpend {
|
|
id String @id @default(uuid())
|
|
request_id String?
|
|
tag String?
|
|
date String
|
|
api_key String
|
|
model String?
|
|
model_group String?
|
|
custom_llm_provider String?
|
|
mcp_namespaced_tool_name String?
|
|
endpoint String?
|
|
prompt_tokens BigInt @default(0)
|
|
completion_tokens BigInt @default(0)
|
|
cache_read_input_tokens BigInt @default(0)
|
|
cache_creation_input_tokens BigInt @default(0)
|
|
spend Float @default(0.0)
|
|
api_requests BigInt @default(0)
|
|
successful_requests BigInt @default(0)
|
|
failed_requests BigInt @default(0)
|
|
created_at DateTime @default(now())
|
|
updated_at DateTime @updatedAt
|
|
|
|
@@unique([tag, date, api_key, model, custom_llm_provider, mcp_namespaced_tool_name, endpoint])
|
|
@@index([date])
|
|
@@index([tag])
|
|
@@index([api_key])
|
|
@@index([model])
|
|
@@index([mcp_namespaced_tool_name])
|
|
@@index([endpoint])
|
|
}
|
|
|
|
|
|
// Track the status of cron jobs running. Only allow one pod to run the job at a time
|
|
model LiteLLM_CronJob {
|
|
cronjob_id String @id @default(cuid()) // Unique ID for the record
|
|
pod_id String // Unique identifier for the pod acting as the leader
|
|
status JobStatus @default(INACTIVE) // Status of the cron job (active or inactive)
|
|
last_updated DateTime @default(now()) // Timestamp for the last update of the cron job record
|
|
ttl DateTime // Time when the leader's lease expires
|
|
}
|
|
|
|
enum JobStatus {
|
|
ACTIVE
|
|
INACTIVE
|
|
}
|
|
|
|
model LiteLLM_ManagedFileTable {
|
|
id String @id @default(uuid())
|
|
unified_file_id String @unique // The base64 encoded unified file ID
|
|
file_object Json? // Stores the OpenAIFileObject
|
|
model_mappings Json
|
|
flat_model_file_ids String[] @default([]) // Flat list of model file id's - for faster querying of model id -> unified file id
|
|
storage_backend String? // Storage backend name (e.g., "azure_storage", "gcs", "default")
|
|
storage_url String? // The actual storage URL where the file is stored
|
|
created_at DateTime @default(now())
|
|
created_by String?
|
|
updated_at DateTime @updatedAt
|
|
updated_by String?
|
|
|
|
@@index([unified_file_id])
|
|
}
|
|
|
|
model LiteLLM_ManagedObjectTable { // for batches or finetuning jobs which use the
|
|
id String @id @default(uuid())
|
|
unified_object_id String @unique // The base64 encoded unified file ID
|
|
model_object_id String @unique // the id returned by the backend API provider
|
|
file_object Json // Stores the OpenAIFileObject
|
|
file_purpose String // either 'batch' or 'fine-tune'
|
|
status String? // check if batch cost has been tracked
|
|
created_at DateTime @default(now())
|
|
created_by String?
|
|
updated_at DateTime @updatedAt
|
|
updated_by String?
|
|
|
|
@@index([unified_object_id])
|
|
@@index([model_object_id])
|
|
}
|
|
|
|
model LiteLLM_ManagedVectorStoreTable {
|
|
id String @id @default(uuid())
|
|
unified_resource_id String @unique // The base64 encoded unified vector store ID
|
|
resource_object Json? // Stores the VectorStoreCreateResponse
|
|
model_mappings Json // Maps model_id -> provider_vector_store_id
|
|
flat_model_resource_ids String[] @default([]) // Flat list of provider vector store IDs for faster querying
|
|
storage_backend String? // Storage backend name (if applicable)
|
|
storage_url String? // Storage URL (if applicable)
|
|
created_at DateTime @default(now())
|
|
created_by String?
|
|
updated_at DateTime @updatedAt
|
|
updated_by String?
|
|
|
|
@@index([unified_resource_id])
|
|
}
|
|
|
|
model LiteLLM_ManagedVectorStoresTable {
|
|
vector_store_id String @id
|
|
custom_llm_provider String
|
|
vector_store_name String?
|
|
vector_store_description String?
|
|
vector_store_metadata Json?
|
|
created_at DateTime @default(now())
|
|
updated_at DateTime @updatedAt
|
|
litellm_credential_name String?
|
|
litellm_params Json?
|
|
team_id String?
|
|
user_id String?
|
|
|
|
@@index([team_id])
|
|
@@index([user_id])
|
|
}
|
|
|
|
// Guardrails table for storing guardrail configurations
|
|
model LiteLLM_GuardrailsTable {
|
|
guardrail_id String @id @default(uuid())
|
|
guardrail_name String @unique
|
|
litellm_params Json
|
|
guardrail_info Json?
|
|
team_id String?
|
|
created_at DateTime @default(now())
|
|
updated_at DateTime @updatedAt
|
|
}
|
|
|
|
// Prompt table for storing prompt configurations
|
|
model LiteLLM_PromptTable {
|
|
id String @id @default(uuid())
|
|
prompt_id String
|
|
version Int @default(1)
|
|
litellm_params Json
|
|
prompt_info Json?
|
|
created_at DateTime @default(now())
|
|
updated_at DateTime @updatedAt
|
|
|
|
@@unique([prompt_id, version])
|
|
@@index([prompt_id])
|
|
}
|
|
|
|
model LiteLLM_HealthCheckTable {
|
|
health_check_id String @id @default(uuid())
|
|
model_name String
|
|
model_id String?
|
|
status String
|
|
healthy_count Int @default(0)
|
|
unhealthy_count Int @default(0)
|
|
error_message String?
|
|
response_time_ms Float?
|
|
details Json?
|
|
checked_by String?
|
|
checked_at DateTime @default(now())
|
|
created_at DateTime @default(now())
|
|
updated_at DateTime @updatedAt
|
|
|
|
@@index([model_name])
|
|
@@index([checked_at])
|
|
@@index([status])
|
|
}
|
|
|
|
// Search Tools table for storing search tool configurations
|
|
model LiteLLM_SearchToolsTable {
|
|
search_tool_id String @id @default(uuid())
|
|
search_tool_name String @unique
|
|
litellm_params Json
|
|
search_tool_info Json?
|
|
created_at DateTime @default(now())
|
|
updated_at DateTime @updatedAt
|
|
}
|
|
|
|
// SSO configuration table
|
|
model LiteLLM_SSOConfig {
|
|
id String @id @default("sso_config")
|
|
sso_settings Json
|
|
created_at DateTime @default(now())
|
|
updated_at DateTime @updatedAt
|
|
}
|
|
|
|
model LiteLLM_ManagedVectorStoreIndexTable {
|
|
id String @id @default(uuid())
|
|
index_name String @unique
|
|
litellm_params Json
|
|
index_info Json?
|
|
created_at DateTime @default(now())
|
|
created_by String?
|
|
updated_at DateTime @updatedAt
|
|
updated_by String?
|
|
}
|
|
|
|
// Cache configuration table
|
|
model LiteLLM_CacheConfig {
|
|
id String @id @default("cache_config")
|
|
cache_settings Json
|
|
created_at DateTime @default(now())
|
|
updated_at DateTime @updatedAt
|
|
}
|
|
|
|
// UI Settings configuration table
|
|
model LiteLLM_UISettings {
|
|
id String @id @default("ui_settings")
|
|
ui_settings Json
|
|
created_at DateTime @default(now())
|
|
updated_at DateTime @updatedAt
|
|
}
|
|
|
|
// Skills table for storing LiteLLM-managed skills
|
|
model LiteLLM_SkillsTable {
|
|
skill_id String @id @default(uuid())
|
|
display_title String?
|
|
description String?
|
|
instructions String? // The skill instructions/prompt (from SKILL.md)
|
|
source String @default("custom") // "custom" or "anthropic"
|
|
latest_version String?
|
|
file_content Bytes? // Binary content of the skill files (zip)
|
|
file_name String? // Original filename
|
|
file_type String? // MIME type (e.g., "application/zip")
|
|
metadata Json? @default("{}")
|
|
created_at DateTime @default(now())
|
|
created_by String?
|
|
updated_at DateTime @default(now()) @updatedAt
|
|
updated_by String?
|
|
}
|
|
|
|
// Policy table for storing guardrail policies
|
|
model LiteLLM_PolicyTable {
|
|
policy_id String @id @default(uuid())
|
|
policy_name String @unique
|
|
inherit String? // Name of parent policy to inherit from
|
|
description String?
|
|
guardrails_add String[] @default([])
|
|
guardrails_remove String[] @default([])
|
|
condition Json? @default("{}") // Policy conditions (e.g., model matching)
|
|
pipeline Json? // Optional guardrail pipeline (mode + steps[])
|
|
created_at DateTime @default(now())
|
|
created_by String?
|
|
updated_at DateTime @default(now()) @updatedAt
|
|
updated_by String?
|
|
}
|
|
|
|
// Policy attachment table for defining where policies apply
|
|
model LiteLLM_PolicyAttachmentTable {
|
|
attachment_id String @id @default(uuid())
|
|
policy_name String // Name of the policy to attach
|
|
scope String? // Use '*' for global scope
|
|
teams String[] @default([]) // Team aliases or patterns
|
|
keys String[] @default([]) // Key aliases or patterns
|
|
models String[] @default([]) // Model names or patterns
|
|
tags String[] @default([]) // Tag patterns (e.g., ["healthcare", "prod-*"])
|
|
created_at DateTime @default(now())
|
|
created_by String?
|
|
updated_at DateTime @default(now()) @updatedAt
|
|
updated_by String?
|
|
}
|
|
|
|
//Unified Access Groups table for storing unified access groups
|
|
model LiteLLM_AccessGroupTable {
|
|
access_group_id String @id @default(uuid())
|
|
access_group_name String @unique
|
|
description String?
|
|
|
|
// Resource memberships - explicit arrays per type
|
|
access_model_names String[] @default([])
|
|
access_mcp_server_ids String[] @default([])
|
|
access_agent_ids String[] @default([])
|
|
|
|
assigned_team_ids String[] @default([])
|
|
assigned_key_ids String[] @default([])
|
|
|
|
created_at DateTime @default(now())
|
|
created_by String?
|
|
updated_at DateTime @default(now()) @updatedAt
|
|
updated_by String?
|
|
} |