scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-14 23:21:35 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 102
litellm/docs/my-website/docs
History
Krrish Dholakia ecd9a83e61 fix(adaptive_router): P2 review items — @updatedAt + snapshot samples 
- Mark last_updated_at (AdaptiveRouterState) and last_activity_at
  (AdaptiveRouterSession) with @updatedAt so Prisma refreshes the
  timestamps on every write. Without this the fields stayed frozen at
  INSERT time and the last_activity_at index was misleading for any
  future TTL/eviction logic. Applied to all three schema.prisma copies;
  no migration SQL change needed (Prisma @updatedAt is a client-side
  annotation that doesn't touch DDL).

- get_state_snapshot: report cell.total_samples instead of alpha+beta
  for the 'samples' field. The previous value inflated every cell by
  the COLD_START_MASS prior (e.g. showed 10.0 before any real traffic
  arrived), which confused operators reading /adaptive_router/.../state.
  Updated docs + the snapshot test to match.

Also fixes two pre-existing merge-break syntax errors in router.py
(missing ')' on the AdaptiveRouter TYPE_CHECKING import; truncated
async_pre_routing_hook dispatch call for the adaptive router branch)
that were masking the rest of the file from the interpreter.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-04-21 16:27:01 -07:00
..
adding_provider build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
anthropic_unified Merge branch 'upstream/main' into HEAD 2026-03-13 22:56:08 -03:00
caching build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
completion Add supported providers to prompt caching doc (#26124) 2026-04-20 15:25:21 -07:00
contribute_integration docs(community.md): add new integration partner doc 2025-12-09 18:17:14 -08:00
contributing merge: resolve conflicts between main and litellm_oss_staging_03_11_2026 2026-03-12 09:38:31 -03:00
debugging fix: cleanup 2026-03-25 09:20:25 -07:00
embedding merge: resolve conflicts between main and litellm_oss_staging_03_11_2026 2026-03-12 09:38:31 -03:00
extras build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
guides docs: sidebar updates, letta resources links, Google GenAI SDK, cost tracking order 2026-03-18 04:28:06 +05:30
integrations build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
langchain build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
learn build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
observability build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
pass_through build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
projects build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
provider_registration merge: resolve conflicts between main and litellm_oss_staging_03_11_2026 2026-03-12 09:38:31 -03:00
providers Feature/add audio support for scaleway (#26110) 2026-04-20 14:49:41 -07:00
proxy Prompt Compression - add it to the proxy (#25729) 2026-04-20 15:08:00 -07:00
search feat(search): add Serper (serper.dev) as search provider (#23112) 2026-03-09 08:40:37 -07:00
secret_managers build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
troubleshoot Merge pull request #25622 from Sameerlite/litellm_docs_cost_discrepancy_guide 2026-04-15 18:43:15 -07:00
tutorials Add supported providers to prompt caching doc (#26124) 2026-04-20 15:25:21 -07:00
vector_stores Add vector store support for ragflow 2025-12-03 15:29:47 +05:30
a2a.md Agents - add max budget + tpm/rpm limiting per agent AND per agent session (#22849) 2026-03-07 19:12:42 -08:00
a2a_agent_headers.md docs(agents): add A2A agent authentication headers guide 2026-03-05 15:11:18 +05:30
a2a_agent_permissions.md [Docs] A2a - Permission management (#17515) 2025-12-04 17:29:47 -08:00
a2a_cost_tracking.md fix: prompt registry 2026-02-18 00:34:54 +05:30
a2a_invoking_agents.md fix: prompt registry 2026-02-18 00:34:54 +05:30
a2a_iteration_budgets.md Agents - add max budget + tpm/rpm limiting per agent AND per agent session (#22849) 2026-03-07 19:12:42 -08:00
adaptive_router.md fix(adaptive_router): P2 review items — @updatedAt + snapshot samples 2026-04-21 16:27:01 -07:00
aiohttp_benchmarks.md
anthropic_count_tokens.md Litellm fix update bedrock models (#24947) 2026-04-01 19:22:54 -07:00
apply_guardrail.md merge: resolve conflicts between main and litellm_oss_staging_03_11_2026 2026-03-12 09:38:31 -03:00
assistants.md docs: improve Getting Started page and SDK documentation structure (#17614) 2025-12-08 13:05:50 -08:00
audio_transcription.md merge: resolve conflicts between main and litellm_oss_staging_03_11_2026 2026-03-12 09:38:31 -03:00
batches.md fix: prompt registry 2026-02-18 00:34:54 +05:30
bedrock_converse.md
bedrock_invoke.md
benchmarks.md docs: clarify how to get benchmarking script 2026-04-11 17:31:03 -07:00
budget_manager.md
contact.md docs: update broken Slack invite links to support page (#16546) 2025-11-12 12:41:55 -08:00
container_files.md fix: prompt registry 2026-02-18 00:34:54 +05:30
containers.md [docs] add docs for containers files api + code interpreter on LiteLLM (#17749) 2025-12-09 18:11:28 -08:00
contributing.md build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
count_tokens.md merge: resolve conflicts between main and litellm_oss_staging_03_11_2026 2026-03-12 09:38:31 -03:00
data_retention.md fix: prompt registry 2026-02-18 00:34:54 +05:30
data_security.md fix: cleanup 2026-03-25 09:20:25 -07:00
default_code_snippet.md build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
enterprise.md docs: document new github + gitlab ci scripts 2026-03-25 20:17:10 -07:00
evals_api.md fix: prompt registry 2026-02-18 00:34:54 +05:30
exception_mapping.md Adds support for returning Azure Content Policy error information when exceptions from Azure OpenAI occur (#16231) 2025-11-08 16:04:36 -08:00
files_endpoints.md feat(anthropic): add Files API support for SDK 2026-03-11 12:45:19 -03:00
fine_tuning.md docs: document new github + gitlab ci scripts 2026-03-25 20:17:10 -07:00
generateContent.md fix: Metadata / Trace ID Missing in S3 Streaming Callbacks 2026-02-25 14:16:42 +05:30
image_edits.md merge: resolve conflicts between main and litellm_oss_staging_03_11_2026 2026-03-12 09:38:31 -03:00
image_generation.md merge: resolve conflicts between main and litellm_oss_staging_03_11_2026 2026-03-12 09:38:31 -03:00
image_variations.md
index.md Add docs announcement bar for Trivy compromise resolution (#25870) 2026-04-16 15:15:52 -07:00
interactions.md fix(ollama): thread api_base to get_model_info + graceful fallback (#21970) 2026-02-23 21:00:37 -08:00
load_test.md build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
load_test_advanced.md build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
load_test_rpm.md
load_test_sdk.md
mcp.md Litellm ishaan march30 (#24887) (#25151) 2026-04-04 14:44:07 -07:00
mcp_aws_sigv4.md build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
mcp_control.md [Chore] update mcp documentation for header forwarding 2026-03-04 13:07:25 +05:30
mcp_cost.md
mcp_guardrail.md merge: resolve conflicts between main and litellm_oss_staging_03_11_2026 2026-03-12 09:38:31 -03:00
mcp_oauth.md build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
mcp_openapi.md feat(mcp): allow admins to override tool name and description per MCP server (#22828) 2026-03-04 17:58:05 -08:00
mcp_public_internet.md fix: prompt registry 2026-02-18 00:34:54 +05:30
mcp_semantic_filter.md fix: prompt registry 2026-02-18 00:34:54 +05:30
mcp_toolsets.md Litellm ishaan march23 - MCP Toolsets + GCP Caching fix (#25146) (#25155) 2026-04-04 16:23:21 -07:00
mcp_troubleshoot.md fix: prompt registry 2026-02-18 00:34:54 +05:30
mcp_usage.md
mcp_zero_trust.md docs(mcp_zero_trust): add MCP zero trust auth guide (#23918) 2026-03-17 17:45:16 -07:00
migration.md fix: cleanup 2026-03-25 09:20:25 -07:00
migration_policy.md
moderation.md docs(moderation.md): fix moderation quick start docs 2025-11-07 16:25:08 -08:00
ocr.md Enable local file support for OCR (#22133) 2026-02-27 10:50:02 -08:00
oidc.md address review feedback 2026-04-11 21:52:39 -07:00
old_guardrails.md
projects.md
prompt_management.md Add support for prompt management for responses 2026-03-18 15:48:31 +05:30
proxy_api.md build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
proxy_auth.md build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
proxy_server.md build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
rag_ingest.md build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
rag_query.md fix: prompt registry 2026-02-18 00:34:54 +05:30
realtime.md Announce April Townhall (#25021) 2026-04-02 14:10:49 -07:00
reasoning_content.md docs(reasoning_content.md): update guide 2026-03-23 17:23:14 -07:00
rerank.md feat: Add IBM watsonx.ai rerank support (#21303) 2026-02-16 20:12:16 -08:00
response_api.md build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
response_api_compact.md fix: prompt registry 2026-02-18 00:34:54 +05:30
router_architecture.md
routing.md Merge pull request #24611 from Sameerlite/Sameerlite/order-fallback2 2026-03-27 20:15:30 +05:30
rules.md
scheduler.md
sdk_custom_pricing.md build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
secret.md docs: document new github + gitlab ci scripts 2026-03-25 20:17:10 -07:00
set_keys.md
skills.md [Docs] Claude Skills API (#17052) 2025-11-24 15:32:03 -08:00
skills_gateway.md feat: multiple concurrent budget windows per API key and team (#24883) (#25109) 2026-04-06 14:02:04 -07:00
text_completion.md
text_to_speech.md fix: prompt registry 2026-02-18 00:34:54 +05:30
traffic_mirroring.md fix: prompt registry 2026-02-18 00:34:54 +05:30
troubleshoot.md docs: remove phone numbers from readme and docs 2026-03-25 12:40:40 -07:00
vector_store_files.md fix docs 2025-11-15 16:58:47 -08:00
vertex_batch_passthrough.md Enhance documentation and sidebar structure 2026-03-17 02:10:06 +05:30
videos.md Add new videos docs 2026-03-16 17:57:14 +05:30
wildcard_routing.md