scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-04 02:31:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 70
34166 commits 3112 branches 1436 tags 4.4 GiB
Commit graph

34166 commits

This branch
This branch
All branches
Author SHA1 Message Date
Ishaan Jaffer
4b7e8efe6c refactor(proxy): consolidate DD APM tag helpers into DDSpanTagger class 2026-03-03 14:00:17 -08:00
Ishaan Jaffer
a112e78795 feat(proxy): add key_alias, key_hash, requested_model tags to DD APM spans 2026-03-03 13:52:51 -08:00
yuneng-jiang
2d26209d80
Merge pull request #22698 from BerriAI/litellm_test_projects_hooks 
[Test] UI - Projects: Add unit tests for project hooks
 2026-03-03 13:42:28 -08:00
Julio Quinteros Pro
fbf916d71e
Merge pull request #22699 from BerriAI/fix/mypy-count-tokens-signature 
Fix mypy override errors in count_tokens signatures
 2026-03-03 18:28:14 -03:00
Julio Quinteros Pro
279b4f16cb Fix mypy override errors in count_tokens signatures 
Replace **kwargs with explicit tools and system parameters to match
the BaseTokenCounter.count_tokens abstract method signature.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-03 18:15:27 -03:00
Harshit Jain
b62a4be6b6
Merge pull request #22676 from BerriAI/litellm_feat_guardrail-list 
feat: guardrail-mode-default-list
 2026-03-04 02:36:57 +05:30
yuneng-jiang
4edb1e00c6 [Test] UI - Add unit tests for project hooks 
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
 2026-03-03 12:36:26 -08:00
Harshit28j
d661419109 fix: support list of modes in Mode.default for tag-based guardrails 2026-03-04 01:50:28 +05:30
yuneng-jiang
4c1b15d685
Merge pull request #22687 from BerriAI/litellm_fix_spend_log_cleanup 
[Fix] Spend Log Cleanup: lock tracking, integer retention, skip log level
 2026-03-03 10:48:20 -08:00
yuneng-jiang
a1ba6c9fa6 Fix log levels: info for unconfigured, warning for misconfigured 
Suppress noisy error log fired every cron tick when spend log cleanup
is simply not configured. _should_delete_spend_logs already logs the
specific reason at the right level (info for None, warning for
invalid value), so the redundant blanket error log in
cleanup_old_spend_logs is removed.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
 2026-03-03 10:21:31 -08:00
yuneng-jiang
224c617119 Fix spend log cleanup: lock tracking, integer retention, skip log level 
- Only release distributed lock in finally if it was actually acquired;
  prevents spurious Redis release_lock calls on early returns
- Treat bare integer maximum_spend_logs_retention_period as days (e.g. 3 → "3d")
  instead of silently failing with a ValueError
- Elevate "Skipping cleanup" log from info to error so misconfigured
  retention settings are visible without verbose logging
- Add tests for all three fixes

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
 2026-03-03 10:12:08 -08:00
yuneng-jiang
b4980340fb
Merge pull request #22680 from BerriAI/litellm_fix_mcp_server_dates 
[Fix] MCP server: preserve created_at and updated_at timestamps
 2026-03-03 09:53:37 -08:00
yuneng-jiang
76e3dba0f8 fix mcp server created_at and updated_at timestamps being overwritten with current time 
- Add created_at field to MCPServer type (was missing)
- Map created_at from LiteLLM_MCPServerTable in build_mcp_server_from_table()
- Use server.created_at and server.updated_at instead of datetime.now() in _build_mcp_server_table() and health check table builder
- Add regression tests to verify timestamps are preserved through round-trip conversions

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
 2026-03-03 09:41:45 -08:00
Harshit28j
22e682b1e8 feat: guardrail-mode-default-list 2026-03-03 22:45:32 +05:30
Sameer Kankute
afc7b87b36
Merge pull request #22656 from BerriAI/litellm_add_vector_store_Ui 
Add support for Attaching knowledge base to model via UI
 2026-03-03 22:25:59 +05:30
Sameer Kankute
daa0397f30
Merge pull request #22674 from BerriAI/litellm_gemini-3.1-flash-lite-preview 
Day 0 gemini 3.1 flash lite preview support
 2026-03-03 22:23:17 +05:30
Sameer Kankute
9d06106af0 Fix gemini-3.1-flash-lite-preview for streaming 2026-03-03 22:22:57 +05:30
Sameer Kankute
c3fe4634b6 Add correct pricing for gemini 3.1 flash lite 2026-03-03 22:06:16 +05:30
Cesar Garcia
a0cc550f48
Merge pull request #22665 from Chesars/feat/add-zai-glm-5-model-pricing 
feat(models): add zai/glm-5 and zai/glm-5-code to model cost map
 2026-03-03 12:17:42 -03:00
Chesars
75518c3ca7 feat(models): add zai/glm-5 and zai/glm-5-code to model cost map 
Add native ZhipuAI GLM-5 and GLM-5-Code model entries with pricing
from docs.z.ai/guides/overview/pricing.
 2026-03-03 12:03:40 -03:00
Harshit28j
7d322e0d44 Merge branch 'main' of https://github.com/BerriAI/litellm into litellm_custm_auth 2026-03-03 20:24:44 +05:30
Cesar Garcia
dfd7203d7f
Merge pull request #22650 from Chesars/fix/add-missing-dashscope-glm5-pricing 
fix(pricing): add 7 missing DashScope model pricing entries
 2026-03-03 11:53:30 -03:00
Cesar Garcia
105a40ba4f
Merge pull request #22649 from Chesars/fix/add-missing-openrouter-model-pricing 
fix(pricing): add 5 missing OpenRouter model pricing entries
 2026-03-03 11:53:07 -03:00
Harshit28j
6d535e5639 fix(proxy): allow custom auth routes to bypass route authorization checks 
Custom user-added routes (e.g. /ldap/ngs/ready) used with Depends(user_api_key_auth) were being rejected as admin-only after _run_post_custom_auth_checks was introduced in commit 14badde13c.

The route authorization check in common_checks is designed for LiteLLM's own management routes. Custom auth flows that add their own routes should be trusted since the custom auth function already validated the request. Budget and expiry checks still run.

Add skip_route_check parameter to common_checks() and pass skip_route_check=True from _run_post_custom_auth_checks() to skip route authorization while preserving budget/team/model checks.

Regression test added: test_common_checks_skip_route_check_for_custom_auth

Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>
 2026-03-03 20:20:47 +05:30
Sameer Kankute
c1b39a6425
Merge pull request #22651 from BerriAI/litellm_encrypted_content_affinity_2 
Add support for encrypted content affinity
 2026-03-03 19:43:47 +05:30
Sameer Kankute
a9ee8ff5d2
Merge pull request #22641 from BerriAI/litellm_remove_default_litellm_thinking 
[Chore]Remove defualt hardcoded thinking levels for gemini 3 family
 2026-03-03 19:42:40 +05:30
Sameer Kankute
bdfc602dbf
Merge pull request #22625 from BerriAI/litellm_azure_ai_finetune 
Fix: Azure ai finetuning api
 2026-03-03 19:42:17 +05:30
Harshit Jain
bb1da7091a
Merge pull request #22631 from Harshit28j/litellm_bump_litellm_08_03 
bump: version 1.82.0 → 1.82.1
 2026-03-03 19:35:56 +05:30
Sameer Kankute
88dd1b5801
Merge pull request #22657 from BerriAI/revert-22654-litellm_add_Qwen3.5-397B-A17B 
Revert "feat(togetherai): add support for togetherai/Qwen3.5-397B-A17B model"
 2026-03-03 19:35:39 +05:30
Sameer Kankute
24ec7f882f
Revert "feat(togetherai): add support for togetherai/Qwen3.5-397B-A17B model" 2026-03-03 19:35:26 +05:30
Sameer Kankute
6c0387d170 Add support for Attaching knowledge base to model via UI 2026-03-03 19:31:55 +05:30
Sameer Kankute
974c02fae4
Merge pull request #22654 from Varad2001/litellm_add_Qwen3.5-397B-A17B 
feat(togetherai): add support for togetherai/Qwen3.5-397B-A17B model
 2026-03-03 19:19:41 +05:30
Varad Khonde
d66f8bc15d feat(togetherai): add support for togetherai/Qwen3.5-397B-A17B model 2026-03-03 19:17:28 +05:30
Sameer Kankute
9ffbd9e30e
Merge pull request #22464 from Point72/ephrimstanley/batch-fixes-feb27 
Managed batches fixes for vertex
 2026-03-03 18:53:53 +05:30
Sameer Kankute
2f6279d189 Fix import issue 2026-03-03 18:41:15 +05:30
Sameer Kankute
ca597e18c8 Fix routing of encrypted content 2026-03-03 18:37:28 +05:30
Sameer Kankute
521f804350 Fix encrypted content streaming affinity issue 2026-03-03 18:37:22 +05:30
Sameer Kankute
2bc4da76ce Update the tests 2026-03-03 18:36:07 +05:30
Sameer Kankute
37834f1d2a Update the docs 2026-03-03 18:36:07 +05:30
Sameer Kankute
7928d41e9a Update the routing 2026-03-03 18:36:07 +05:30
Sameer Kankute
122f534d87 Add encoding method for Encrypted-content-aware deployment 2026-03-03 18:36:07 +05:30
Sameer Kankute
adec115db8 Fix logging for error 2026-03-03 18:36:07 +05:30
Sameer Kankute
18bf3f2df6 Fix mock github test 2026-03-03 18:36:07 +05:30
Sameer Kankute
a88a17796b Fix logging and encrypted content extraction 2026-03-03 18:36:07 +05:30
Sameer Kankute
37612bdf56 ADd incident report 2026-03-03 18:36:07 +05:30
Sameer Kankute
fbec5c5ccf Add docs for encrypted_content_affinity 2026-03-03 18:36:07 +05:30
Sameer Kankute
9f627c67d8 Add tests for encrypted_content_affinity 2026-03-03 18:36:07 +05:30
Sameer Kankute
394c49d303 Add tests for encrypted_content_affinity 2026-03-03 18:36:07 +05:30
Sameer Kankute
92b2556282 Add encrypted_content_affinity in router 2026-03-03 18:34:46 +05:30
Sameer Kankute
058fac848e Add Encrypted-content-aware deployment affinity for the Router 2026-03-03 18:34:46 +05:30