Commit graph

24472 commits

Author SHA1 Message Date
Fang Gong
91040b6b56 fix the api key support for bedrock guardrail in proxy 2025-08-20 18:46:00 -07:00
Krrish Dholakia
34ad646101 fix(auth_checks.py): handle both flows + add unit tests 2025-08-20 16:42:08 -07:00
Krrish Dholakia
e5c3e006c2 fix(proxy_server.py): fix merge config + db router settings logic 2025-08-20 16:33:31 -07:00
Krrish Dholakia
52cbedf044 fix(auth_checks.py): ensure if key has access to aliased model, it still works 2025-08-20 15:36:32 -07:00
Krrish Dholakia
b0c98efd14 fix(__init__.py): remove redundant value 2025-08-20 15:10:58 -07:00
Krrish Dholakia
5c1b27af99 docs(quick_start.md): add back to navbar
useful for showing setup via cli
2025-08-20 15:09:19 -07:00
Krrish Dholakia
fb5b2d8d47 docs: remove old doc
prevent showing up on searches
2025-08-20 15:01:32 -07:00
Ishaan Jaff
55dcaded72
[Feat] Add VertexAI qwen API Service (#13828)
* add support for vertex AI QWEN API

* streaming QWEN API support

* test_partner_models_httpx

* test_partner_models_httpx_streaming

* add cost tracking for vertex_ai/qwen/qwen3-235b-a22b-instruct-2507-maa

* docs qwen models vertexAI
2025-08-20 15:00:33 -07:00
tanjiro
5299e9ad4a
fix key edit settings after regenerating key (#13815) 2025-08-20 14:34:38 -07:00
tanjiro
f7a3af5cde
new notifications (#13813) 2025-08-20 14:32:04 -07:00
Ishaan Jaff
6f6fd0de0d
add fireworks_ai/accounts/fireworks/models/deepseek-v3-0324 (#13821) 2025-08-20 14:31:24 -07:00
Sameer Kankute
5b5a2d12a8 remove test 2025-08-21 00:32:16 +05:30
Sameer Kankute
1d1d637ac0 fix automated checks 2025-08-21 00:09:17 +05:30
Sameer Kankute
37b84d1582 Add rerank endpoint support for deepinfra 2025-08-20 23:36:05 +05:30
Ishaan Jaff
12bae8fdda test_partner_models_httpx_streaming 2025-08-20 09:44:47 -07:00
Ishaan Jaff
e69a895884 test_apply_default_settings 2025-08-20 08:53:38 -07:00
Ishaan Jaff
45a9af8063 security fix 2025-08-20 08:40:49 -07:00
Ishaan Jaff
e229a6a796 security fix 2025-08-20 08:35:59 -07:00
Qingchuan Hao
f2a6be390b feat(utils.py): accept 'api_version' as param for validate_environment 2025-08-20 14:29:58 +00:00
hgyun.lee
036b358636 Synchronize cache behavior between acompletion and completion 2025-08-20 18:27:36 +09:00
Fang Gong
d2b943f391 fix application inference profile for pass-through endpoints for bedrock 2025-08-20 01:06:29 -07:00
Fang Gong
fe51647e3c fix application inference profile for pass-through endpoints for bedrock 2025-08-20 01:03:49 -07:00
Fang Gong
caad9b3ca7 fix application inference profile for pass-through endpoints for bedrock 2025-08-20 00:40:43 -07:00
Tomu Hirata
5879f6e930 comment 2025-08-20 15:46:53 +09:00
Tomu Hirata
c1dbd1c2c1 remove comment
Signed-off-by: Tomu Hirata <tomu.hirata@gmail.com>
2025-08-20 15:42:26 +09:00
Tomu Hirata
d64b579131 Include predicted output in tracing
Signed-off-by: Tomu Hirata <tomu.hirata@gmail.com>
2025-08-20 15:39:32 +09:00
Tim Elfrink
972d7f7133 Merge branch 'main' of https://github.com/BerriAI/litellm into feat/github-copilot-thinking-reasoning-support 2025-08-20 07:58:11 +02:00
Krish Dholakia
4df07a5060
Merge pull request #13622 from BerriAI/fix-passthrough-deletion-failure
Fix query passthrough deletion
2025-08-19 22:34:07 -07:00
Krish Dholakia
bfe814f981
Merge pull request #13637 from Tasmay-Tibrewal/main
Added Qwen3, Deepseek R1 0528 Throughput, GLM 4.5 and GPT-OSS models for Together AI
2025-08-19 22:33:17 -07:00
Krish Dholakia
749bafc550
Merge pull request #13660 from BerriAI/litellm_azure_gpt-t
[LLM Translation] Adjust max_input_tokens for azure/gpt-5-chat models in JSON configuration
2025-08-19 22:32:56 -07:00
Krish Dholakia
04feaf33c0
Merge pull request #13748 from hakasecurity/migrate-to-aim-new-firewall-api
Migrate to aim new firewall api
2025-08-19 22:32:22 -07:00
Krish Dholakia
be30bc68ae
Merge pull request #13759 from kankute-sameer/litellm_feat_correct_cost_calculations
Add long context support for claude-4-sonnet
2025-08-19 22:30:25 -07:00
Krrish Dholakia
7d09375d52 fix: fix gpt-5-chat mappings 2025-08-19 22:21:00 -07:00
Ishaan Jaff
1832c09d6b
[Feat] - UI Allow using Key/Team Based Logging for Langfuse OTEL (#13791)
* add langfuse_otel

* ui allow setting langfuse OTEL

* fixes - using langfuse OTEL

* add description for logging integrations

* add description
2025-08-19 19:06:26 -07:00
Ishaan Jaff
a328ad56e3
[Bug Fix] Fixes for using Auto Router with LiteLLM Docker Image (#13788)
* fix install auto router.sh

* fixes for Docker IMG
2025-08-19 18:36:30 -07:00
Ishaan Jaff
56ac778316
[Bug Fix] Bedrock KB - Using LiteLLM Managed Credentials for Query (#13787)
* fix: add get_credentials_for_vector_store

* test_search_uses_registry_credentials

* test_bedrock_search_with_credentials_managed_registry
2025-08-19 15:39:36 -07:00
mubashir1osmani
ef9e50458d removed faq 2025-08-19 17:01:31 -04:00
tanjiro
b0e3469202
Models page row UI restructure (#13771)
* remove unused model dashboard

* move model_dashboard to templates folder

* moving  columns to molecules directory

* group model names and provider icon

* increase table column name font size. cleanup extra title and description inside the tab

* fix column width and truncate string

* moved credentials column

* combined created by and created at

* combine in and out costs

* remove edit button

* remove 2nd extra tooltip
2025-08-19 14:00:58 -07:00
Philip Kiely
b8167cf304 rip out some old stuff 2025-08-19 13:55:33 -07:00
mubashir1osmani
2edcc51e57 updated claude-code docs and deployment faq 2025-08-19 16:52:46 -04:00
Philip Kiely
6fd1705183 lint 2025-08-19 13:36:41 -07:00
Sameer Kankute
48622a4ee7 add cache above 200k keys in INTENDED_SCHEMA 2025-08-20 01:47:34 +05:30
Philip Kiely
7c3d522435 Update Baseten LiteLLM integration 2025-08-19 12:21:05 -07:00
Sameer Kankute
fa81b6c639
Update test_cost_calculator.py 2025-08-19 23:14:22 +05:30
Ishaan Jaff
195ea6515e
[Feat] Datadog LLM Observability - Add support for tracing guardrail input/output (#13767)
* add guardrail information on DD LLM Obs

* test_guardrail_information_in_metadata
2025-08-19 10:26:25 -07:00
Sameer Kankute
b5f0a7b49b
Merge branch 'main' into litellm_feat_correct_cost_calculations 2025-08-19 18:55:36 +05:30
Sameer Kankute
d39b2e8888 Add test for long context cost calculation 2025-08-19 16:56:13 +05:30
Sameer Kankute
4f38a63152 Add long context support for claude-4-sonnet 2025-08-19 16:40:12 +05:30
drorbaron
7fedcf1ea9 migrate stream ws 2025-08-19 12:36:29 +03:00
drorbaron
6b78ade918 migrate to use new aim FW API 2025-08-19 12:20:19 +03:00