Commit graph

29199 commits

Author SHA1 Message Date
TomeHirata
3f9ab84a7d Reapply "Add supported text field to anthropic citation response" 2025-09-02 14:36:55 +09:00
Ishaan Jaff
5ab3d74371 DEFAULT_NUM_WORKERS_LITELLM_PROXY 2025-09-01 20:34:23 -07:00
Ishaan Jaff
20811372d8 Revert "Merge pull request #14126 from TomeHirata/citation-supported-text-2"
This reverts commit 3f2881cd6d, reversing
changes made to 04f9ff16c4.
2025-09-01 20:24:14 -07:00
Ishaan Jaff
62f14dece3 fix: regression added from prometheus_missing_metrics 2025-09-01 20:21:09 -07:00
Ishaan Jaff
d37be48a80 test: llama-3.3-70b-versatile 2025-09-01 20:14:12 -07:00
Ishaan Jaff
94cac6fff2 fix: groq health check 2025-09-01 20:08:36 -07:00
Krrish Dholakia
ff955c73a8 refactor: remove db credential comment 2025-09-01 19:54:47 -07:00
Krrish Dholakia
271a14d3d1 test: remove hardcoded api base 2025-09-01 19:54:08 -07:00
Krrish Dholakia
3b78b51c08 fix(internal_user_endpoints.py): ensure only proxy admin can update values for other users
prevents proxy_admin_viewer from updating other user passwords
2025-09-01 19:48:29 -07:00
Krish Dholakia
3f2881cd6d
Merge pull request #14126 from TomeHirata/citation-supported-text-2
Add supported text field to anthropic citation response
2025-09-01 19:22:52 -07:00
retanoj
b1686ecbe5 format 2025-09-02 09:59:31 +08:00
Krish Dholakia
04f9ff16c4
Merge pull request #14139 from mubashir1osmani/prometheus_missing_metrics
Prometheus missing metrics
2025-09-01 18:55:24 -07:00
Krish Dholakia
67450feb79
Merge pull request #14146 from ProjectAlita/gpt_5_unsupported_params
GPT-5: Drop unsupported params
2025-09-01 18:54:49 -07:00
retanoj
3b524ba5f1 format 2025-09-02 09:52:50 +08:00
Krrish Dholakia
aa0127a9d4 bump: version 1.76.1 → 1.77.0 2025-09-01 18:52:45 -07:00
Krrish Dholakia
6a2da54fa8 test: update tests 2025-09-01 18:51:05 -07:00
Krrish Dholakia
d4cc748b40 feat(openrouter.py): add image generation via google on openrouter support
Closes https://github.com/BerriAI/litellm/pull/14151
2025-09-01 18:39:41 -07:00
Krrish Dholakia
4b8f2dc051 test: update tests 2025-09-01 18:20:46 -07:00
Krrish Dholakia
ee7181150c docs(gemini_img_migration.md): update docs for new images param 2025-09-01 18:17:30 -07:00
Krrish Dholakia
ffd1f0f04b refactor: update streaming image attr 2025-09-01 18:15:29 -07:00
Krrish Dholakia
2fd2310b8e refactor: update Delta 2025-09-01 18:13:31 -07:00
Krrish Dholakia
0fbcc01173 feat(types/utils.py): support 'images' field in output
Compatible with Openrouter response format

 Closes https://github.com/BerriAI/litellm/pull/14151
2025-09-01 18:05:16 -07:00
Ishaan Jaff
8e72f991cc test_model_alias_map 2025-09-01 17:59:40 -07:00
Krrish Dholakia
f1f9f2a594 fix: fix linting error 2025-09-01 17:52:22 -07:00
Krrish Dholakia
5d6532419f refactor: remove unused function 2025-09-01 17:46:38 -07:00
Krrish Dholakia
c54c41f726 fix: fix ruff errors 2025-09-01 17:38:39 -07:00
Krrish Dholakia
4a422ca897 fix: support logging dynamic metadata values to braintrust 2025-09-01 17:38:15 -07:00
Ishaan Jaff
e17bed715e DEFAULT_NUM_WORKERS_LITELLM_PROXY 2025-09-01 17:08:03 -07:00
Ishaan Jaff
4c7b3e10ed
[Bug Fix] Gemini Tool Calling - fix gemini empty enum property (#14155)
* fix: _convert_schema_types

* fix recursive detector

* test_convert_schema_types_type_array_conversion

* fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY

* add _fix_enum_empty_strings

* test_tool_call_with_empty_enum_property

* test_fix_enum_empty_strings

* fix _fix_enum_empty_strings
2025-09-01 17:05:01 -07:00
Ishaan Jaff
7656cb3d6e test fix 2025-09-01 17:04:47 -07:00
Ishaan Jaff
2331fb45d5
[Bug]: Gemini 2.5 Pro – schema validation fails with OpenAI-style type arrays in tools (#14154)
* fix: _convert_schema_types

* fix recursive detector

* test_convert_schema_types_type_array_conversion

* fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY
2025-09-01 16:53:20 -07:00
Byron Grogan
736bee813e fix: Support AWS_BEDROCK_RUNTIME_ENDPOINT on bedrock passthrough, make work for URLs with a base path 2025-09-01 17:47:26 -06:00
Ishaan Jaff
98d57b5d27
[Feat] Allow using x-litellm-stream-timeout header for stream timeout in requests (#14147)
* fix: allow passing stream_timeout header

* fix: _get_stream_timeout_from_request

* test_add_litellm_data_to_request_with_stream_timeout_header

* docs: LiteLLM Headers

* test_add_litellm_data_to_request_with_stream_timeout_header
2025-09-01 15:59:14 -07:00
Mubashir Osmani
58ac3ecf84
openrouter: added gpt 4.1 model family (#14101) 2025-09-01 15:36:17 -07:00
Ishaan Jaff
58b713d19d
[Bug fix] Misclassified 500 error on invalid image_url in /chat/completions request (#14149)
* add ImageFetchError

* docs ImageFetchError

* fix ImageFetchError

* test_completion_with_invalid_image_url
2025-09-01 15:26:27 -07:00
Ishaan Jaff
2985915357
[Perf] LiteLLM Proxy: +400 RPS when using correct amount of CPU cores (#14153)
* bump: DEFAULT_NUM_WORKERS_LITELLM_PROXY

* fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY
2025-09-01 15:26:16 -07:00
Krish Dholakia
9e947fce19
Merge pull request #14087 from zainhas/main
update together models
2025-09-01 15:07:58 -07:00
Abhinav
b6c26c3365
helm(chart): add optional PodDisruptionBudget for litellm proxy (#14062) (#14093) 2025-09-01 12:21:44 -07:00
Krish Dholakia
a6f8808b0b
Merge pull request #14134 from BerriAI/back-to-logs
Back to Keys should say Back to Logs
2025-09-01 12:01:47 -07:00
Sameer Kankute
c51665ec9c
fix xai cost calculation (#14127) 2025-09-01 11:31:56 -07:00
tanjiro
735af5bf36
success tooltip added (#14132) 2025-09-01 11:08:58 -07:00
tanjiro
ca70b689af
Logs page screen size fixed (#14135)
* width fixed

* tailwind css instead of inline css

* minor width fixes

* time button fixed

* fixed width for the "showing..." part
2025-09-01 11:08:09 -07:00
Ivan Krakhmaliuk
76dd9d8110 GPT-5: Test for unsupported params 2025-09-01 20:30:43 +03:00
Ivan Krakhmaliuk
2622a0634a
GPT-5: Remove params unsupported with reasoning models 2025-09-01 19:51:54 +03:00
mubashir1osmani
2626123aca added litellm_spend_metric 2025-09-01 11:33:34 -04:00
mubashir1osmani
5649c0f0b9 Revert "feat: add persistence and management for guardrails on virtual keys"
This reverts commit 6cd5afa8b1.
2025-09-01 10:45:46 -04:00
mubashir1osmani
a6790ac158 Revert "feat: add UI support for displaying and managing guardrails on virtual keys"
This reverts commit 83654c5608.
2025-09-01 10:45:44 -04:00
mubashir1osmani
31cfe1fe0a Revert "fix: import verbose_proxy_logger to resolve undefined name errors"
This reverts commit a8f2ebed9c.
2025-09-01 10:45:38 -04:00
mubashir1osmani
8de65e8448 fix: added prometheus missing metrics 2025-09-01 10:36:51 -04:00
mubashir1osmani
af2f447698 added prometheus metrics 2025-09-01 10:28:48 -04:00