Commit graph

27315 commits

Author SHA1 Message Date
Krish Dholakia
6b3db2fd49
Merge pull request #15140 from niharm/fix-sonnet-4-5-200k-pricing
Price Fix: Add 200K prices for Sonnet 4.5
2025-10-02 17:28:47 -07:00
DrQuacks
d303bf6743 port less than 1 cent to spend column 2025-10-02 16:55:36 -07:00
DrQuacks
8760276918 dropdown for more than two tags 2025-10-02 16:45:36 -07:00
DrQuacks
a91a7e7750 added testing file for api keys dashboard 2025-10-02 16:17:02 -07:00
DrQuacks
4d340fa48f spend data in tags tooltip 2025-10-02 15:34:09 -07:00
Georg Wölflein
dbfa8ec921
Fix end user cost tracking in the responses API (#15124)
#13860
2025-10-02 15:13:57 -07:00
Ishaan Jaff
f8f4207994
[Security Fix] fix: don't log JWT SSO token on .info() log (#15145)
* fix: get_redirect_response_from_openid

* fix info log check

* fix: forward_upstream_to_client
2025-10-02 15:07:37 -07:00
Jack Venberg
560e96570e Fix: Session Token Cookie Infinite Logout Loop 2025-10-02 15:02:07 -07:00
Amir Refaee
8991657d67
added railtracks to projects using litellm (#15144) 2025-10-02 14:21:38 -07:00
Mubashir Osmani
f2107a189d
add azure_ai grok-4 model family (#15137)
* added oauth mcp to docs

* added azure ai/grok-4 model family

* Revert "added oauth mcp to docs"

This reverts commit 950b7cef44.
2025-10-02 14:21:12 -07:00
DrQuacks
7c5f789b67 styling tags, only showing tag column on tags tab 2025-10-02 13:49:01 -07:00
nihar
cd7acd2eb2 Add 200K prices for Sonnet 4.5 2025-10-02 12:39:44 -07:00
DrQuacks
fec3b55313 bringing tags into api top api keys table 2025-10-02 12:37:07 -07:00
Krrish Dholakia
ebba9e0b2a docs: cleanup docs 2025-10-02 09:51:16 -07:00
deepanshu
2512d89872 Add provider name to payload specification 2025-10-02 10:23:26 -04:00
Sameer Kankute
fb664b0f76 add other fields in cost calculations 2025-10-02 16:13:03 +05:30
Krish Dholakia
f6b67fd9bd
Merge pull request #14799 from tyler-liner/chore/generation-name-opentelemetry
fix (opentelemetry): use generation_name for span naming in logging method
2025-10-01 21:39:38 -07:00
Krish Dholakia
cb39a1bb60
Merge pull request #15024 from kowyo/main
docs: use docker compose instead of docker-compose
2025-10-01 21:34:42 -07:00
Krish Dholakia
93e347b3d8
Merge pull request #15106 from plafleur/ISSUE-15105
Guardrails - Don't run post_call guardrail if no text returned from Bedrock
2025-10-01 21:29:14 -07:00
Krrish Dholakia
83facb761f fix: fix placement 2025-10-01 18:57:27 -07:00
Krrish Dholakia
6589c924c8 fix: add linting 2025-10-01 18:54:50 -07:00
Krrish Dholakia
34366d8fe2 docs(key_management_endpoints.py): document new fields 2025-10-01 18:50:22 -07:00
Krrish Dholakia
32036e2093 feat(ui/): add common rate limit type form, for reuse for tpm/rpm across create + edit key 2025-10-01 18:46:43 -07:00
Ishaan Jaff
d538cf489a
[Feat] Fixes to dynamic rate limiter v3 - add saturatation detection (#15119)
* test cases dynamic rate limits

* fix _handle_generous_mode

* docs add readme

* use configs for vars

* fix debug

* add comment

* test_dynamic_rate_limiter_v3.py

* test_concurrent_pre_call_hooks_stress
2025-10-01 18:35:34 -07:00
Krrish Dholakia
20b6f011f7 fix(create_key_button.tsx): working ui controls to set guaranteed throughput/best effort throughput on key 2025-10-01 18:34:29 -07:00
Ishaan Jaffer
2bc5d93f23 use_callback_in_llm_call 2025-10-01 18:32:37 -07:00
Krrish Dholakia
ff866aae7b feat(create_key_button.tsx): add tpm/rpm rate limit type options to UI
allows user to set the type of tpm/rpm limit they're trying to set
2025-10-01 18:30:34 -07:00
Deepanshu Lulla
68adca04c8
Gitlab based Prompt manager (#14988)
* add prompt

* add prompt

* add prompt

* add prompt

* add prompt management via gitlab

* gitlab client

* gitlab client

* gitlab client

* fix lint issues

* fix lint issues

* remove router changes

---------

Co-authored-by: deepanshu <deepanshu.lulla@hq.bill.com>
2025-10-01 18:13:11 -07:00
Krrish Dholakia
d8e3a62fbe feat(key_management_endpoints.py): add support for guaranteed throughput on key update and service account key creation 2025-10-01 17:58:31 -07:00
Krrish Dholakia
757436f302 test: add unit test 2025-10-01 17:51:10 -07:00
Krrish Dholakia
3ce074564e feat(key_management_endpoints.py): add guaranteed throughput support for model specific tpm / rpm limits
prevents admin from granting keys more tpm/rpm than created for a key
2025-10-01 17:48:23 -07:00
Krrish Dholakia
a83238a2db test: add unit tests 2025-10-01 17:02:05 -07:00
Krrish Dholakia
005aec69c7 feat(key_management_endpoints.py): allow specifying rate limit type when creating tpm/rpm limits on keys
prevents overallocating tpm/rpm limits
2025-10-01 16:57:07 -07:00
Ishaan Jaff
388761f52d
[Fix] LiteLLM UI - Ensure OTEL settings are saved in DB after set on UI (#15118)
* fix: fix _add_callback_from_db_to_in_memory_litellm_callbacks

* test_add_callback_from_db_to_in_memory_litellm_callbacks

* fix otel

* fix: fix _add_callback_from_db_to_in_memory_litellm_callbacks
2025-10-01 15:33:22 -07:00
Ishaan Jaff
d9664a3ee4
fix gpt-5-chat-latest on model cost map (#15116) 2025-10-01 14:35:57 -07:00
Ishaan Jaff
e73d053de3
[Fix] Proxy Auth - Ensure LLM_API_KEYs can access pass through routes (#15115)
* test_virtual_key_llm_api_routes_allows_registered_pass_through_endpoints

* fix: is_registered_pass_through_route

* docs fix
2025-10-01 14:09:01 -07:00
Patrick Lafleur
8e5efd29df
Fix comment 2025-10-01 16:39:26 -04:00
Patrick Lafleur
d6be26dba6
Merge branch 'main' into ISSUE-15105 2025-10-01 14:44:40 -04:00
Luiz Rennó Costa
7e56600896
fix: model_group not always present in litellm_params, and metadata reference location (#15108)
Co-authored-by: Luiz Rennó Costa <luiz.renno@ifood.com.br>
2025-10-01 11:39:49 -07:00
Patrick Lafleur
e7fd1fb96b
Fix missing HTTPException import (#15111) 2025-10-01 11:39:30 -07:00
Sameer Kankute
56e429e33d refactor code for better handling cost 2025-10-01 23:38:53 +05:30
Patrick Lafleur
7ef71d4885
Fix text 2025-10-01 12:08:03 -04:00
Sameer Kankute
7ec7e5332c
Add generateContent cost tracking (#15014) 2025-10-01 09:03:45 -07:00
Patrick Lafleur
3e5d585f7d
Don't run post_call guardrail if no text returned from bedrock 2025-10-01 11:56:50 -04:00
Ishaan Jaffer
ab00ca2de9 bump: version 1.77.6 → 1.77.7 2025-10-01 08:54:03 -07:00
Sameer Kankute
c32f42098c Add cost tracking for /v1/messages 2025-10-01 19:57:16 +05:30
João Speglich
933b3979eb docs: update oci docs with oci_serving_mode 2025-10-01 10:45:50 -03:00
shagunb-acn
0c17689440
Merge branch 'BerriAI:main' into bugfix-14404-image-gen-azure-managed-identity 2025-10-01 09:58:13 +05:30
Krrish Dholakia
7fd24a2632 bump: version 1.77.6 → 1.77.7 2025-09-30 21:23:42 -07:00
Krrish Dholakia
a1a0e99638 fix(prometheus.py): working e2e calls w/ userapikeymetadata 2025-09-30 21:23:25 -07:00