Ishaan Jaffer
699072d302
Revert "fix: model_group not always present in litellm_params, and metadata reference location ( #15108 )"
...
This reverts commit 7e56600896
2025-10-04 12:48:07 -07:00
Ishaan Jaffer
07e1e0a7ca
bump proxy extras migration
2025-10-04 12:38:21 -07:00
Ishaan Jaffer
51457541b0
fix add allowed tools
2025-10-04 12:37:12 -07:00
Teddy Amkie
7a176804f3
Add sync models GitHub documentation with Loom video and cross-references ( #15191 )
...
- Add comprehensive sync_models_github.md with API endpoints and examples
- Include Loom video tutorial for Admin UI sync process
- Add cross-references from model_management.md, cost_tracking.md, and ui.md
- Provide both manual and automated sync options
- Include Python SDK usage examples
2025-10-04 12:32:01 -07:00
Sameer Kankute
8095de506a
Add streamGenerateContent cost tracking in passthrough ( #15199 )
...
* Add streamgenerate cost tracking for gemini provider
* add cost tracking test
2025-10-04 12:31:25 -07:00
Ishaan Jaffer
3d6342f852
test_twelvelabs_missing_input_type_error
2025-10-04 12:28:09 -07:00
Ishaan Jaffer
6c79e12367
fix schema
2025-10-04 12:26:36 -07:00
Ishaan Jaffer
be7ab0b3e3
test_gemini_url_context
2025-10-04 12:23:43 -07:00
=
06d50b55d7
fixes surrounding selection state on model info update
2025-10-04 12:13:18 -07:00
Krrish Dholakia
6745e9f3f5
fix(model_dashboard.tsx): fix query
2025-10-04 12:08:13 -07:00
Krrish Dholakia
c2eb4d7f4e
fix(networking.tsx): use more efficient query for getting list of users
2025-10-04 12:07:21 -07:00
Ishaan Jaffer
c38c5d20cc
test dynamic rate limiter 3
2025-10-04 12:06:13 -07:00
Krish Dholakia
79014a8522
Merge pull request #15184 from ARajan1084/edit-key-nonpremium-user-fix
...
fix: empty premium fields resulting in edit key blocking
2025-10-04 11:51:40 -07:00
Ishaan Jaffer
2dc11316f2
fix failing deepseek-ai/DeepSeek-V3.1
2025-10-04 11:50:30 -07:00
Ishaan Jaffer
cdfb53dd81
fix linting error
2025-10-04 11:40:47 -07:00
Krrish Dholakia
509927eec9
test: add vitest for clipboard http scenario
2025-10-04 11:34:12 -07:00
Krrish Dholakia
fff40e2ed6
fix(datautils.ts): fix clipboard copy issue on http endpoints
2025-10-04 11:29:15 -07:00
Ishaan Jaffer
7a41c09529
test bedrock embedding tests marengo
2025-10-04 11:27:29 -07:00
Ishaan Jaffer
44db58c8df
test_e2e_bedrock_async_invoke_embedding_async_twelvelabs_marengo
2025-10-04 11:13:39 -07:00
Ishaan Jaffer
e7b570000e
fix: azure passthrough test
2025-10-04 11:06:36 -07:00
Ishaan Jaffer
53503828b2
test fix
2025-10-04 10:57:02 -07:00
Ishaan Jaffer
6f298cf5f0
test_azure_openai_assistants_e2e_operations_stream
2025-10-04 10:53:46 -07:00
Ishaan Jaffer
4ab571f684
fix test /generateContent route
2025-10-04 10:49:46 -07:00
Ishaan Jaff
f78608082c
[Feat] Dynamic Rate Limiter v3 - fixes for detecting saturation + fixes for post saturation behavior ( #15192 )
...
* fix: test case 1, model hits saturation
* fix: _check_rate_limits test case 2
* fix: _get_priority_allocation
* test_default_priority_shared_pool
* fix: No Rate Limiting when low saturatation
* fix: correctly use model_saturation_check
* fixes priority_descriptors
* fix: tune default PriorityReservationSettings
2025-10-04 10:45:17 -07:00
Alexsander Hamir
29a31e17dd
[Doc] Perf: Last week improvement ( #15193 )
...
* doc: perf update
* fix: mixed up changes
* fix: add gist
2025-10-04 10:43:13 -07:00
Ishaan Jaffer
ee36c30217
fix LF tests
2025-10-04 10:39:17 -07:00
Ishaan Jaffer
00f44861ea
fix: gooogle GenAI route tests
2025-10-04 10:18:25 -07:00
Ishaan Jaffer
df9a19bc9d
fix OPENAI_EMBEDDING_PARAMS
2025-10-04 10:11:21 -07:00
Ishaan Jaffer
1655a9aea8
fix lf tests
2025-10-04 10:02:56 -07:00
Ishaan Jaffer
eb417ed774
fix lf logging
2025-10-04 10:00:10 -07:00
Ishaan Jaffer
27fbfbe259
fix: include_subpath
2025-10-04 09:47:16 -07:00
Ishaan Jaffer
212a2e13f3
OTEL fix spans
2025-10-04 09:22:57 -07:00
Ishaan Jaffer
a040e0154a
add openai
2025-10-04 09:19:00 -07:00
Ishaan Jaffer
4400a6c189
test bedrock guardrails
2025-10-04 09:18:26 -07:00
Alexsander Hamir
5d22229d35
[Fix] Cache - Avoiding expensive operations when cache isn't available ( #15182 )
...
* Optimize cache performance by avoiding expensive operations when caching is disabled
- Moved cache availability checks before expensive operations to improve performance for non-cached requests
- Updated client code to handle None responses from caching handler
* clean hot path
* Fix TypeError with isinstance check for CustomStreamWrapper in caching
Fixed `TypeError: typing.Any cannot be used with isinstance()` that was
occurring in the caching handler when checking cached streaming responses.
The issue was caused by CustomStreamWrapper being aliased to `typing.Any`
at runtime through the TYPE_CHECKING conditional import pattern. When the
code attempted to use isinstance(cached_result, CustomStreamWrapper) at
lines 222 and 338, it failed because Python's isinstance() cannot be used
with typing.Any.
Solution: Import CustomStreamWrapper at runtime separately from the
TYPE_CHECKING block, while keeping a type alias for static type checking.
This allows isinstance checks to work properly while maintaining type hints.
* fix: remove unnecessary type checking
2025-10-04 09:10:37 -07:00
Ishaan Jaffer
d50fbcdc00
fix: include_cost_in_streaming_usage
2025-10-04 09:05:02 -07:00
Ishaan Jaffer
89934f062c
fix ruff check
2025-10-04 08:59:57 -07:00
Ishaan Jaffer
3d981680b0
fix ServerToolUse mypy lint error
2025-10-04 08:59:15 -07:00
Ishaan Jaffer
8e7c593f51
fix: transform_rerank_response
2025-10-04 08:55:48 -07:00
Krrish Dholakia
f5cda40bc6
feat: prisma migration
2025-10-04 08:53:08 -07:00
Ishaan Jaffer
67b0c874a3
ci/cd run again
2025-10-04 08:51:21 -07:00
Krish Dholakia
ad2270fe13
Merge pull request #14764 from daily-kim/litellm_fix_bearer_capitalization
...
Fix: Authorization header to use correct "Bearer" capitalization
2025-10-03 22:02:46 -07:00
Krish Dholakia
7d41f02d02
Merge pull request #14813 from shagunb-acn/bugfix-14404-image-gen-azure-managed-identity
...
#14404 BugFix - Add support for Azure AD token-based authorization in…
2025-10-03 21:53:59 -07:00
Krish Dholakia
c83a3ac9b4
Merge pull request #14939 from Toy-97/patch-1
...
update: DeepInfra model data refresh [2025-09-26]
2025-10-03 21:48:31 -07:00
Krish Dholakia
206f67a11e
Merge pull request #15183 from uc4w6c/fix/test_mcp_server
...
test: fix test_mcp_server.py
2025-10-03 21:44:52 -07:00
YutaSaito
81a8766b84
feat: add JP Cross-Region Inference ( #15188 )
2025-10-03 21:20:04 -07:00
Krrish Dholakia
39cac8e58a
build(ui/): show updated schema.prisma
2025-10-03 19:07:50 -07:00
Krrish Dholakia
aa1b690494
feat(ui/): allow user to edit allowed tools for an mcp server
2025-10-03 19:05:56 -07:00
=
aca8ae7962
fixes issue where empty premium fields were blocking key edit
2025-10-03 18:57:50 -07:00
Krrish Dholakia
6691d0bc85
feat(proxy/): add edit / view for extra headers on MCP servers
2025-10-03 18:57:27 -07:00
