Tim Elfrink
30c3e7b3d3
Fix: Bedrock cross-region inference profile cost calculation ( #14566 )
...
* Add tests for Bedrock cross-region inference profile mapping
- Test model mapping lookup works correctly
- Test proxy cost calculation scenario reproduces original issue
- Verify cost calculation returns expected values
- Ensure compatibility with existing test patterns
* Fix Bedrock cross-region inference profile cost calculation
- Add mapping for bedrock/us.anthropic.claude-3-5-haiku-20241022-v1:0
- Sync backup file for local testing consistency
- Resolve proxy spend tracking failures for cross-region profiles
- Maintain identical configuration with standalone profile
Fixes #14458
2025-09-15 07:10:20 -07:00
Sameer Kankute
110ce543c2
[Feat]Add cancel endpoint support for openai and azure ( #14561 )
...
* Add cancel endpoint support for openai
and azure
* fix lint error
* fix cancel url contruction azure
* readd changes
2025-09-15 07:08:56 -07:00
Sameer Kankute
7fd6e62570
Fix unsupported stop param for grok-code models ( #14565 )
2025-09-15 07:00:54 -07:00
LingXuanYin
df5db48c3c
fix bug
2025-09-15 17:20:30 +08:00
LingXuanYin
c9e1088fda
update docs
2025-09-15 16:17:09 +08:00
LingXuanYin
3bbe09ceb9
update test volcengine
2025-09-15 14:03:15 +08:00
LingXuanYin
bf7868bb0e
fix volcengine thinking parameters missing if set disable
...
update test volcengine
2025-09-15 13:15:05 +08:00
soojin
1585f5b920
fix: add exception handling for logger retrieval in cold storage object key generation
...
- Wrap get_active_custom_logger_for_callback_name call in try-except block
- Gracefully handle cases where logger instance cannot be retrieved
- Fall back to empty s3_path when logger lookup fails
- Prevents crashes when cold storage logger is misconfigured or unavailable
2025-09-15 09:12:27 +09:00
iabhi4
4ba3a21042
fix(proxy): Correctly parse multi-part MCP server aliases from URL paths
2025-09-14 15:17:08 -07:00
Tim Elfrink
9521414efa
Resolve merge conflict by including both CompactifAI and OVHCloud providers
...
- Keep CompactifAI provider detection logic
- Include new OVHCloud provider from main branch
- Both providers now work correctly with model prefix detection
2025-09-14 23:03:18 +02:00
Tim Elfrink
6ac37093e5
Update CompactifAI model references and move tests to unit test directory
...
- Update all model references from llama-2-7b-compressed to cai-llama-3-1-8b-slim
- Move CompactifAI tests from tests/llm_translation to tests/test_litellm/llms/compactifai/
- Update documentation examples to use the new model name
- Remove integration test inheritance to make tests pure mock tests
This addresses review feedback to use mock tests and updated model naming.
2025-09-14 23:00:27 +02:00
iabhi4
dc27bccb45
feat(proxy): Assign default budget to auto-generated JWT teams
2025-09-14 12:04:43 -07:00
mubashir1osmani
e123cae06e
fix: lint errors
2025-09-14 14:55:47 -04:00
mubashir1osmani
e694cc102a
feat: Add Spend metrics in datadog
2025-09-14 14:42:26 -04:00
Krrish Dholakia
03f2be1e20
fix: fix race conditions
2025-09-14 09:41:04 -07:00
Krrish Dholakia
2c6481fa33
fix: remove incorrect test
2025-09-14 09:34:31 -07:00
Krrish Dholakia
fc2d1f2646
fix: fix import errors
2025-09-14 09:32:21 -07:00
Krish Dholakia
510332b886
Merge pull request #14491 from Rasmusafj/main
...
Resolve cache key collision issue where all soft budget alerts use identical cache keys
2025-09-14 00:51:27 -07:00
Krish Dholakia
56fd60b140
Merge pull request #14494 from eliasto/feat/ovhcloud-ai-edpoints-provider
...
feat: Add OVHCloud AI Endpoints as a provider
2025-09-14 00:45:08 -07:00
Krish Dholakia
37aa8fff5e
Merge pull request #14548 from nearai-cloud/fix/completion-chat-id
...
fix: completion chat id
2025-09-14 00:42:04 -07:00
Krrish Dholakia
7ef8c808cf
docs: update doc
2025-09-14 00:28:11 -07:00
Krish Dholakia
db644b6edd
Merge pull request #14500 from luisfucros/feat/update-sambanova-models
...
Add sambanova deepseek v3.1 and gpt-oss-120b models
2025-09-13 23:38:20 -07:00
Krish Dholakia
11822e63f1
Merge pull request #14519 from uc4w6c/feat/add_tools_permission_guardrail
...
feat: add tool-permission guardrail
2025-09-13 23:22:31 -07:00
Coffee
ac0386ae1f
fix: completion chat id
2025-09-14 14:21:57 +08:00
Krish Dholakia
dc4bbba0a5
Merge pull request #14520 from boopesh07/email_prometheus
...
Added user_email labels to the prometheus monitoring.
2025-09-13 23:19:46 -07:00
Krish Dholakia
2ec4b2953c
Merge pull request #14531 from mubashir1osmani/main
...
fix: DD tool calls passed in metadata
2025-09-13 23:16:15 -07:00
Krish Dholakia
2338dd952e
Merge pull request #14546 from BerriAI/filter-on-logs-bug
...
The 'last 24 hours' button shows up above the end user dropdown on Logs page
2025-09-13 23:12:39 -07:00
Krish Dholakia
1622d03ecc
Merge pull request #14545 from BerriAI/litellm_ui_qa_09_13_2025_p1
...
Litellm UI qa 09 13 2025 p1 - fix end user filtering + fix load mcp tool call error + prevent setting max user budget on scroll in edit user settings
2025-09-13 18:48:43 -07:00
Krrish Dholakia
fe546b936a
fix(fetch_mcp_tools.tsx): fix load mcp tools
2025-09-13 18:42:42 -07:00
Ishaan Jaff
f37dd6bb95
Litellm 1.77.2 stable notes ( #14544 )
...
* fix release notes instructions
* docs v1
* fix doc
* fix highlights
* docs fix
* docs fix
2025-09-13 18:41:34 -07:00
Krrish Dholakia
84f934bf36
fix(user_edit_view.tsx): use shared component to prevent accidental setting of edit user budget
2025-09-13 18:20:07 -07:00
Krrish Dholakia
bb5e71447d
fix(spend_management_endpoints.py): add end user filtering
2025-09-13 18:15:34 -07:00
Yuta Saito
0c1abf1a55
fix: recompute filters after deleting an MCP Server
2025-09-14 09:19:23 +09:00
Boopesh Shanmugam
95da14cb96
Docs update on user header mapping ( #14527 )
2025-09-13 16:58:10 -07:00
Ishaan Jaff
6172145014
fix: org budget update fix ( #14541 )
2025-09-13 16:34:26 -07:00
Krrish Dholakia
b6bca6369f
fix(constants.py): make default num workers 1
2025-09-13 13:57:58 -07:00
Ishaan Jaff
9110af37d0
bump: version 1.77.1 → 1.77.2
2025-09-13 13:55:30 -07:00
Krrish Dholakia
dc4b09e26e
build(ui/): new ui build
2025-09-13 13:48:27 -07:00
Krish Dholakia
6efc898407
Merge pull request #14523 from BerriAI/litellm_dev_09_12_2025_p1
...
VLLM - transcription endpoint support + Ollama_chat/ - images, thinking, and content as list handling +
2025-09-13 13:39:28 -07:00
Ishaan Jaff
6c27e5ce43
fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY
2025-09-13 12:11:33 -07:00
Ishaan Jaff
252ec8e1ae
test_normal_router_call_tpm_v3
2025-09-13 12:04:56 -07:00
Alexsander Hamir
44d209622b
fix: remove dynamic creation of static value ( #14538 )
2025-09-13 11:58:38 -07:00
Krrish Dholakia
8443000ca4
fix(main.py): route vllm calls via the openai sdk route
...
consistent with other openai-like implementations
2025-09-13 11:49:05 -07:00
Ishaan Jaff
26dafdc493
test fix: note this does not play nice with circleCI, it passes on local
2025-09-13 11:37:19 -07:00
Ishaan Jaff
ea280e1a6e
_transform_messages: google ai studio
2025-09-13 11:31:19 -07:00
dependabot[bot]
d89c7f0eb7
build(deps): bump hono from 4.6.5 to 4.9.7 in /litellm-js/spend-logs ( #14513 )
...
Bumps [hono](https://github.com/honojs/hono ) from 4.6.5 to 4.9.7.
- [Release notes](https://github.com/honojs/hono/releases )
- [Commits](https://github.com/honojs/hono/compare/v4.6.5...v4.9.7 )
---
updated-dependencies:
- dependency-name: hono
dependency-version: 4.9.7
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-09-13 11:10:37 -07:00
Krrish Dholakia
a8e2d24d3a
fix: fix import
2025-09-13 10:12:32 -07:00
Krish Dholakia
269515e525
Merge branch 'main' into litellm_dev_09_12_2025_p1
2025-09-13 10:10:30 -07:00
Ishaan Jaff
ec32a0a7d7
fix: get_base_completion_call_args
2025-09-13 09:59:08 -07:00
Krrish Dholakia
9ee9745781
docs(vllm.md): document new endpoint
2025-09-13 09:46:39 -07:00
