Ishaan Jaffer
8d5e378348
test fix
2025-09-18 10:21:55 -07:00
Ishaan Jaffer
182bea296f
fix test
2025-09-18 10:18:12 -07:00
Ishaan Jaffer
076d129953
fix: test_completion_with_no_model
2025-09-18 10:16:44 -07:00
Ishaan Jaffer
d1b9611c97
fix: test_completion_with_no_model
2025-09-18 10:13:58 -07:00
Ishaan Jaffer
1615b1a62a
fix: cohere generate api is deprecated
2025-09-18 07:41:43 -07:00
Ishaan Jaffer
87e6a007b4
fix: cohere generate api is deprecated
2025-09-18 07:29:39 -07:00
Ishaan Jaff
6e7188fdfb
fix: cohere generate api is deprecated ( #14676 )
2025-09-18 07:28:15 -07:00
Tim Elfrink
61cd12009a
Fix: Vertex AI Gemini labels field provider-aware filtering ( #14563 )
...
* Add comprehensive tests for Vertex AI Gemini labels provider filtering
- Test Google GenAI endpoints exclude labels even when explicitly provided
- Test Vertex AI endpoints include labels when provided
- Cover provider detection logic for different endpoint URLs
- Verify metadata-to-labels conversion only happens for Vertex AI
- Ensure edge cases are handled properly (null/empty api_base)
* Fix Vertex AI Gemini labels field provider-aware filtering
- Add _is_google_genai_endpoint() function to detect Google GenAI vs Vertex AI endpoints
- Update _transform_request_body() to accept api_base parameter
- Only include labels field for Vertex AI endpoints (not Google GenAI)
- Pass api_base through sync/async transform functions
- Maintain backward compatibility with existing usage
- Fixes issue where Google GenAI requests failed with unsupported labels field
* Refactor labels filtering to use custom_llm_provider instead of URL parsing
Replace URL-based endpoint detection with custom_llm_provider parameter
checking for cleaner, more reliable provider identification.
Changes:
- Remove _is_google_genai_endpoint() helper function
- Update labels condition to use custom_llm_provider != "gemini"
- Remove api_base parameter from _transform_request_body()
- Simplify sync/async transform function signatures
- Update tests to reflect new parameter structure
- Remove obsolete test_provider_detection test
This approach aligns with existing codebase patterns where
custom_llm_provider="gemini" identifies Google AI Studio endpoints
that don't support labels, while vertex_ai/vertex_ai_beta identify
Vertex AI endpoints that do support labels.
* Use LlmProviders.GEMINI constant instead of hardcoded string
2025-09-18 07:22:27 -07:00
Krish Dholakia
2338dd952e
Merge pull request #14546 from BerriAI/filter-on-logs-bug
...
The 'last 24 hours' button shows up above the end user dropdown on Logs page
2025-09-13 23:12:39 -07:00
Krish Dholakia
1622d03ecc
Merge pull request #14545 from BerriAI/litellm_ui_qa_09_13_2025_p1
...
Litellm UI qa 09 13 2025 p1 - fix end user filtering + fix load mcp tool call error + prevent setting max user budget on scroll in edit user settings
2025-09-13 18:48:43 -07:00
Krrish Dholakia
fe546b936a
fix(fetch_mcp_tools.tsx): fix load mcp tools
2025-09-13 18:42:42 -07:00
Ishaan Jaff
f37dd6bb95
Litellm 1.77.2 stable notes ( #14544 )
...
* fix release notes instructions
* docs v1
* fix doc
* fix highlights
* docs fix
* docs fix
2025-09-13 18:41:34 -07:00
Krrish Dholakia
84f934bf36
fix(user_edit_view.tsx): use shared component to prevent accidental setting of edit user budget
2025-09-13 18:20:07 -07:00
Krrish Dholakia
bb5e71447d
fix(spend_management_endpoints.py): add end user filtering
2025-09-13 18:15:34 -07:00
Boopesh Shanmugam
95da14cb96
Docs update on user header mapping ( #14527 )
2025-09-13 16:58:10 -07:00
Ishaan Jaff
6172145014
fix: org budget update fix ( #14541 )
2025-09-13 16:34:26 -07:00
Krrish Dholakia
b6bca6369f
fix(constants.py): make default num workers 1
2025-09-13 13:57:58 -07:00
Ishaan Jaff
9110af37d0
bump: version 1.77.1 → 1.77.2
2025-09-13 13:55:30 -07:00
Krrish Dholakia
dc4b09e26e
build(ui/): new ui build
2025-09-13 13:48:27 -07:00
Krish Dholakia
6efc898407
Merge pull request #14523 from BerriAI/litellm_dev_09_12_2025_p1
...
VLLM - transcription endpoint support + Ollama_chat/ - images, thinking, and content as list handling +
2025-09-13 13:39:28 -07:00
Ishaan Jaff
6c27e5ce43
fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY
2025-09-13 12:11:33 -07:00
Ishaan Jaff
252ec8e1ae
test_normal_router_call_tpm_v3
2025-09-13 12:04:56 -07:00
Alexsander Hamir
44d209622b
fix: remove dynamic creation of static value ( #14538 )
2025-09-13 11:58:38 -07:00
Krrish Dholakia
8443000ca4
fix(main.py): route vllm calls via the openai sdk route
...
consistent with other openai-like implementations
2025-09-13 11:49:05 -07:00
Ishaan Jaff
26dafdc493
test fix: note this does not play nice with circleCI, it passes on local
2025-09-13 11:37:19 -07:00
Ishaan Jaff
ea280e1a6e
_transform_messages: google ai studio
2025-09-13 11:31:19 -07:00
dependabot[bot]
d89c7f0eb7
build(deps): bump hono from 4.6.5 to 4.9.7 in /litellm-js/spend-logs ( #14513 )
...
Bumps [hono](https://github.com/honojs/hono ) from 4.6.5 to 4.9.7.
- [Release notes](https://github.com/honojs/hono/releases )
- [Commits](https://github.com/honojs/hono/compare/v4.6.5...v4.9.7 )
---
updated-dependencies:
- dependency-name: hono
dependency-version: 4.9.7
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-09-13 11:10:37 -07:00
Krrish Dholakia
a8e2d24d3a
fix: fix import
2025-09-13 10:12:32 -07:00
Krish Dholakia
269515e525
Merge branch 'main' into litellm_dev_09_12_2025_p1
2025-09-13 10:10:30 -07:00
Ishaan Jaff
ec32a0a7d7
fix: get_base_completion_call_args
2025-09-13 09:59:08 -07:00
Krrish Dholakia
9ee9745781
docs(vllm.md): document new endpoint
2025-09-13 09:46:39 -07:00
Ishaan Jaff
69e451458c
test_logging_opentelemetry_context_propagation
2025-09-13 09:44:36 -07:00
Krish Dholakia
38efd358eb
Merge pull request #14401 from Noma-Security/noma_non_blocking_monitor_mode
...
Noma non blocking monitor mode & anonymize input support
2025-09-13 09:41:41 -07:00
Krish Dholakia
550feffeb9
Merge pull request #14512 from timelfrink/fix/lm-studio-bearer-header-14502
...
fix(lm_studio): resolve illegal Bearer header value issue
2025-09-13 09:40:30 -07:00
Krish Dholakia
a6ba744085
Merge pull request #14529 from BerriAI/litellm_contributor_prs_09_12_2025_p1
...
Fixed Log Tab Key Alias
2025-09-13 09:39:28 -07:00
Krish Dholakia
ad9515a81e
Merge branch 'main' into litellm_contributor_prs_09_12_2025_p1
2025-09-13 09:38:43 -07:00
Krish Dholakia
de8cf40ffa
Merge pull request #14482 from BerriAI/litellm_dev_09_11_2025_p3
...
Feature - new `litellm_request_debug=true` flag, enables emitting raw request/response log on single request
2025-09-12 19:56:53 -07:00
Krish Dholakia
663dbc6080
Merge pull request #14477 from BerriAI/litellm_dev_09_11_2025_p2
...
`/v1/messages` - don't send content block after message w/ finish reason + usage block + `/key/unblock` - support hashed tokens
2025-09-12 19:51:44 -07:00
Ishaan Jaff
8b3b943557
docs fix
2025-09-12 19:51:14 -07:00
Krish Dholakia
e254d9013b
Merge pull request #14469 from sashank5644/litellm_log_key_alias_filtering
...
Fixed Log Tab Key Alias filtering inaccurately for failed logs
2025-09-12 19:46:17 -07:00
Krrish Dholakia
05e3e3685b
docs(forward_client_headers.md): document new forwarding client headers to llm api feature
2025-09-12 19:38:07 -07:00
Ishaan Jaff
93af8fd6ba
[QA] E2E - Testing for bedrock batches api ( #14525 )
...
* add bedrock/batch-anthropic.claude-3-5-sonnet-20240620-v1:0
* test_bedrock_batches_api
* fix
* fix import
* test_bedrock_batches_api
2025-09-12 19:31:19 -07:00
Ishaan Jaff
93d6e9bf49
pip install "google-genai==1.22.0"
2025-09-12 19:30:47 -07:00
Ishaan Jaff
20c390dc71
[Docs] - Bedrock Batches API ( #14526 )
...
* docs bedrock batch
* docs fix
* docs bedrock batches
* fix Create Batch Request
* docs fix
2025-09-12 19:08:13 -07:00
Krrish Dholakia
6596c24d5c
fix(litellm_pre_call_utils.py): add wildcard model support for forwardable model group headers
2025-09-12 18:45:24 -07:00
Ishaan Jaff
075a089d82
[Feat] Bedrock Batches - Ensure correct transformation applied to incoming requests ( #14522 )
...
* use is_batch_jsonl_file
* fix valid_content_type
* fix transform_create_file_request
* fix _transform_openai_jsonl_content_to_bedrock_jsonl_content
* test_transform_openai_jsonl_content_to_bedrock_jsonl_content
* fix mypy linting errors
* fix BEDROCK_BATCH_MODEL
* fix working sample
* fix comment
* fix model list
* fix: use with managed batches
* refactor
2025-09-12 18:32:57 -07:00
Krrish Dholakia
7a5e5a12da
fix: fix linting errors
2025-09-12 18:03:50 -07:00
Krrish Dholakia
bdd960c451
docs(admin_ui_sso.md): clarify sso usage on docs
2025-09-12 18:03:03 -07:00
Krrish Dholakia
8ec02a5bdc
test: add unit tests for ollama chat request transformation
2025-09-12 17:59:59 -07:00
Krrish Dholakia
461e181450
fix(ollama/chat): support images
...
Fixes https://github.com/BerriAI/litellm/issues/14217
2025-09-12 17:49:42 -07:00
