eycjur
00b36554b3
add unit test
2025-09-23 01:57:50 +00:00
Krish Dholakia
0a1c1a27a7
Merge pull request #14787 from BerriAI/litellm_dev_09_22_2025_p1
...
docs(provider_specific_params.md): fix docs
2025-09-22 17:45:57 -07:00
Krrish Dholakia
70cd9d3d4e
test: fix unit test to work on github action
2025-09-22 17:38:11 -07:00
Anubhav Singh
fde4dcb0b8
Merge branch 'main' into wandb-inference
2025-09-23 00:14:11 +05:30
Fabrício Ceschin
c854e8a9d0
Merge branch 'BerriAI:main' into LangfuseUsageDetails
2025-09-22 13:21:35 -04:00
Ishaan Jaff
fa20abfe48
[Feat] Proxy CLI Auth - Allow re-using cli auth token ( #14780 )
...
* fix: cli auth with SSO okta
* fix: add LITTELM_CLI_SERVICE_ACCOUNT_NAME
* fix: get_litellm_cli_user_api_key_auth
* use existing_key CLI
* fix: use existing key
* test auth commands
* test_cli_sso_callback_regenerate_vs_create_flow
2025-09-22 10:07:16 -07:00
Otavio Brito
ffd9117357
fix failing test
2025-09-22 11:06:11 -03:00
Fabrício Ceschin
8e15cc18ff
Merge branch 'BerriAI:main' into LangfuseUsageDetails
2025-09-22 09:43:33 -04:00
Otavio Brito
33a11c4b07
fix vllm passthrough
2025-09-22 10:09:02 -03:00
Krish Dholakia
9096d9cb25
Merge branch 'main' into feat/issue-14562-bedrock-converse-request-metadata
2025-09-21 21:26:37 -07:00
Krish Dholakia
d4540d31c1
Merge branch 'main' into fix/streaming-tool-call-indices
2025-09-21 21:24:22 -07:00
Krish Dholakia
197e98b6fb
Merge pull request #14758 from TeddyAmkie/model-armor-restore
...
Resolve Model Armor gaps (Pdfs, basic
2025-09-21 21:18:53 -07:00
uzaxirr
d8d5581f29
Resolve merge conflicts with main branch
...
- Accept main branch's consolidation of Cohere providers
- Preserve header implementation with proper three-tier merging
- Replace outdated header handling in Cohere sections with consolidated approach
- Maintain backward compatibility and functionality
2025-09-22 05:59:28 +05:30
uzaxirr
50d717cde0
Apply Black formatting and fix Ruff issues
...
- Format code with Black to meet style requirements
- Fix auto-fixable Ruff linting issues
- Maintain header implementation functionality
2025-09-22 04:46:08 +05:30
daily-kim
62622ef4b2
fix: update authorization header to use 'Bearer' instead of 'bearer'
2025-09-21 10:44:47 +00:00
uzaxirr
3986b073c9
feat: Add SDK support for additional headers
2025-09-21 14:58:14 +05:30
Teddy Amkie
9d1878029d
Added model armor testing files basic
2025-09-20 22:40:46 -07:00
Ishaan Jaffer
8b3e3c1882
tes fix
2025-09-20 17:00:30 -07:00
Ishaan Jaffer
c656982f18
test fix
2025-09-20 16:55:23 -07:00
Ishaan Jaffer
d0dcf8c81c
test_rerank_custom_callbacks
2025-09-20 16:27:58 -07:00
Ishaan Jaffer
979ca9287b
test prometheus fix
2025-09-20 16:03:34 -07:00
Ishaan Jaffer
f1a18b69a4
test_aincrement_top_level_request_and_spend_metrics
2025-09-20 15:33:08 -07:00
Ishaan Jaffer
8ec73db36b
test fix
2025-09-20 15:32:59 -07:00
Ishaan Jaffer
6c966400dd
fix test
2025-09-20 15:03:35 -07:00
Ishaan Jaffer
d4a2a4a608
test fix
2025-09-20 14:10:40 -07:00
Ishaan Jaffer
18d5177aec
test fix
2025-09-20 14:09:24 -07:00
Ishaan Jaffer
59d2f0f465
test_string_cost_values
2025-09-20 13:34:57 -07:00
Ishaan Jaffer
4b876ea9ca
test_sanitize_request_body_for_spend_logs_payload_mixed_types
2025-09-20 12:33:37 -07:00
Ishaan Jaffer
aa992fb86f
test e2e bedrock embedding
2025-09-20 11:35:31 -07:00
Ishaan Jaffer
39cf690d50
test_e2e_bedrock_embedding_image_twelvelabs_marengodocs fix
2025-09-20 09:34:08 -07:00
Ishaan Jaffer
7236202e41
test fix
2025-09-20 09:28:15 -07:00
Krish Dholakia
1f9afcb349
Merge pull request #14438 from hakasecurity/change-aim-headers
...
rename aim headers + tests
2025-09-19 23:32:50 -07:00
Krish Dholakia
981e8470ef
Merge pull request #14578 from timelfrink/fix/issue-14373-bedrock-inference-profiles
...
Fix: Bedrock inference profiles for Nova Canvas image generation
2025-09-19 23:31:23 -07:00
Krish Dholakia
0f0f4327a3
Merge pull request #14589 from timelfrink/fix/issue-14586-gemini-exception-messages
...
Fix: Updated error message for Gemini API
2025-09-19 23:29:21 -07:00
Krish Dholakia
270d612029
Merge branch 'main' into litellm_dev_09_10_2025_p1
2025-09-19 22:01:57 -07:00
Ishaan Jaffer
a6795a6560
test fix
2025-09-19 18:05:36 -07:00
Ishaan Jaffer
eabc9cd415
test test_e2e_bedrock_embedding
2025-09-19 18:03:20 -07:00
Ishaan Jaffer
ed5c9f1c69
test fixes for mapped tests
2025-09-19 18:01:36 -07:00
Krish Dholakia
6142c3ac3d
Merge pull request #14738 from BerriAI/litellm_dev_09_19_2025_p1
...
UI SSO - consider token info endpoint on generic SSO route for access control groups
2025-09-19 17:58:37 -07:00
Ishaan Jaffer
dec15a80a2
test: mcp test fix
2025-09-19 17:52:32 -07:00
Ishaan Jaffer
15898c89e1
test: test_azure_openai_gpt_5_responses_api
2025-09-19 17:45:34 -07:00
Ishaan Jaffer
c3f150b13d
mcp test fix
2025-09-19 17:41:15 -07:00
Ishaan Jaffer
0ba4c7753a
test fix
2025-09-19 17:33:37 -07:00
Krrish Dholakia
7694e9f6a9
test: refactoring + testing
2025-09-19 17:20:15 -07:00
Ishaan Jaffer
d739d226ed
fix: test
2025-09-19 16:28:09 -07:00
Ishaan Jaff
90ee9e4587
[Feat] Dynamic Rate Limiter v3 - fixes to ensure priority routing works as expected ( #14734 )
...
* fix: dynamic limiter v3
* fix: dynamic limiter v3
* feat: add dynamic limiter v3
* feat: add dynamic limiter v3
* feat: add dynamic limiter v3 in init litellm_logging
* feat: add dynamic limiter v3 in init litellm_logging
* fix: priority rate limiting
* Potential fix for code scanning alert no. 3397: Clear-text logging of sensitive information
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
* fix: priority rate limiting
* fix: ruff
* fix: mypy lint
---------
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-09-19 16:04:45 -07:00
Felipe Garé
a696ffe4a6
Litellm gemini batch ( #14733 )
...
* feat: add Vertex AI support for file content retrieval
- Extended `custom_llm_provider` to include "vertex_ai" in `afile_content` function.
- Implemented file content retrieval logic for Vertex AI in `VertexAIFilesHandler`.
- Added helper method to extract bucket and object from URL-encoded file_id.
- Created comprehensive unit and integration tests for Vertex AI file handling.
- Updated transformation logic to ensure compatibility with Vertex AI file responses.
* fix: update Vertex AI file transformation logic
- Modified the transformation logic in `VertexAIFilesConfig` to return a newline-separated JSON string for batch JSONL files instead of a array if JSON strings.
* fix: enhance Vertex AI output handling in transformation logic
- Updated the transformation logic in `VertexAIBatchTransformation` to utilize the new `OutputInfo` TypedDict for retrieving the GCS output directory.
- Added `OutputInfo` class to type definitions for better structure and clarity in Vertex AI responses.
2025-09-19 15:22:52 -07:00
Max Falk
12da4039b9
fix: Prevent AttributeError for _get_tags_from_request_kwargs ( #14735 )
...
* fix: avoid NoneType AttributeError when extracting tags
I've been running into this error:
```
21:47:08 - LiteLLM:ERROR: litellm_logging.py:2396 - LiteLLM.LoggingError: [Non-Blocking] Exception occurred while success logging Traceback (most recent call last):
File "/usr/lib/python3.13/site-packages/litellm/litellm_core_utils/litellm_logging.py", line 2312, in async_success_handler
await callback.async_log_success_event(
...<6 lines>...
)
File "/usr/lib/python3.13/site-packages/litellm/router_strategy/budget_limiter.py", line 396, in async_log_success_event
request_tags = _get_tags_from_request_kwargs(kwargs)
File "/usr/lib/python3.13/site-packages/litellm/router_strategy/tag_based_routing.py", line 144, in _get_tags_from_request_kwargs
return _metadata.get("tags", [])
^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
```
This makes the function more resilient without resorting to try catch.
* add tests
Signed-off-by: Max Falk <gmdfalk@gmail.com>
---------
Signed-off-by: Max Falk <gmdfalk@gmail.com>
2025-09-19 15:21:02 -07:00
Yuta Saito
7d93856c93
fix: correct mistake introduced during conflict resolution
2025-09-20 06:44:06 +09:00
Fabrício Ceschin
f0490ab60d
Merge branch 'BerriAI:main' into LangfuseUsageDetails
2025-09-19 13:54:56 -04:00
