Tom Alon
b83b497d38
PR fixes
2025-09-11 13:38:06 +03:00
Tom Alon
b473344f70
Implement anonymization logic
2025-09-11 11:47:19 +03:00
drorbaron
2ee8c0c6d7
rename aim headers + tests
2025-09-11 11:19:58 +03:00
Ishaan Jaff
258b674dbb
fix deepinfra test
2025-09-10 19:39:23 -07:00
Ishaan Jaff
a13aa4740a
[Fixes] Bug fixes to using LiteLLM MCP Gateway ( #14392 )
...
* fix: use _get_mcp_servers_in_path
* fix checks for using litellm_proxy as MCP tool provider
* fix: fix mcp_tools_with_litellm_proxy
* fix: fix aresponses_api_with_mcp
* aresponses_api_with_mcp
* test_mcp_allowed_tools_filtering
* fix: _filter_mcp_tools_by_allowed_tools
* fix: _filter_mcp_tools_by_allowed_tools
* test_streaming_responses_api_with_mcp_tools
* fixes: test tools transfrom MCP->OpenaI spec
* test_streaming_responses_api_with_mcp_tools
* fix: chat ui allow multi select with allowed tools
* fix: use correct MCP events with litellm proxy response API
* fix get_event_model_class
* fix litellm proxy MCP handler
* fix MCPEnhancedStreamingIterator
* chat ui show list tools result
* UI: show MCP events
* fix stream iterator
* fixes: litellm proxy mcp handler
* test responses + mcp
* fix: update responses api with mcp handling
* ruff check fix
* central: _process_mcp_tools_to_openai_format
* fix: refactor code
* test_mcp_allowed_tools_filtering
* test mcp with litellm proxy
* fix mcp call
* demo: video using MCP ui
* fixes for using stream iterator
* test_no_duplicate_mcp_tools_in_streaming_e2e
* docs fix
* fix code snippet
2025-09-10 19:12:11 -07:00
Ishaan Jaff
1f42e41c8d
[Bug]: Fix Authorization header not being sent to configured MCP servers ( #14422 )
...
* test: test_mcp_server_config_auth_value_header_used
* fix: authentication_token
* docs: fix instructions on using responses api with MCPs
* mcp fixes
2025-09-10 16:41:08 -07:00
Ishaan Jaff
dc5650eeda
Revert "fix: remove anthropic-beta header for Vertex AI requests with prompt caching" ( #14421 )
2025-09-10 15:47:18 -07:00
iabhi4
384ad7e99c
fix: avoid deepcopy crash with non-pickleables in Gemini/Vertex
2025-09-10 12:59:03 -07:00
xprilion
667481e75b
(feat): Add W&B Inference to LiteLLM
2025-09-11 00:07:30 +05:30
Tom Alon
f6bc4d0bf9
Noma non blocking on monitor mode
2025-09-10 13:35:17 +03:00
Krish Dholakia
a80cfe5fb5
Merge branch 'main' into feature/databricks-function-call-missing-pass-description
2025-09-09 22:42:32 -07:00
Krish Dholakia
53bf023876
Merge pull request #14092 from gotsysdba/main
...
OCI Provder: Update OCIPromptTokensDetails
2025-09-09 22:39:16 -07:00
Krish Dholakia
d72081113e
Merge pull request #14111 from dharamendrak/feature/aiohttp-dependency-injection
...
feat: Add dependency injection support to BaseLLMAIOHTTPHandler
2025-09-09 22:35:30 -07:00
Krish Dholakia
03a457842d
Merge pull request #14310 from swarna1101/fix-anthropic-prompt-caching-vertex-ai
...
fix: remove anthropic-beta header for Vertex AI requests with prompt caching
2025-09-09 22:32:40 -07:00
Krrish Dholakia
a504c7dae3
test: update tests
2025-09-09 21:43:37 -07:00
Krrish Dholakia
bdd7255bab
test: remove redundant tests - moved to parallel_request_limiter_v3.py
2025-09-09 21:35:50 -07:00
Krrish Dholakia
c45ede7187
test: update test
2025-09-09 21:31:34 -07:00
Krrish Dholakia
f0de7d1dfd
fix: remove EOL model name
2025-09-09 21:15:12 -07:00
Krrish Dholakia
d05f58721e
test: remove end of life model from tests
2025-09-09 21:01:45 -07:00
Krrish Dholakia
e443d01925
test: remove redundant test
2025-09-09 20:37:09 -07:00
Krrish Dholakia
bff76715a5
test: skip test with invalid arn
2025-09-09 20:35:44 -07:00
Krrish Dholakia
07a83056a6
test: update test
2025-09-09 20:30:50 -07:00
Krrish Dholakia
44566977f1
test: update test
2025-09-09 20:18:03 -07:00
Krrish Dholakia
0854c35d3e
test: remove eol bedrock model from tests
2025-09-09 19:48:35 -07:00
Ishaan Jaff
555efd60b5
[Security] Fix: Ensure .info() logs are not used for request/responses + Add code QA check for possible violations ( #14386 )
...
* test: info log
* fixes for debug
* add info_log_check
* fix: debug level
* fix: debug level
* fix: use .debug
* fix info statements
* fix info log check
* fix: fix emit_standard_logging_payload
* fix RequestBody
* Potential fix for code scanning alert no. 3339: Clear-text logging of sensitive information
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
* fix check
* fix code qa check
---------
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-09-09 13:55:56 -07:00
pinkgu
285b14bd69
Fix/gcp model armor ( #14381 )
...
* chore: fix model armor always success
Signed-off-by: bjorn <bjornjee95@gmail.com>
* chore: fix sanitisation field extraction
Signed-off-by: bjorn <bjornjee95@gmail.com>
---------
Signed-off-by: bjorn <bjornjee95@gmail.com>
2025-09-09 09:18:37 -07:00
swarnabhasinha
f8ddd123d1
fix: add missing patch import in vertex_ai test
2025-09-09 16:16:59 +05:30
swarnabhasinha
7c5ec380c1
fix: remove anthropic-beta header for Vertex AI requests with prompt caching
2025-09-09 15:57:53 +05:30
Krish Dholakia
351896cd1d
Merge pull request #12414 from dotmobo/feature/fix-timestamp-granularities
...
The parameter timestamp_granularities is broken for openai-like transcription
2025-09-08 23:13:13 -07:00
Krish Dholakia
b9ce3a1587
Merge pull request #12416 from dotmobo/feature/fix-alloy
...
feat: add a health_check_voice parameter in model_info
2025-09-08 23:12:48 -07:00
Krish Dholakia
8c5dd753cf
Merge pull request #12651 from ocraviotto/fix-gemini-400-when-no-user-msg
...
fix: ensure Gemini calls include a user message (fixes #9733 )
2025-09-08 23:08:32 -07:00
Krish Dholakia
a92b521ad4
Merge branch 'main' into propagate_metadata_to_vertexai_labels
2025-09-08 19:08:22 -07:00
Krish Dholakia
54c3ae15c8
Merge pull request #14312 from mubashir1osmani/main
...
fix: spend tags endpoint returns 500
2025-09-08 19:05:13 -07:00
Ishaan Jaff
87f116bded
test fix
2025-09-08 18:46:20 -07:00
Ishaan Jaff
2cc85936ed
Revert "Security fix - prevent proxy_admin_viewer from modifying other user's credentials + remove hardcoded sensitive keys from test repo" ( #14362 )
2025-09-08 18:40:54 -07:00
Ishaan Jaff
68d250973c
[Feature]: Support "Token" MCPAuth ( #14359 )
...
* add MCPAuth.authorization type
* test: Token Auth MCP
* fix: _get_auth_headers to handle auth_type == MCPAuth.authorization
* docs auth types with MCP on config.yaml
* test_mcp_server_works_without_config_auth_value
2025-09-08 18:25:41 -07:00
Ishaan Jaff
f1699d4cbf
fix IGNORE_FUNCTIONS
2025-09-08 17:33:36 -07:00
Ishaan Jaff
e37c1069a1
fix test images gemini
2025-09-08 17:22:59 -07:00
Ishaan Jaff
6400552308
fix lic check
2025-09-08 17:18:42 -07:00
Ishaan Jaff
c7f9be6803
test_async_log_cache_hit_on_callbacks
2025-09-08 17:15:53 -07:00
Fabricio Ceschin
faaae888f1
Merge conflicts
2025-09-08 11:34:45 -04:00
Dharamendra Kumar
5b26e78ad6
Fix linting
2025-09-07 18:04:00 -07:00
Dharamendra Kumar
92596e48fe
Merge branch 'main' into feature/aiohttp-dependency-injection
2025-09-07 17:54:55 -07:00
mubashir1osmani
d9bbbc10a6
added tests
2025-09-07 10:17:28 -04:00
Krish Dholakia
9a62b9bdb9
Merge pull request #14161 from BerriAI/litellm_dev_09_01_2025_p2
...
Security fix - prevent proxy_admin_viewer from modifying other user's credentials + remove hardcoded sensitive keys from test repo
2025-09-06 22:14:45 -07:00
Krish Dholakia
e31b2d9eba
Merge pull request #9902 from btemplep/main
...
fix bedrock embedding invocations with app inference profiles
2025-09-06 22:13:35 -07:00
Krish Dholakia
fbc0ec98b6
Merge pull request #12438 from jasonpnnl/fix-customer-update
...
Fix 500 error in `/customer/update` endpoint when updating with `budget_id`
2025-09-06 22:12:30 -07:00
Krish Dholakia
ba10173ec7
Merge branch 'main' into heroku-llms
2025-09-06 22:10:20 -07:00
Krish Dholakia
884cca7da9
Merge pull request #12984 from darashenka/main
...
honor OLLAMA_API_KEY for ollama_chat
2025-09-06 22:07:28 -07:00
Krrish Dholakia
06d472f205
test: fix tests
2025-09-06 21:59:02 -07:00
