Teddy Amkie
7f5c92ddeb
Update docs for stream_timeout and timeout ( #14073 )
2025-08-29 09:59:07 -07:00
Krish Dholakia
bcd38dde2e
Merge pull request #14036 from gotsysdba/main
...
OCI Provider: add oci_key_file as an optional_parameter
2025-08-29 06:27:09 -07:00
Krish Dholakia
7513bec0e9
Merge pull request #14037 from NoWall57/feature/force-anthropic-custom-api-base-readme
...
docs: add documentation for LITELLM_ANTHROPIC_DISABLE_URL_SUFFIX envi…
2025-08-29 06:26:11 -07:00
Krish Dholakia
f73b9da2cd
Merge pull request #14040 from dmvieira/main
...
Fix error saving latency as timedelta on Redis
2025-08-29 06:25:43 -07:00
Krish Dholakia
c4f60f1a06
Merge pull request #14038 from datarobot-forks/carsongee/add_docs
...
📖 Add DataRobot to the provider documentation.
2025-08-29 06:25:13 -07:00
Krish Dholakia
38a7c8a560
Merge pull request #14041 from Const-antine/litellm_helm_custom_configmap
...
[Helm charts] Enhance proxy_config configuration: add support for existing configmap
2025-08-29 06:24:57 -07:00
Krish Dholakia
fffccc0675
Merge pull request #14042 from WilsonSunBritten/10988-set-truncation-threshold
...
Allow configuration to set threshold before request entry in spend log gets truncated
2025-08-29 06:24:28 -07:00
Krish Dholakia
dd33e3f928
Merge pull request #14050 from lmwang9527/fix/logging-worker-graceful-shutdown
...
Fix LoggingWorker graceful shutdown to prevent CancelledError warnings
2025-08-29 06:23:53 -07:00
Carson Gee
f90072b226
Apply suggestions from code review
...
Co-authored-by: Nate Goudreault <50588929+nate-goudreault@users.noreply.github.com>
2025-08-28 23:00:09 -06:00
Carson Gee
bf55bf5072
Update datarobot.md
2025-08-28 23:00:09 -06:00
mjnitz02
5c73b17387
Add initial docs
2025-08-28 23:00:09 -06:00
Ishaan Jaff
81db36c06c
add xai/grok-code-fast ( #14054 )
2025-08-28 18:10:04 -07:00
Ishaan Jaff
3fe05b300a
fix - use import fastuuid as uuid ( #14016 )
2025-08-28 17:57:46 -07:00
WilsonSunBritten
b3edff02e8
fix mock tests
2025-08-28 17:40:16 -06:00
WilsonSunBritten
8bf2fe2991
attempt to fix unrelated lint error
2025-08-28 17:21:17 -06:00
WilsonSunBritten
e6ba9b4c91
lint fix
2025-08-28 17:12:48 -06:00
WilsonSunBritten
4ea92d96cb
lint fix
2025-08-28 17:11:50 -06:00
WilsonSunBritten
0721345703
Switch to string constant based truncation
2025-08-28 16:28:36 -06:00
Ishaan Jaff
f3338bef9f
[MCP] Bug fix - adding SSE MCP tools - fix connection test when adding MCPs ( #14048 )
...
* fix: _execute_with_mcp_client
* add warning for SSE MCP
* docs - MCP videos / guides
2025-08-28 15:16:34 -07:00
Ishaan Jaff
37a599932d
[Bug Fix] Virtual keys with llm_api type cause Internal Server Error when using /anthropic/* and other llm passthrough routes ( #14046 )
...
* fix route checks passthrough_routes_wildcard
* refactor check_route_access
* test_virtual_key_llm_api_route_includes_passthrough_prefix
2025-08-28 15:14:09 -07:00
WilsonSunBritten
026480358b
Revert "Allow configuration to on what threshold to try truncating request content in db"
...
This reverts commit 771052d67d
2025-08-28 16:12:42 -06:00
lmwang
6760a6aaa1
Fix LoggingWorker graceful shutdown to prevent CancelledError warnings
...
- Change exception logging to debug level during shutdown cancellation
- Add clear_queue() call to process remaining coroutines during shutdown
- Prevents 'RuntimeWarning: coroutine was never awaited' messages
- Add comprehensive tests for graceful shutdown behavior
Fixes #13970
2025-08-28 14:15:17 -07:00
Const-antine
f8d1e03450
rework tests
2025-08-28 13:39:09 -04:00
Const-antine
1350336515
fix tests
2025-08-28 13:30:11 -04:00
Const-antine
d3b526041f
better formatting
2025-08-28 13:18:36 -04:00
Const-antine
730e9c90a2
fix formatting
2025-08-28 13:18:33 -04:00
Const-antine
5d973ea06e
update readme
2025-08-28 13:18:26 -04:00
Const-antine
409429ddd6
add new tests
2025-08-28 13:18:23 -04:00
Const-antine
ff4040bbe1
add functionality to mount existing configmap if needed
2025-08-28 13:18:05 -04:00
Wilson Britten
771052d67d
Allow configuration to on what threshold to try truncating request content in db
2025-08-28 09:48:50 -06:00
Diogo Munaro Vieira
d2ffca24bb
fix: timedelta as cache serializable error
2025-08-28 11:42:25 -03:00
0x5751
323fe8aeac
docs: add documentation for LITELLM_ANTHROPIC_DISABLE_URL_SUFFIX environment variable
...
Added comprehensive documentation for the new LITELLM_ANTHROPIC_DISABLE_URL_SUFFIX configuration option that allows users to disable automatic URL suffix appending when using custom Anthropic API endpoints. This is useful for proxy servers or custom endpoints that don't follow Anthropic's standard URL structure.
Changes:
- Added environment variable to Anthropic provider docs with examples
- Created "Custom API Base" section explaining usage scenarios
- Added entry to environment variables reference table in config settings
2025-08-28 22:21:41 +08:00
gotsysdba
15f1d82536
Fix tests
2025-08-28 14:54:38 +01:00
gotsysdba
87abfc3c11
Adding oci_key_file support for oci provider
2025-08-28 14:37:53 +01:00
Krish Dholakia
e638c5490d
Merge pull request #13945 from NoWall57/feature/force-anthropic-custom-api-base
...
feat: Add support for custom Anthropic-compatible API endpoints
2025-08-27 22:28:55 -07:00
Krish Dholakia
74c9663189
Merge pull request #12797 from ericgtkb/fix-vertex-ai-anyof
...
Fix additional anyOf corner cases for Vertex AI Gemini tool calls - issue #11164
2025-08-27 22:26:13 -07:00
Krish Dholakia
68f4847659
Merge pull request #12865 from aholmberg/holmberg/default-reasoning
...
fix: make gemini and openai responses return reasoning by default
2025-08-27 22:25:30 -07:00
Krish Dholakia
fc738c5822
Merge branch 'main' into holmberg/default-reasoning
2025-08-27 22:25:22 -07:00
Krish Dholakia
df39320889
Merge pull request #12885 from xywei/main
...
Remove vector store methods from global scope
2025-08-27 22:22:59 -07:00
Krish Dholakia
67d432a6d7
Merge pull request #13243 from nagyv-team/main
...
Ensure that `function_call_prompt` extends system messages following its current schema
2025-08-27 22:16:53 -07:00
Krish Dholakia
10816a44d4
Merge pull request #13160 from pangeacyber/aidr-update
...
Update Pangea Guardrail to support new AIDR endpoint
2025-08-27 22:15:32 -07:00
Krish Dholakia
cf491a7931
Merge pull request #13562 from qidu/main
...
refactor(router): choose weights by 'weight', 'rpm', 'tpm' in one loop for simple_shuffle
2025-08-27 22:13:42 -07:00
Krish Dholakia
c692f19346
Merge branch 'main' into main
2025-08-27 22:13:29 -07:00
Krish Dholakia
12bef8fbf4
Merge pull request #13691 from timelfrink/feat/github-copilot-thinking-reasoning-support
...
feat: Add thinking and reasoning_effort parameter support for GitHub Copilot provider
2025-08-27 22:09:22 -07:00
Krish Dholakia
a913ecf60b
Merge branch 'main' into feat/github-copilot-thinking-reasoning-support
2025-08-27 22:09:15 -07:00
Krish Dholakia
f01c7d13e7
Merge pull request #13991 from ikaadil/fix/gemini-imagen-model-name-validation
...
[Bug Fix] Resolve invalid model name error for Gemini Imagen models
2025-08-27 21:56:19 -07:00
Krish Dholakia
f764e415be
Merge pull request #14012 from KRRT7/in-memory-cache-optimization
...
⚡ ️ Speed up InMemoryCache.evict_cache by 21%
2025-08-27 21:55:34 -07:00
Ishaan Jaff
d5774d89cc
Update Docker image tag to v1.75.8-stable ( #14014 )
...
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: ishaan <ishaan@berri.ai>
2025-08-27 16:44:50 -07:00
Ishaan Jaff
04dc1a5351
[Feat] Add support for returning images with gemini/gemini-2.5-flash-image-preview with /chat/completions ( #13983 )
...
* add gemini-2.5-flash-image-preview
* add gemini-2.5-flash-image-preview
* add image in ChatCompletionResponseMessage
* test_gemini_image_generation_async
* Revert "Merge pull request #13394 from Deviad/feature/enhance_logging_for_containers"
This reverts commit 539b94ad4e71af7bcf9c
2025-08-27 16:16:19 -07:00
Xingyao Wang
9acf80b8ad
Fix issue #13995 : Handle None metadata in batch requests ( #13996 )
...
* Fix issue #13995 : Handle None metadata in batch requests
- Added null check in add_key_level_controls method to prevent NoneType error
- Updated type hint to Optional[dict] for better type safety
- Added comprehensive test suite to verify the fix works correctly
- All existing tests pass, confirming no regression
Fixes #13995
Co-authored-by: openhands <openhands@all-hands.dev>
* Move test file to tests/test_litellm/proxy/ directory
- Moved test_batch_metadata_none_fix.py from tests/ to tests/test_litellm/proxy/
- Updated import structure to match existing test patterns
- This ensures the test runs in GitHub Actions as requested by @krrishdholakia
Co-authored-by: openhands <openhands@all-hands.dev>
---------
Co-authored-by: openhands <openhands@all-hands.dev>
2025-08-27 14:51:09 -07:00
