Commit graph

28923 commits

Author SHA1 Message Date
Cesar Garcia
089d1eb08b
fix(docker): add libsndfile to Alpine image for audio processing (#18092)
ARM64 Alpine image was missing libsndfile library causing soundfile
module to fail with "cannot load library" error.
2025-12-17 10:07:57 +05:30
yuneng-jiang
1c5f16fb6e
Merge pull request #18034 from BerriAI/litellm_ui_spend_logs_overhead
[Feature] UI -  Show LiteLLM Overhead in Logs
2025-12-16 14:52:26 -08:00
yuneng-jiang
f316caa088
Merge pull request #18033 from BerriAI/litellm_ui_logs_overhead
[Feature] Add LiteLLM Overhead to Logs
2025-12-16 14:51:50 -08:00
Ishaan Jaffer
cdcbccb30d fix interactions API 2025-12-17 02:28:38 +04:00
Ishaan Jaffer
53b47289ce init interactions API 2025-12-17 02:27:54 +04:00
Ishaan Jaffer
f80628502d init docs 2025-12-17 02:27:54 +04:00
Ishaan Jaffer
0052953fc9 docs init 2025-12-17 02:27:54 +04:00
YutaSaito
20cd637f74
Merge pull request #18082 from BerriAI/docs/vault_mount
docs: add documentation describing configurable Hashicorp Vault mount…
2025-12-17 07:24:34 +09:00
Jorge Yero Salazar
48a3a741e5
Allow base_model for non Azure providers in proxy (#18038)
* Allow base_model for non Azure providers in proxy

* Add tests
2025-12-17 02:24:12 +04:00
Yuta Saito
c3d6f8b900 docs: add documentation describing configurable Hashicorp Vault mount and path options 2025-12-17 07:23:30 +09:00
Ishaan Jaff
424363fb1d
[Feat] Add New Google Interactions API on AI Gateway (#18081)
* init BaseInteractionsAPIConfig

* updated types for interactions API

* fix SDK level interactions API

* InteractionsAPIRequestUtils

* init base

* init interactions API

* init Interactions API Types

* init interactins API

* GoogleAIStudioInteractionsConfig

* init http handler

* remove file no longer needed

* test OPENAPI_SPEC_URL

* TestGoogleInteractionsCreate

* add google interctions routes

* init interactions api

* init interactions api

* new routes

* fix config

* working streaming interactons api
2025-12-17 02:20:23 +04:00
Ishaan Jaff
c727c8216f
[Feat] New Endpoint - Google Interactions API - added on litellm SDK (#18079)
* init BaseInteractionsAPIConfig

* updated types for interactions API

* fix SDK level interactions API

* InteractionsAPIRequestUtils

* init base

* init interactions API

* init Interactions API Types

* init interactins API

* GoogleAIStudioInteractionsConfig

* init http handler

* remove file no longer needed

* test OPENAPI_SPEC_URL

* TestGoogleInteractionsCreate
2025-12-17 02:18:51 +04:00
codgician
58e081b6e0
feat: add github_copilot model info (#17858) 2025-12-17 02:15:13 +04:00
yuneng-jiang
c2f79681b6 Fixing test 2 2025-12-16 13:44:53 -08:00
Emerson Gomes
8df713b887
Add Azure DeepSeek V3.2 versions (#18019) 2025-12-17 01:01:57 +04:00
yuneng-jiang
0e5b56eddf Fixing tests 2025-12-16 12:51:44 -08:00
Ishaan Jaff
77b8004ab1
add brazil pii patterns (#18076) 2025-12-17 00:47:10 +04:00
Alexsander Hamir
233e89976a
Lazy load OpenAILikeChatConfig to avoid heavy import (#18075)
- Remove direct import of OpenAILikeChatConfig from llms.openai_like.chat.handler
- Add OpenAILikeChatConfig to LLM_CONFIG_NAMES for lazy loading
- Add handler in _lazy_import_llm_configs() to lazy load when accessed
- Add OpenAILikeChatConfig to TYPE_CHECKING block for type hints

This defers the import until OpenAILikeChatConfig is actually needed, improving import time.
2025-12-16 12:43:42 -08:00
Alexsander Hamir
9b440caac2
Lazy load ImageEditRequestUtils in images/main.py to avoid heavy import (#18074)
- Remove direct import of ImageEditRequestUtils from images.utils
- Add __getattr__ handler to lazy load ImageEditRequestUtils when accessed
- Create _get_ImageEditRequestUtils() helper function with caching
- Use importlib instead of sys to avoid importing sys inside functions
- Update image_edit() to use helper function for accessing ImageEditRequestUtils
- Add TYPE_CHECKING import for proper type hints

This defers the heavy import from images.utils until ImageEditRequestUtils is actually needed, improving import time when from .images.main import * is executed.
2025-12-16 12:28:33 -08:00
Alexsander Hamir
80d445a96f
feat: lazy load GuardrailItem following existing patterns (#18072)
- Add TYPES_NAMES tuple and _lazy_import_types function in _lazy_imports.py
- Remove direct import of GuardrailItem from __init__.py
- Add lazy loading handler in __getattr__ to dispatch type imports
- Add type stub for GuardrailItem in TYPE_CHECKING block
- Add test_types_lazy_imports test to verify lazy loading works
- Use from __future__ import annotations for forward reference support
- Follows same pattern as DOTPROMPT_NAMES and LLM_CONFIG_NAMES for consistency
2025-12-16 11:48:36 -08:00
yuneng-jiang
d918c7b8a3
Merge pull request #18071 from BerriAI/litellm_ui_hide_add_models
[Feature] UI - Add Models Conditional Rendering
2025-12-16 11:38:50 -08:00
yuneng-jiang
975edbcab2 Fixing build 2025-12-16 11:26:45 -08:00
yuneng-jiang
0487c610b8 Add Model Tab Visibility Changes 2025-12-16 11:25:43 -08:00
Alexsander Hamir
f177e4f1a3
[Refactor] litellm/init.py: lazy load encoding from main.py (#18070)
- Add __getattr__ in main.py to lazy load encoding when accessed
- Remove direct assignment of encoding = tiktoken.get_encoding() at module level
- Heavy tiktoken.get_encoding() call is now deferred until encoding is first accessed
- Follows existing lazy loading patterns
- All existing code using litellm.encoding continues to work
2025-12-16 11:19:59 -08:00
Alexsander Hamir
014c74fd06
[Refactor] litellm/init.py: lazy-load AmazonConverseConfig (#18069)
- Add LLM_CONFIG_NAMES tuple and _lazy_import_llm_configs function in _lazy_imports.py
- Remove direct import of AmazonConverseConfig from __init__.py
- Add lazy loading handler in __getattr__ to dispatch LLM config imports
- Add type stub for AmazonConverseConfig in TYPE_CHECKING block
- Add test_llm_config_lazy_imports test to verify lazy loading works
- Follows same pattern as DOTPROMPT_NAMES for consistency
2025-12-16 10:48:11 -08:00
Alexsander Hamir
8be2eac816
add warning about library imported on litellm/init (#18066) 2025-12-16 09:36:24 -08:00
Sameer Kankute
2b495f84ab
Merge pull request #18025 from BerriAI/litellm_staging_12_16_2025
Litellm staging 12 16 2025
2025-12-16 22:31:39 +05:30
Alexsander Hamir
06a499ccd0
[Refactor] litellm/init.py: lazy-load heavy client decorator imports (#18064) 2025-12-16 08:21:07 -08:00
Sameer Kankute
343319889c
Merge pull request #18063 from BerriAI/revert-17970-fix/auth-passthrough-enhancements
Revert "Fix get_model_from_request() to extract model ID from Vertex AI passthrough URLs"
2025-12-16 21:44:40 +05:30
Sameer Kankute
3661f8010f
Revert "fix(proxy): extract model from vertex ai passthrough url pattern (#17…"
This reverts commit ae7c994526.
2025-12-16 21:44:10 +05:30
Sameer Kankute
20bdada900
Merge pull request #18046 from BerriAI/litellm_fix_managed_files_endpoint
Fix managed files endpoint
2025-12-16 21:39:34 +05:30
Sameer Kankute
8864c6937c
Merge pull request #18031 from BerriAI/litellm_anthropic_claude_skills_int
Add support for agent skills in chat completion
2025-12-16 21:39:11 +05:30
Sameer Kankute
215857cce3
Merge branch 'main' into litellm_staging_12_16_2025 2025-12-16 21:38:14 +05:30
Sameer Kankute
755f024087 remove print statments 2025-12-16 21:37:09 +05:30
Sameer Kankute
fc5c5d4dbe
Merge pull request #18042 from BerriAI/litellm_embedding_default_omit
fix: Add none to encoding_format instead of omitting it
2025-12-16 21:35:29 +05:30
Sameer Kankute
abfa869030
Merge pull request #18049 from BerriAI/litellm_bedrock_ttl_issue
Remove ttl field when routing to bedrock
2025-12-16 21:34:57 +05:30
Sameer Kankute
616417eaaa
Merge pull request #18037 from BerriAI/litellm_fix_vertex_ai_headers
fix: skip adding beta headers for vertex ai as it is not suppported
2025-12-16 21:33:35 +05:30
Sameer Kankute
de5471e3cd
Merge pull request #18036 from BerriAI/litellm_fix_responses_headers
Add custom headers in responses API
2025-12-16 21:30:59 +05:30
Sameer Kankute
f23f157556 fix error: Incompatible types (expression has type dict[Any, Any] 2025-12-16 21:27:42 +05:30
Mateo Di Loreto
107ea9043a
[Feature] Download Prisma binaries at build time instead of at runtime for Security Restricted environments (#17695)
* Use config file to enable prometheus metrics

* Revert "Use config file to enable prometheus metrics"

This reverts commit 15ae36e171.

* Improve hardened stack and Prisma offline flow

* Document hardened compose usage

* Remove undesired change in fastapi-sso

* Restore dashboard lockfile

* Remove unecessary tempdirs

* Document hardened/offline Docker validation flow
2025-12-16 21:25:53 +05:30
Alexsander Hamir
8f976df651
[Refactor] litellm/init.py: lazy load default encoding from client decorator (#18059) 2025-12-16 07:45:24 -08:00
Alexsander Hamir
f8168f5063
[Refactor] litellm/init.py: lazy load dotprompt integration (#18056) 2025-12-16 07:18:11 -08:00
Alexsander Hamir
feb6924efe
[Refactor] litellm/init.py: lazy load .types.utils (#18054) 2025-12-16 06:42:17 -08:00
Alexsander Hamir
ea06fb70fb
refactor: lazy load bedrock types (#18053) 2025-12-16 06:05:01 -08:00
Alexsander Hamir
6ca812130b
[Refactor] litellm/init.py: lazy load LLMClientCache (#18008) 2025-12-16 05:44:06 -08:00
Sameer Kankute
0931d50461 Fix code quality check litellm_staging_12_16_2025 2025-12-16 16:30:41 +05:30
Sameer Kankute
6ccfb8b45e Remove ttl fiedl when routing to bedrock 2025-12-16 16:20:19 +05:30
Krish Dholakia
e31d8a1cf6
Router order parameter documentation (#18045)
* feat: Add deployment ordering for load balancing

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* Refactor docs to simplify load balancing and deployment ordering explanations

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-12-16 15:57:05 +05:30
Sameer Kankute
6a3f0a8baf Add output file id in managed objects for batches 2025-12-16 15:52:07 +05:30
Sameer Kankute
3222b4e3a8 Add batch output file in managed table 2025-12-16 15:44:30 +05:30