Commit graph

29114 commits

Author SHA1 Message Date
yuneng-jiang
40b823af87 Add Health Check Model for Wildcard in UI 2025-12-19 15:13:06 -08:00
Alexsander Hamir
5b1fda02fb
Add infrastructure recommendations to benchmarks documentation (#18264)
Added concise PostgreSQL and Redis specifications based on benchmark results and industry standards for API gateway deployments. Includes tiered recommendations for different RPS workloads, configuration best practices, and scaling guidelines.
2025-12-19 13:44:36 -08:00
Alexsander Hamir
f3b97356fb
Add lazy loading for GaladrielChatConfig to reduce import memory overhead (#18260)
Implements lazy loading pattern for GaladrielChatConfig following the existing approach used for other LLM config classes. This defers the import until the config is actually accessed, reducing memory usage during module initialization.
2025-12-19 13:00:57 -08:00
yuneng-jiang
026c2ad693
Merge pull request #18167 from BerriAI/litellm_vector_store_config
[Feature] Auto Resolve Vector Store Embedding Model Config
2025-12-19 11:39:17 -08:00
yuneng-jiang
cacaf54b95
Merge pull request #18170 from BerriAI/litellm_ui_cloudzero_delete
[Feature] UI - Cloudzero Delete Settings
2025-12-19 11:38:28 -08:00
yuneng-jiang
b1b488982d
Merge pull request #18168 from BerriAI/litellm_cloudzero_delete
[Feature] Delete Cloudzero Settings Route
2025-12-19 11:38:10 -08:00
Sameer Kankute
3761f38e43
Merge pull request #18254 from BerriAI/litellm_add_stability_model_edit_1
Add support for stability model and bedrock stability model
2025-12-20 00:23:15 +05:30
Sameer Kankute
2962bcac63
Merge pull request #18256 from BerriAI/litellm_rever_proxy
revert proxy_server_config.py
2025-12-20 00:20:47 +05:30
Sameer Kankute
d3fb7528d5 revert proxy_server_config.py 2025-12-20 00:20:20 +05:30
Sameer Kankute
b3d17951cd revert proxy_server_config.py 2025-12-20 00:19:40 +05:30
Sameer Kankute
e430e317f5 revert proxy_server_config.py 2025-12-20 00:18:03 +05:30
Sameer Kankute
f05e600969
Merge pull request #18236 from BerriAI/litellm_add_background_responses_cost_tracking
Add cost tracking for responses api in background mode
2025-12-20 00:14:09 +05:30
Sameer Kankute
d29f4cab59
Merge pull request #17971 from BerriAI/litellm_ocr_deepseek
Add support for ocr for vertex ai deepseek model
2025-12-20 00:13:57 +05:30
Sameer Kankute
3d56d3d49b vertex ai deepseek doesn't support pdf urls, so skip them 2025-12-19 23:53:17 +05:30
Sameer Kankute
b0a219b718 fix lint error 2025-12-19 23:45:37 +05:30
Sameer Kankute
8efd4653ce Fix litellm_mapped_tests_llms 2025-12-19 23:44:14 +05:30
Sameer Kankute
8ab4f8cfe6 fix lint error 2025-12-19 23:40:23 +05:30
Alexsander Hamir
24edbccf5c
[Fix] Security - Remove example API keys with high entropy (#18255) 2025-12-19 10:09:50 -08:00
Sameer Kankute
e39376c54b fix lint error 2025-12-19 23:39:37 +05:30
Sameer Kankute
06d08b52d9
Merge pull request #18237 from BerriAI/litellm_gemini_response_format_fix
Fix: properties: should be non-empty for OBJECT type
2025-12-19 23:34:05 +05:30
Sameer Kankute
f062dbdca6
Merge pull request #18227 from BerriAI/litellm_gemini3_doc_update
Add version requirement in gemini 3 flash blog
2025-12-19 23:30:20 +05:30
Sameer Kankute
86596de193 add vertex ai location note 2025-12-19 23:29:38 +05:30
Sameer Kankute
9edde2ffdb
Merge pull request #18239 from BerriAI/litellm_fix_sdk_import_error
fix:No module named 'fastapi'
2025-12-19 23:27:23 +05:30
Sameer Kankute
4dedb128b7 fix code qa check 2025-12-19 23:26:05 +05:30
Sameer Kankute
98382bdb93 Fix mypy errors 2025-12-19 23:21:20 +05:30
Sameer Kankute
1f566f6720 fix: lint erros 2025-12-19 23:16:27 +05:30
Sameer Kankute
248eb4ea49 Minor bug fixes: mask list 2025-12-19 23:04:53 +05:30
Sameer Kankute
5feb6d5388 Add support for stability speicifc params in request 2025-12-19 23:03:17 +05:30
Sameer Kankute
b849f51e58 Add support for stability model in image edit 2025-12-19 23:03:17 +05:30
Sameer Kankute
b09ea08424 Add stability models for image edit 2025-12-19 23:03:17 +05:30
yuneng-jiang
e1d25670cd
Merge pull request #18214 from BerriAI/litellm_key_management_fix
[Fix] Key Delete and Regenerate Permissions Fix
2025-12-19 08:48:21 -08:00
Ishaan Jaffer
388535003e docs fix 2025-12-19 20:06:56 +05:30
Anil Kodali
afba676b2e
Add Amazon Nova to sidebar and under supported models in README (#18220) 2025-12-19 19:07:34 +05:30
Ishaan Jaff
deb8d16967
[Feat] Add new Rag Search API / Query API with rerankers (#18217)
* init RAGQueryRequest

* init RAGQuery

* fix query

* fix _execute_query_pipeline

* TestRAGOpenAI
2025-12-19 19:05:07 +05:30
Ishaan Jaffer
b0db9d6bb7 code qa check 2025-12-19 19:00:44 +05:30
Ishaan Jaff
09b5ee9428
[Feat] Unified Skills API - works across Anthropic, Vertex, Azure, Bedrock (#18232)
* init LiteLLM_SkillsTable

* init LiteLLMSkillsTransformationHandler

* init LiteLLMSkillsTransformationHandler

* init skills

* init SkillsInjectionHook

* init litellm skills handler

* _fetch_skill_from_db

* LiteLLMSkillsTransformationHandler

* add _prisma_skill_to_litellm

* use SkillPromptInjectionHandler

* refactor skills handler

* add slack GIF

* test_skill_code_execution_via_deployment_hook

* init readme

* test_get_skill_sdk

* test skills in DB

* fix code qa

* init with containers param

* SkillsInjectionHook

* fix type

* convert_skill_to_anthropic_tool, get_litellm_code_execution_tool_anthropic

* fix messages skills handler

* test_slack_gif_skill_creates_gif

* init SkillsInjectionHook

* clean async_pre_call_hook

* fixes

* working unified skills API! yeet

* fix mypy linting

* LiteLLM_SkillsTable

* llm-sandbox==0.3.31

* fix
2025-12-19 18:55:59 +05:30
Sameer Kankute
568fa73c5d fix:No module named 'fastapi' 2025-12-19 15:20:01 +05:30
Sameer Kankute
a0538e3d54 Fix: properties: should be non-empty for OBJECT type 2025-12-19 14:28:40 +05:30
YutaSaito
3c380086b6
Merge pull request #18234 from BerriAI/litellm_fix_not_working_failure_logging
fix: not working log_failure_event in langfuse
2025-12-19 17:32:05 +09:00
Sameer Kankute
84e4fc3fab
Merge pull request #18226 from Chesars/fix/responses-api-tool-calls-transformation
fix(responses-api): fix tool calls transformation in completion bridge
2025-12-19 13:41:55 +05:30
Sameer Kankute
7d0f41f437 Add cost tracking for responses api in background mode 2025-12-19 13:35:48 +05:30
YutaSaito
369111d186
Merge pull request #18235 from uc4w6c/doc/improve_secret_manager
doc: improve secret manager settings
2025-12-19 17:03:29 +09:00
Yuta Saito
20bbfdd7cb fix: not working log_failure_event in langfuse 2025-12-19 16:54:57 +09:00
yuneng-jiang
887aa62ac7 Ruff check 2025-12-18 21:09:11 -08:00
Sameer Kankute
9e3acdb815 Add version requirement in gemini 3 flash blog 2025-12-19 10:38:06 +05:30
Sameer Kankute
d7647f5b86 Add version requirement in gemini 3 flash blog 2025-12-19 10:17:58 +05:30
Sameer Kankute
d1d008fb7e
Merge pull request #18194 from BerriAI/litellm_fix_cli_bugs
Fix: Claude code responses api bridge errors
2025-12-19 08:38:55 +05:30
Sameer Kankute
1fd4f1ba52
Merge pull request #18109 from BerriAI/litellm_fix_custom_gaurdrail_fix
Fix guardrails for passthrough endpoint
2025-12-19 08:36:58 +05:30
Chesars
5a1cc51d0d docs: add function calling example for Responses API 2025-12-18 22:07:04 -03:00
Chesars
bd36b1261f test: add tests for tool calls transformation fixes
- test_tool_message_output_is_string_not_list: verifies function_call_output.output is a string
- test_multiple_tool_calls_in_single_choice: verifies multiple tool calls are grouped in one choice
2025-12-18 22:01:29 -03:00