Commit graph

4928 commits

Author SHA1 Message Date
YutaSaito
716cac4e3b
Merge pull request #18300 from BerriAI/litellm_fix_datadog-dual-callback-conflict
fix: ensure Datadog callback runs alongside LLM Observability
2025-12-21 06:22:21 +09:00
Yuta Saito
b54216d05f fix: ensure Datadog callback runs alongside LLM Observability 2025-12-21 05:46:34 +09:00
Alexsander Hamir
699a91e031
fix(test): Fix test_users_in_team_budget to create user with team_id (#18297)
Previously, the test created a user first (without team_id), then added them
to a team. This caused the API key to have team_id=None, which broke team
budget tracking and enforcement.

The fix:
- Create team first, then create user with team_id parameter
- This ensures the API key gets team_id set from creation time
- Team budget tracking and enforcement now work correctly

Added comprehensive comments explaining why the order is critical and should
not be changed, as it tests the intended flow where keys are associated with
teams at creation time.

Also added extensive debugging output to help diagnose future issues.
2025-12-20 12:30:30 -08:00
Alexsander Hamir
5a76aada3c
[Fix] CI/CD - responses_api_testing (#18295) 2025-12-20 10:27:58 -08:00
Ishaan Jaffer
148715541c test compl openai orgs 2025-12-20 23:41:29 +05:30
Ishaan Jaffer
de65f0e777 TestAzureOpenAIO3Mini 2025-12-20 23:18:19 +05:30
Ishaan Jaffer
179eb8815d test_azure_safety_result 2025-12-20 22:40:53 +05:30
Ishaan Jaffer
987c9a608b TestAzureOpenAIO3Mini 2025-12-20 22:37:59 +05:30
Ishaan Jaffer
b1090db927 test_openai_stream_options_call 2025-12-20 22:35:21 +05:30
Ishaan Jaffer
9f205b0323 TestAzureOpenAIO3Mini 2025-12-20 21:52:28 +05:30
Ishaan Jaffer
7eb2af1959 test bad org fix 2025-12-20 21:43:27 +05:30
Ishaan Jaffer
abf14663ed test_slack_gif_skill_creates_gif 2025-12-20 21:35:25 +05:30
Ishaan Jaffer
6112160a16 Revert "[Fix] Security - Remove example API keys with high entropy (#18255)"
This reverts commit 24edbccf5c.
2025-12-20 20:48:11 +05:30
Ishaan Jaffer
7232039779 test fixes 2025-12-20 15:38:20 +05:30
Ishaan Jaffer
7d28485cb5 test_amazon_titan_image_gen 2025-12-20 15:16:55 +05:30
Ishaan Jaffer
eec05c036a test_create_skill_sdk 2025-12-20 15:08:31 +05:30
Ishaan Jaffer
c13b4c5514 test_aaapass_through_endpoint_pass_through_keys_langfuse 2025-12-20 14:36:59 +05:30
Ishaan Jaffer
627d615322 test_amazon_titan_image_gen 2025-12-20 14:36:50 +05:30
Ishaan Jaffer
859474dd44 fix patch 2025-12-20 14:00:42 +05:30
Ishaan Jaffer
c1b116c5f5 fix 2025-12-20 13:54:05 +05:30
Cesar Garcia
138b415e81
fix(responses-api): use list format with input_text for tool results (#18257)
The Responses API expects tool results to use input_text/input_image types,
not output_text. This fix ensures consistent list format for all tool results:
- String content → [{"type": "input_text", "text": "..."}]
- Image content → [{"type": "input_image", "image_url": "..."}]

This resolves the conflict between tests that expected different formats
and aligns with OpenAI's Responses API requirements.

Fixes the regression introduced in #18226.
2025-12-20 13:46:14 +05:30
YutaSaito
2bbfa498e2
Revert "ensure datadog llm obs ignores dd base url override" 2025-12-20 08:56:49 +09:00
Yuta Saito
72f424c719 ensure datadog llm obs ignores dd base url override 2025-12-20 07:44:40 +09:00
yuneng-jiang
026c2ad693
Merge pull request #18167 from BerriAI/litellm_vector_store_config
[Feature] Auto Resolve Vector Store Embedding Model Config
2025-12-19 11:39:17 -08:00
yuneng-jiang
b1b488982d
Merge pull request #18168 from BerriAI/litellm_cloudzero_delete
[Feature] Delete Cloudzero Settings Route
2025-12-19 11:38:10 -08:00
Sameer Kankute
3761f38e43
Merge pull request #18254 from BerriAI/litellm_add_stability_model_edit_1
Add support for stability model and bedrock stability model
2025-12-20 00:23:15 +05:30
Sameer Kankute
f05e600969
Merge pull request #18236 from BerriAI/litellm_add_background_responses_cost_tracking
Add cost tracking for responses api in background mode
2025-12-20 00:14:09 +05:30
Sameer Kankute
d29f4cab59
Merge pull request #17971 from BerriAI/litellm_ocr_deepseek
Add support for ocr for vertex ai deepseek model
2025-12-20 00:13:57 +05:30
Sameer Kankute
3d56d3d49b vertex ai deepseek doesn't support pdf urls, so skip them 2025-12-19 23:53:17 +05:30
Sameer Kankute
b0a219b718 fix lint error 2025-12-19 23:45:37 +05:30
Sameer Kankute
8efd4653ce Fix litellm_mapped_tests_llms 2025-12-19 23:44:14 +05:30
Alexsander Hamir
24edbccf5c
[Fix] Security - Remove example API keys with high entropy (#18255) 2025-12-19 10:09:50 -08:00
Sameer Kankute
06d08b52d9
Merge pull request #18237 from BerriAI/litellm_gemini_response_format_fix
Fix: properties: should be non-empty for OBJECT type
2025-12-19 23:34:05 +05:30
Sameer Kankute
b849f51e58 Add support for stability model in image edit 2025-12-19 23:03:17 +05:30
yuneng-jiang
e1d25670cd
Merge pull request #18214 from BerriAI/litellm_key_management_fix
[Fix] Key Delete and Regenerate Permissions Fix
2025-12-19 08:48:21 -08:00
Ishaan Jaff
deb8d16967
[Feat] Add new Rag Search API / Query API with rerankers (#18217)
* init RAGQueryRequest

* init RAGQuery

* fix query

* fix _execute_query_pipeline

* TestRAGOpenAI
2025-12-19 19:05:07 +05:30
Ishaan Jaffer
b0db9d6bb7 code qa check 2025-12-19 19:00:44 +05:30
Ishaan Jaff
09b5ee9428
[Feat] Unified Skills API - works across Anthropic, Vertex, Azure, Bedrock (#18232)
* init LiteLLM_SkillsTable

* init LiteLLMSkillsTransformationHandler

* init LiteLLMSkillsTransformationHandler

* init skills

* init SkillsInjectionHook

* init litellm skills handler

* _fetch_skill_from_db

* LiteLLMSkillsTransformationHandler

* add _prisma_skill_to_litellm

* use SkillPromptInjectionHandler

* refactor skills handler

* add slack GIF

* test_skill_code_execution_via_deployment_hook

* init readme

* test_get_skill_sdk

* test skills in DB

* fix code qa

* init with containers param

* SkillsInjectionHook

* fix type

* convert_skill_to_anthropic_tool, get_litellm_code_execution_tool_anthropic

* fix messages skills handler

* test_slack_gif_skill_creates_gif

* init SkillsInjectionHook

* clean async_pre_call_hook

* fixes

* working unified skills API! yeet

* fix mypy linting

* LiteLLM_SkillsTable

* llm-sandbox==0.3.31

* fix
2025-12-19 18:55:59 +05:30
Sameer Kankute
a0538e3d54 Fix: properties: should be non-empty for OBJECT type 2025-12-19 14:28:40 +05:30
YutaSaito
3c380086b6
Merge pull request #18234 from BerriAI/litellm_fix_not_working_failure_logging
fix: not working log_failure_event in langfuse
2025-12-19 17:32:05 +09:00
Sameer Kankute
84e4fc3fab
Merge pull request #18226 from Chesars/fix/responses-api-tool-calls-transformation
fix(responses-api): fix tool calls transformation in completion bridge
2025-12-19 13:41:55 +05:30
Sameer Kankute
7d0f41f437 Add cost tracking for responses api in background mode 2025-12-19 13:35:48 +05:30
Yuta Saito
20bbfdd7cb fix: not working log_failure_event in langfuse 2025-12-19 16:54:57 +09:00
Sameer Kankute
d1d008fb7e
Merge pull request #18194 from BerriAI/litellm_fix_cli_bugs
Fix: Claude code responses api bridge errors
2025-12-19 08:38:55 +05:30
Sameer Kankute
1fd4f1ba52
Merge pull request #18109 from BerriAI/litellm_fix_custom_gaurdrail_fix
Fix guardrails for passthrough endpoint
2025-12-19 08:36:58 +05:30
Chesars
bd36b1261f test: add tests for tool calls transformation fixes
- test_tool_message_output_is_string_not_list: verifies function_call_output.output is a string
- test_multiple_tool_calls_in_single_choice: verifies multiple tool calls are grouped in one choice
2025-12-18 22:01:29 -03:00
yuneng-jiang
085d07db46 Fixing tests 2025-12-18 16:12:06 -08:00
Alexsander Hamir
0c48826cdc
Revert "[Fix] CI/CD - local_testing & mapped tests (#18222)" (#18223)
This reverts commit dc7f500c47.
2025-12-18 14:46:09 -08:00
Alexsander Hamir
dc7f500c47
[Fix] CI/CD - local_testing & mapped tests (#18222) 2025-12-18 14:34:48 -08:00
yuneng-jiang
41732696c6 replicate delete checks for regenerate 2025-12-18 13:25:11 -08:00