Commit graph

32007 commits

Author SHA1 Message Date
Alexsander Hamir
01a07903f6 Merge branch 'main' into litellm_release_day_02_10_2026 2026-02-10 16:25:54 -08:00
Alexsander Hamir
6f669e0985 Revert "Document envs"
This reverts commit 7488abece8.
2026-02-10 16:19:32 -08:00
Alexsander Hamir
7488abece8 Document envs 2026-02-10 16:11:21 -08:00
Alexsander Hamir
39dc32bb14 fix: make OIDC Google tests use context-manager mocks to prevent real API calls
- Use with patch(): so mocks are active when get_secret() runs
- Patch HTTPHandler in main as fallback to avoid real httpx usage
- Fixes failures in CI (ConnectError / Google OIDC provider failed)
  when decorator-based patches did not apply reliably
2026-02-10 16:08:58 -08:00
michelligabriele
8507df483c
fix(router): propagate model-level tags from config to SpendLogs (#20769) 2026-02-10 15:52:52 -08:00
Ishaan Jaffer
f311fba194 fix 2026-02-10 15:24:46 -08:00
Ishaan Jaff
f8619e2000
[Stability] Investigate + fix issue where model cost map became poorly formatted (#20895)
* init: GetModelCostMap

* fix

* docs

* docs fix

* docs fixes

* docs fix

* test model cost map resilience

* MODEL_COST_MAP_MIN_MODEL_COUNT

* validate_model_cost_map

* test_should_have_minimum_models_in_backup

* docs fix

* docs fix

* fix

* dos fix

* docs fix

* docs fix

* docs fix

* docs fix

* validate_model_cost_map

* fix

* cleanup
2026-02-10 15:17:01 -08:00
Alexsander Hamir
9f26a1b494 Fix flaky tests: OIDC Azure AD and video content handler GET
- test_oidc_azure_ad_token_success: use monkeypatch.delenv to force-unset
  AZURE_FEDERATED_TOKEN_FILE so the Azure AD token provider path is always
  exercised in CI (e.g. Azure Pipelines / GitHub Actions OIDC).
- test_video_content_handler_uses_get_for_openai: patch both
  http_handler._get_httpx_client and llm_http_handler._get_httpx_client so
  the mock is used regardless of import order / CI environment.
2026-02-10 15:14:03 -08:00
Krish Dholakia
10d891a365
Guardrails - add logging to all unified_guardrails + link to custom code guardrail templates (#20900)
* feat(guardrail_hooks/): add guardrail logging to all unified guardrails

ensures unified guardrails use the 'log_guardrail_information' decorator for logging

* fix(custom_guardrail.py): don't log inputs on guardrail response - just emit state

* refactor: don't double log bedrock guardrail information

* feat: add in-product nudges for contributing + trying community custom code guardrails

allows users to contribute / share custom code guardrails
2026-02-10 15:13:54 -08:00
Emerson Gomes
a6f90586ac
feat(model-db): add azure_ai/kimi-k2.5 pricing entry (#20896) 2026-02-10 14:46:40 -08:00
yuneng-jiang
9f8878ee17
Merge pull request #20893 from BerriAI/pypi_fix_feb10
[Infra] CI/CD - Fix PyPI CI Step
2026-02-10 14:01:05 -08:00
yuneng-jiang
7d2c874434 Fixing ci pypi build 2026-02-10 13:59:48 -08:00
Alexsander Hamir
bd1db74031 chore: bump litellm-proxy-extras to 0.4.34, fix publish_proxy_extras CI working dir
- Bump version in litellm-proxy-extras/pyproject.toml, pyproject.toml, requirements.txt
- Remove redundant 'cd litellm-proxy-extras' in Get new version and Publish to PyPI steps
  (job already uses working_directory: ~/project/litellm-proxy-extras)
2026-02-10 13:59:00 -08:00
yuneng-jiang
ea38630e7c bump: version 0.4.33 → 0.4.34 2026-02-10 13:58:57 -08:00
yuneng-jiang
b7107ab803
Merge pull request #20892 from BerriAI/litellm_ui_spend_logs_model
[Feature] UI - Spend Logs: Paginated Searchable Model Select
2026-02-10 13:51:53 -08:00
Alexsander Hamir
ebc25a597f revert: undo Docker Node pin; keep orjson/diff upgrades, use ignore list
- Revert Dockerfile and Dockerfile.database to plain 'nodejs npm' (no pin, no apk update)
- Add Node CVEs and orjson/diff to .grype.yaml and security_scans.sh allowlist
- Keep orjson==3.11.7 in requirements.txt and diff>=8.0.3 override in package.json
  (easy upgrades that do not change Docker image build)
2026-02-10 13:05:53 -08:00
yuneng-jiang
3fe1c1ba24 fixing build 2026-02-10 12:53:51 -08:00
Alexsander Hamir
68a0176a38 fix(docker): run apk update before apk add for nodejs-24-24.13.0-r0
CI base image index may not include the package; apk update refreshes
the index so nodejs-24-24.13.0-r0 can be resolved.
2026-02-10 12:45:52 -08:00
yuneng-jiang
7fd8c0e160 Searchable Paginated Model Select For Spend Logs 2026-02-10 12:44:38 -08:00
Alexsander Hamir
79296baabc fix: address security scan failures (Node, orjson, diff)
- Pin Node to 24.13.0 (nodejs-24-24.13.0-r0) in Dockerfile and
  Dockerfile.database to fix Node CVEs (CVE-2025-55130, etc.)
- Upgrade orjson to 3.11.7 in requirements.txt (CVE-2025-67221)
- Add npm override for diff>=8.0.3 in litellm-dashboard (GHSA-73rr-hh4g-fpgx)
- Remove Node CVEs from .grype.yaml and security_scans.sh allowlist;
  keep Python 3.13 / zlib ignores (no fix in Wolfi yet)
2026-02-10 12:37:15 -08:00
Alexsander Hamir
7df89930b4 fix: resolve bedrock base model to cost map key in test_get_model_info_bedrock_models
get_base_model() returns model id without 'bedrock/' prefix; cost map
keys use 'bedrock/<model>'. Resolve base_model to actual key (try
base_model then bedrock/base_model) and skip when not in map to fix
KeyError for moonshotai.kimi-k2-thinking.
2026-02-10 12:06:49 -08:00
Alexsander Hamir
ebd4f3d947 test: pass dummy api_key for AIML mocked test so validate_environment passes; add flaky(retries=0) 2026-02-10 11:41:15 -08:00
Alexsander Hamir
ca7c74e358 test: use mocked HTTP for AIML image generation test (no API key/credits needed) 2026-02-10 11:34:02 -08:00
Alexsander Hamir
e3b070ea83 test: fix schema and env override tests - add supports_preset to model prices schema; use LITELLM_MAX_CALLBACKS for MAX_CALLBACKS override test 2026-02-10 11:09:34 -08:00
Alexsander Hamir
9b9926bb59 test: ignore metadata.additional_usage_values.speed in spend logs payload comparison 2026-02-10 11:04:44 -08:00
Alexsander Hamir
6019afb644 bump: version 1.81.9 → 1.81.10 2026-02-10 11:01:27 -08:00
Alexsander Hamir
af0617cce8 Document envs 2026-02-10 10:47:06 -08:00
Alexsander Hamir
3c0a10f05a fix: prefix OpenAI model with 'responses/' when thinking is enabled
- Add model prefixing to route OpenAI thinking requests to Responses API
- Fixes test failure where model should be 'responses/gpt-5.2' instead of 'gpt-5.2'
- Ensures OpenAI models with thinking parameter use Responses API for reasoning summary
- Prevents double-prefixing with existing 'responses/' check
2026-02-10 10:42:53 -08:00
Alexsander Hamir
c15632d626 fix: add safeguards to _convert_to_json_serializable_dict to prevent infinite recursion
- Add max_depth parameter (default 20) to prevent infinite recursion
- Add circular reference protection using visited set
- Add function to recursive_detector ignore list with proper safeguards
- Fixes CPU usage spikes caused by unguarded recursive function
2026-02-10 10:36:51 -08:00
Alexsander Hamir
205b08703b fix: resolve test failures - budget mock_table and MCP openapi async
- test_budget_endpoints: define mock_table in client_and_mocks fixture to fix NameError in 5 tests
- mcp_server_manager: make _register_openapi_tools async and use load_openapi_spec_async to avoid RuntimeError when called from running event loop; await in load_servers_from_config
- test_mcp_server_manager: await _register_openapi_tools in test_register_openapi_tools_includes_static_headers
2026-02-10 10:26:44 -08:00
Alexsander Hamir
16a678e9ba Revert "Bump litellm-proxy-extras to 0.4.34"
This reverts commit a096544f46.
2026-02-10 10:25:30 -08:00
Alexsander Hamir
5db3820a1d fix: authorize urllib3/filelock in liccheck, replace pkg_resources with packaging
- Add urllib3 (MIT) and filelock (Unlicense) to [Authorized Packages] in liccheck.ini
- Fix DeprecationWarning by using packaging.requirements.Requirement instead of pkg_resources
2026-02-10 10:24:19 -08:00
Alexsander Hamir
ddc590ab2e Merge branch 'litellm_release_day_02_10_2026' of https://github.com/BerriAI/litellm into litellm_release_day_02_10_2026 2026-02-10 10:23:33 -08:00
Alexsander Hamir
1eb53b3f03 Add canonical bedrock/moonshotai.kimi-k2-thinking to model cost map 2026-02-10 10:22:43 -08:00
michelligabriele
3bbc25a3f0
fix(aiohttp): respect ssl_verify with shared sessions (#20349)
* fix(aiohttp): respect ssl_verify with shared sessions

* fix(aiohttp): resolve mypy error for ssl parameter type

Pass ssl kwarg conditionally to aiohttp request() only when explicitly
configured, since None is not a valid value for the ssl parameter
(expected SSLContext | bool | Fingerprint).
2026-02-10 10:17:35 -08:00
Alexsander Hamir
a096544f46 Bump litellm-proxy-extras to 0.4.34 2026-02-10 09:56:04 -08:00
Alexsander Hamir
40e1baa7e0 fix(dashboard): import TeamMembersComponent from TeamMemberTab instead of missing team_member_view 2026-02-10 09:51:25 -08:00
Alexsander Hamir
8eeb3a39ff fix: remove duplicate PerplexityResponsesConfig key in lazy imports registry 2026-02-10 09:47:37 -08:00
michelligabriele
1afe3032fd
fix(otel): auto-infer otlp_http exporter when endpoint is configured (#20438)
When OpenTelemetry is configured via the UI, only OTEL_ENDPOINT and
OTEL_HEADERS are set, but OTEL_EXPORTER is not specified. This caused
the exporter to default to "console", meaning traces were printed to
stdout instead of being sent to the configured endpoint.

This fix adds logic in OpenTelemetryConfig.__post_init__ to automatically
infer "otlp_http" as the exporter when an endpoint is specified but the
exporter is still the default "console".

Fixes issue reported by Elastic team where traces weren't being sent
to their OTEL endpoint when configured through the LiteLLM UI.
2026-02-10 09:33:16 -08:00
Sameer Kankute
0f01802dde
Merge pull request #20845 from BerriAI/litellm_gemini_image_handling
Handle image in assitant message for gemini
2026-02-10 18:24:09 +05:30
Sameer Kankute
3de892b8ca
Merge pull request #20860 from BerriAI/litellm_perplexity_research_api_support
[Feat] Perplexity research api support
2026-02-10 18:22:30 +05:30
Sameer Kankute
cdab87dec0
Merge pull request #20838 from BerriAI/litellm_managed_error_file
Add support managed error file
2026-02-10 18:20:26 +05:30
Sameer Kankute
f6228fda3e Fix mypy issues 2026-02-10 18:18:41 +05:30
Sameer Kankute
0b4c511576
Merge pull request #20863 from BerriAI/litellm_moonshotai.kimi-k2.5
Add moonshotai.kimi-k2.5
2026-02-10 18:12:36 +05:30
Sameer Kankute
7166ca8c59 Add moonshotai.kimi-k2.5 2026-02-10 18:10:37 +05:30
Sameer Kankute
63eedc26b0 Fix test_async_post_call_success_hook_for_unified_finetuning_job 2026-02-10 18:08:23 +05:30
Sameer Kankute
fda64caa28
Merge pull request #20855 from BerriAI/litellm_bedrock_kimi2
Add Kimi model pricing by region
2026-02-10 18:05:25 +05:30
Sameer Kankute
5222fd4795
Merge pull request #20783 from BerriAI/litellm_oss_staging_02_09_2026
litellm oss staging 09/02/2026
2026-02-10 18:02:14 +05:30
Sameer Kankute
45133fab53
Merge pull request #20854 from BerriAI/litellm_oss_staging_02_05_2026_3
Litellm oss staging 02 05 2026 3
2026-02-10 17:59:56 +05:30
Sameer Kankute
7d5141c28c Fix mypy issues 2026-02-10 17:58:15 +05:30