Commit graph

5116 commits

Author SHA1 Message Date
amangupta-20
399579f8ea
feat: Add Levo AI integration (#18529) 2026-01-05 08:49:21 +05:30
cantalupo555
9b1c5f7e36
feat(zai): Add GLM-4.7 model with reasoning support (#18476)
Add support for Z.AI GLM-4.7, latest flagship model with enhanced reasoning capabilities.

Changes:
- Add zai/glm-4.7 to model pricing with /bin/bash.60/M input, .20/M output
- Add cached input pricing (/bin/bash.11/M) for GLM-4.7
- Add supports_reasoning flag to enable thinking parameter
- Update ZAIChatConfig to support thinking parameter for models with reasoning
- Update documentation with GLM-4.7 as latest flagship model
- Add cached input column to pricing table (GLM-4.7 only)
- Add tests for GLM-4.7 reasoning support and cost calculation
- Update all examples to use GLM-4.7

Model specifications:
- Context: 200K input, 128K output
- Supports: reasoning, function calling, tool choice, prompt caching
- Pricing: Same as GLM-4.6 with cache support

See: https://docs.z.ai/guides/llm/glm-4.7
2026-01-04 00:44:19 +05:30
Krish Dholakia
969790c463
Iam roles anywhere docs (#18559)
* Add documentation for IAM Roles Anywhere

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* Refactor Bedrock provider docs for IAM Roles Anywhere

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2026-01-04 00:10:07 +05:30
Krish Dholakia
87fe62229f
feat: Add adopters page and data structure (#18605)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2026-01-03 21:51:19 +05:30
Krish Dholakia
0aae5153b6
docs: Clarify Bedrock AgentCore documentation (#18603)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2026-01-03 16:06:07 +05:30
Chetan Choudhary
687adc6024
Add log_format parameter to GenericAPILogger (#18587)
Adds log_format parameter supporting json_array (default), ndjson, and single formats. NDJSON format enables webhook integrations like Sumo Logic to parse individual log records at ingest time. Defaults to json_array for backward compatibility.
2026-01-02 23:28:30 +05:30
Sameer Kankute
c8bb92afdc
Merge pull request #18579 from BerriAI/litellm_remove_prompt_chaching_header
Remove prompt caching headers as the support has been removed
2026-01-02 21:01:50 +05:30
YutaSaito
e9365c496d
Merge pull request #18580 from BerriAI/litellm_feat_support_metaurl_on_ui
feat: add UI support for configuring meta URLs
2026-01-02 17:54:26 +09:00
Lukas de Boer
edc8413f1e
Add Kubernetes ServiceAccount JWT authentication support (#18055)
* Allow get_nested_value dot notation to support escaping for Kubernetes JWT Support

* Add support for team and org alias fields, add docs, tests

* Fix lint issue with max statements in handle jwt logic
2026-01-02 14:02:31 +05:30
Yuta Saito
35f9a75d55 feat: add UI support for configuring meta URLs 2026-01-02 15:07:37 +09:00
Sameer Kankute
ca94990307 remove prompt caching headers as the support has been removed 2026-01-02 11:08:35 +05:30
Alexsander Hamir
936aa6821f
[Fix] CI/CD - litellm_security_tests (#18567) 2026-01-01 14:20:04 -08:00
Alexsander Hamir
a7da4833da
[Fix] CI/CD - check_code_and_doc_quality (#18560) 2026-01-01 11:18:59 -08:00
Yuta Saito
b343d15157 fix: prevent LiteLLM from closing external OTEL spans 2026-01-01 08:28:48 +09:00
Prajeena Maharjan
b720fba142
Fix formatting in proxy configs documentation
Got an error message:

{"error":{"message":"Invalid JSON payload: trailing comma is not allowed: line 8 column 8 (char 141)","type":"invalid_request_error","param":"request_body","code":"400"}}%
2025-12-28 23:48:43 -06:00
Matt Cowger
9f4a4fd271
Add docs as follow on to #18362 (#18388) 2025-12-25 11:08:47 +05:30
Ishaan Jaff
1123cfa928
[Feat] AI Gateway - Add support for Platform Fee / Margins (#18427)
* init cost_margin_config

* feat: add cost margin

* init types

* LITELLM_SETTINGS_SAFE_DB_OVERRIDES

* feat _apply_cost_margin

* ui endpoint

* ui provider margins

* add margin

* refactored ui

* test cost margins

* refactored ui

* provider discounts

* add cost_breakdown to spendLogs

* add CostBreakdownViewer

* fix cost breakdown

* docs fix

* doc margins

* docs margins
2025-12-25 11:07:27 +05:30
Sameer Kankute
42121ad13b Update minimax docs to be in proper format 2025-12-24 09:25:36 +05:30
YutaSaito
55bfb24ef8
Merge pull request #18324 from BerriAI/litellm_feat_dynamic_env_propagation_for_stdio_MCP_server
feat: support MCP stdio header env overrides
2025-12-24 06:29:53 +09:00
Ishaan Jaff
4f7682f670
[Feat] RAG query endpoint - Add RAG Search / Query endpoint (#18376)
* add rag query to llm api endpoints

* add rag query as a new endpoint

* docs - new endpoint

* ingest+query

* docs add rag query
2025-12-23 22:30:37 +05:30
Ishaan Jaff
0f63cbea59
[Feat] Interactions API - allow using all litellm providers (interactions -> responses api bridge) (#18373)
* add BaseInteractionsTest

* add interactions_api_handler

* init bridge

* init LiteLLMResponsesInteractionsConfig

* LiteLLMResponsesInteractionsHandler

* mv test

* fixes api spec

* docs

* fix transform+iterators

* docs fix

* fix iterator
2025-12-23 22:30:22 +05:30
Sameer Kankute
c7e0366925 Add support for minmax tts 2025-12-23 21:53:53 +05:30
Sameer Kankute
a2240775c4 correct doc 2025-12-23 21:46:34 +05:30
Sameer Kankute
e18cfc0cf6 corrected provider name 2025-12-23 21:42:51 +05:30
Sameer Kankute
26c0396146 Add documentation for chat compeltion minmax 2025-12-23 17:10:06 +05:30
Sameer Kankute
af8483b37e Fix: documentation for litellm sdk 2025-12-23 16:27:35 +05:30
Sameer Kankute
0174c56c90 Fix: documentation for litellm sdk 2025-12-23 16:23:53 +05:30
Sameer Kankute
7559869359
Merge branch 'main' into litellm_minmax_anthropic_spec 2025-12-23 16:13:47 +05:30
Sameer Kankute
403875256c Add minmax documentation 2025-12-23 16:11:26 +05:30
Cesar Garcia
40fac60ea7
docs(openai): fix gpt-5-mini reasoning_effort supported values (#18346)
Remove 'none' from gpt-5-mini's supported reasoning_effort values in the documentation table. gpt-5-mini does not support reasoning_effort="none", only minimal, low, medium, and high.
2025-12-23 15:50:57 +05:30
Sameer Kankute
c47079ba3a
Merge pull request #18062 from Chesars/fix/groq-deprecated-models
fix: remove deprecated Groq models and update model registry
2025-12-23 12:06:27 +05:30
Sameer Kankute
f6350aac9b
Merge pull request #18349 from prasadkona/feat/databricks-partner-integration
feat(databricks): Add enhanced authentication, security features, and custom user-agent support
2025-12-23 09:45:28 +05:30
Alexsander Hamir
5534038e93
Fix CI: Revert security scan changes and add GitGuardian ignore rules (#18358) 2025-12-22 17:03:53 -08:00
yuneng-jiang
87fc81f3e6 Add cloudzero ui docs 2025-12-22 13:19:03 -08:00
prasadkona
d33c54ee0c
Merge branch 'main' into feat/databricks-partner-integration 2025-12-22 12:30:03 -08:00
prasadkona
3a1baae45c feat(databricks): Add enhanced authentication, security features, and custom user-agent support
- Add OAuth M2M (Machine-to-Machine) authentication via DATABRICKS_CLIENT_ID and DATABRICKS_CLIENT_SECRET
- Add Databricks SDK auto-auth with automatic credential discovery
- Add sensitive data redaction for secure logging (tokens, API keys, secrets)
- Add custom user_agent parameter for partner attribution in Databricks telemetry
- Support user_agent in LiteLLM Proxy via config.yaml litellm_params
- Add 49 mocked unit tests for all new functionality
- Add 13 E2E tests for real-world validation (skipped in CI)
- Update documentation with new features and examples
2025-12-22 12:02:51 -08:00
Alexsander Hamir
30fa90f70d
[Feat] Enable async_post_call_failure_hook to transform error responses (#18348) 2025-12-22 11:24:30 -08:00
Sameer Kankute
6d5eb07496
Merge pull request #18336 from BerriAI/litellm_add_nova_image_embedding_support
fix: request body for image embedding request
2025-12-22 19:11:42 +05:30
Ishaan Jaff
2677d9d30d
[Feat] New provider TTS - Add AWS polly API for TTS (#18326)
* add aws_polly as new provider

* init AWSPollyTextToSpeechConfig

* test_aws_polly_tts_with_native_voice

* init aws_polly + AWS polly dispatch

* init AWSPollyTextToSpeechConfig

* fix transform

* add aws_polly as a new provider for TTS API

* add to sidebar

* docs aws polly

* code qa fix

* add AWS Polly Text-to-Speech

* add cost tracking for AWS polly

* docs fix
2025-12-22 18:19:34 +05:30
Sameer Kankute
cbc1ac9508 fix: request body for image embedding request 2025-12-22 16:55:04 +05:30
Farhan Aulianda
63c3a6e228
fix: enable JSON-only provider routing + add xiaomi_mimo provider (#18291)
* fix: enable JSON-only provider routing + add xiaomi_mimo provider

* docs: add xiaomi_mimo provider documentation
2025-12-22 12:05:22 +05:30
Yuta Saito
34b500c7f5 feat: support MCP stdio header env overrides 2025-12-22 12:58:31 +09:00
Ishaan Jaffer
fe6f0be70f add new providers 2025-12-21 09:27:25 +05:30
yuneng-jiang
f28ff1dd79 docs 2025-12-20 12:43:41 -08:00
yuneng-jiang
0bd7c01ca4
Merge branch 'main' into litellm_yuneng_docs_v18011 2025-12-20 12:38:50 -08:00
yuneng-jiang
7e0f360272 docs 2025-12-20 12:36:32 -08:00
Alexsander Hamir
52fc18ec9a
performance write up (#18296) 2025-12-20 12:30:17 -08:00
Ishaan Jaffer
acadaca7e7 doc review 1 2025-12-21 00:06:06 +05:30
Ishaan Jaffer
01a517a2c6 v 1.80.11 2025-12-20 23:48:10 +05:30
dependabot[bot]
a15f30ba7d
chore(deps): bump altcha-lib from 1.3.0 to 1.4.1 in /docs/my-website (#18017)
Bumps [altcha-lib](https://github.com/altcha-org/altcha-lib) from 1.3.0 to 1.4.1.
- [Release notes](https://github.com/altcha-org/altcha-lib/releases)
- [Commits](https://github.com/altcha-org/altcha-lib/compare/1.3.0...1.4.1)

---
updated-dependencies:
- dependency-name: altcha-lib
  dependency-version: 1.4.1
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-20 21:24:01 +05:30