Commit graph

5104 commits

Author SHA1 Message Date
Alexsander Hamir
25df8757cb docs: add missing environment variables to documentation - DATABRICKS_CLIENT_ID, DATABRICKS_CLIENT_SECRET, DATABRICKS_USER_AGENT, LITELLM_USER_AGENT 2026-01-01 11:13:24 -08:00
Yuta Saito
b343d15157 fix: prevent LiteLLM from closing external OTEL spans 2026-01-01 08:28:48 +09:00
Prajeena Maharjan
b720fba142
Fix formatting in proxy configs documentation
Got an error message:

{"error":{"message":"Invalid JSON payload: trailing comma is not allowed: line 8 column 8 (char 141)","type":"invalid_request_error","param":"request_body","code":"400"}}%
2025-12-28 23:48:43 -06:00
Matt Cowger
9f4a4fd271
Add docs as follow on to #18362 (#18388) 2025-12-25 11:08:47 +05:30
Ishaan Jaff
1123cfa928
[Feat] AI Gateway - Add support for Platform Fee / Margins (#18427)
* init cost_margin_config

* feat: add cost margin

* init types

* LITELLM_SETTINGS_SAFE_DB_OVERRIDES

* feat _apply_cost_margin

* ui endpoint

* ui provider margins

* add margin

* refactored ui

* test cost margins

* refactored ui

* provider discounts

* add cost_breakdown to spendLogs

* add CostBreakdownViewer

* fix cost breakdown

* docs fix

* doc margins

* docs margins
2025-12-25 11:07:27 +05:30
Sameer Kankute
42121ad13b Update minimax docs to be in proper format 2025-12-24 09:25:36 +05:30
YutaSaito
55bfb24ef8
Merge pull request #18324 from BerriAI/litellm_feat_dynamic_env_propagation_for_stdio_MCP_server
feat: support MCP stdio header env overrides
2025-12-24 06:29:53 +09:00
Ishaan Jaff
4f7682f670
[Feat] RAG query endpoint - Add RAG Search / Query endpoint (#18376)
* add rag query to llm api endpoints

* add rag query as a new endpoint

* docs - new endpoint

* ingest+query

* docs add rag query
2025-12-23 22:30:37 +05:30
Ishaan Jaff
0f63cbea59
[Feat] Interactions API - allow using all litellm providers (interactions -> responses api bridge) (#18373)
* add BaseInteractionsTest

* add interactions_api_handler

* init bridge

* init LiteLLMResponsesInteractionsConfig

* LiteLLMResponsesInteractionsHandler

* mv test

* fixes api spec

* docs

* fix transform+iterators

* docs fix

* fix iterator
2025-12-23 22:30:22 +05:30
Sameer Kankute
c7e0366925 Add support for minmax tts 2025-12-23 21:53:53 +05:30
Sameer Kankute
a2240775c4 correct doc 2025-12-23 21:46:34 +05:30
Sameer Kankute
e18cfc0cf6 corrected provider name 2025-12-23 21:42:51 +05:30
Sameer Kankute
26c0396146 Add documentation for chat compeltion minmax 2025-12-23 17:10:06 +05:30
Sameer Kankute
af8483b37e Fix: documentation for litellm sdk 2025-12-23 16:27:35 +05:30
Sameer Kankute
0174c56c90 Fix: documentation for litellm sdk 2025-12-23 16:23:53 +05:30
Sameer Kankute
7559869359
Merge branch 'main' into litellm_minmax_anthropic_spec 2025-12-23 16:13:47 +05:30
Sameer Kankute
403875256c Add minmax documentation 2025-12-23 16:11:26 +05:30
Cesar Garcia
40fac60ea7
docs(openai): fix gpt-5-mini reasoning_effort supported values (#18346)
Remove 'none' from gpt-5-mini's supported reasoning_effort values in the documentation table. gpt-5-mini does not support reasoning_effort="none", only minimal, low, medium, and high.
2025-12-23 15:50:57 +05:30
Sameer Kankute
c47079ba3a
Merge pull request #18062 from Chesars/fix/groq-deprecated-models
fix: remove deprecated Groq models and update model registry
2025-12-23 12:06:27 +05:30
Sameer Kankute
f6350aac9b
Merge pull request #18349 from prasadkona/feat/databricks-partner-integration
feat(databricks): Add enhanced authentication, security features, and custom user-agent support
2025-12-23 09:45:28 +05:30
Alexsander Hamir
5534038e93
Fix CI: Revert security scan changes and add GitGuardian ignore rules (#18358) 2025-12-22 17:03:53 -08:00
yuneng-jiang
87fc81f3e6 Add cloudzero ui docs 2025-12-22 13:19:03 -08:00
prasadkona
d33c54ee0c
Merge branch 'main' into feat/databricks-partner-integration 2025-12-22 12:30:03 -08:00
prasadkona
3a1baae45c feat(databricks): Add enhanced authentication, security features, and custom user-agent support
- Add OAuth M2M (Machine-to-Machine) authentication via DATABRICKS_CLIENT_ID and DATABRICKS_CLIENT_SECRET
- Add Databricks SDK auto-auth with automatic credential discovery
- Add sensitive data redaction for secure logging (tokens, API keys, secrets)
- Add custom user_agent parameter for partner attribution in Databricks telemetry
- Support user_agent in LiteLLM Proxy via config.yaml litellm_params
- Add 49 mocked unit tests for all new functionality
- Add 13 E2E tests for real-world validation (skipped in CI)
- Update documentation with new features and examples
2025-12-22 12:02:51 -08:00
Alexsander Hamir
30fa90f70d
[Feat] Enable async_post_call_failure_hook to transform error responses (#18348) 2025-12-22 11:24:30 -08:00
Sameer Kankute
6d5eb07496
Merge pull request #18336 from BerriAI/litellm_add_nova_image_embedding_support
fix: request body for image embedding request
2025-12-22 19:11:42 +05:30
Ishaan Jaff
2677d9d30d
[Feat] New provider TTS - Add AWS polly API for TTS (#18326)
* add aws_polly as new provider

* init AWSPollyTextToSpeechConfig

* test_aws_polly_tts_with_native_voice

* init aws_polly + AWS polly dispatch

* init AWSPollyTextToSpeechConfig

* fix transform

* add aws_polly as a new provider for TTS API

* add to sidebar

* docs aws polly

* code qa fix

* add AWS Polly Text-to-Speech

* add cost tracking for AWS polly

* docs fix
2025-12-22 18:19:34 +05:30
Sameer Kankute
cbc1ac9508 fix: request body for image embedding request 2025-12-22 16:55:04 +05:30
Farhan Aulianda
63c3a6e228
fix: enable JSON-only provider routing + add xiaomi_mimo provider (#18291)
* fix: enable JSON-only provider routing + add xiaomi_mimo provider

* docs: add xiaomi_mimo provider documentation
2025-12-22 12:05:22 +05:30
Yuta Saito
34b500c7f5 feat: support MCP stdio header env overrides 2025-12-22 12:58:31 +09:00
Ishaan Jaffer
fe6f0be70f add new providers 2025-12-21 09:27:25 +05:30
yuneng-jiang
f28ff1dd79 docs 2025-12-20 12:43:41 -08:00
yuneng-jiang
0bd7c01ca4
Merge branch 'main' into litellm_yuneng_docs_v18011 2025-12-20 12:38:50 -08:00
yuneng-jiang
7e0f360272 docs 2025-12-20 12:36:32 -08:00
Alexsander Hamir
52fc18ec9a
performance write up (#18296) 2025-12-20 12:30:17 -08:00
Ishaan Jaffer
acadaca7e7 doc review 1 2025-12-21 00:06:06 +05:30
Ishaan Jaffer
01a517a2c6 v 1.80.11 2025-12-20 23:48:10 +05:30
dependabot[bot]
a15f30ba7d
chore(deps): bump altcha-lib from 1.3.0 to 1.4.1 in /docs/my-website (#18017)
Bumps [altcha-lib](https://github.com/altcha-org/altcha-lib) from 1.3.0 to 1.4.1.
- [Release notes](https://github.com/altcha-org/altcha-lib/releases)
- [Commits](https://github.com/altcha-org/altcha-lib/compare/1.3.0...1.4.1)

---
updated-dependencies:
- dependency-name: altcha-lib
  dependency-version: 1.4.1
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-20 21:24:01 +05:30
Ishaan Jaffer
6112160a16 Revert "[Fix] Security - Remove example API keys with high entropy (#18255)"
This reverts commit 24edbccf5c.
2025-12-20 20:48:11 +05:30
Ishaan Jaffer
a38f98057f fix 2025-12-20 15:21:00 +05:30
Krrish Dholakia
a3b6c6c0a7 fix: fix doc 2025-12-20 13:28:58 +05:30
Alexsander Hamir
5b1fda02fb
Add infrastructure recommendations to benchmarks documentation (#18264)
Added concise PostgreSQL and Redis specifications based on benchmark results and industry standards for API gateway deployments. Includes tiered recommendations for different RPS workloads, configuration best practices, and scaling guidelines.
2025-12-19 13:44:36 -08:00
Sameer Kankute
3761f38e43
Merge pull request #18254 from BerriAI/litellm_add_stability_model_edit_1
Add support for stability model and bedrock stability model
2025-12-20 00:23:15 +05:30
Sameer Kankute
d29f4cab59
Merge pull request #17971 from BerriAI/litellm_ocr_deepseek
Add support for ocr for vertex ai deepseek model
2025-12-20 00:13:57 +05:30
Alexsander Hamir
24edbccf5c
[Fix] Security - Remove example API keys with high entropy (#18255) 2025-12-19 10:09:50 -08:00
Sameer Kankute
f062dbdca6
Merge pull request #18227 from BerriAI/litellm_gemini3_doc_update
Add version requirement in gemini 3 flash blog
2025-12-19 23:30:20 +05:30
Sameer Kankute
86596de193 add vertex ai location note 2025-12-19 23:29:38 +05:30
Sameer Kankute
248eb4ea49 Minor bug fixes: mask list 2025-12-19 23:04:53 +05:30
Ishaan Jaffer
388535003e docs fix 2025-12-19 20:06:56 +05:30
Anil Kodali
afba676b2e
Add Amazon Nova to sidebar and under supported models in README (#18220) 2025-12-19 19:07:34 +05:30