Commit graph

6194 commits

Author SHA1 Message Date
gotsysdba
87abfc3c11
Adding oci_key_file support for oci provider 2025-08-28 14:37:53 +01:00
TomuHirata
7333060fb0 feat(databricks): add anthropic citation support 2025-08-28 18:43:43 +09:00
李海峰
2d0a57a719 Add Volcengine embedding module with handler and transformation logic
- Implemented VolcEngineEmbeddingHandler for synchronous and asynchronous embedding requests.
- Created VolcEngineEmbeddingConfig for transforming requests and responses to/from Volcengine format.
- Added integration tests for embedding functionality, covering various scenarios including error handling and parameter validation.
- Established test structure for Volcengine embedding, ensuring compliance with LiteLLM testing patterns.
- Included comprehensive tests for parameter mapping, request transformation, and response handling.
2025-08-28 15:05:11 +08:00
Krish Dholakia
c43706061f
Merge branch 'main' into heroku-llms 2025-08-27 22:21:36 -07:00
Krish Dholakia
f01c7d13e7
Merge pull request #13991 from ikaadil/fix/gemini-imagen-model-name-validation
[Bug Fix] Resolve invalid model name error for Gemini Imagen models
2025-08-27 21:56:19 -07:00
Krrish Dholakia
e2279329c6 docs(index.md): cleanup 2025-08-27 20:37:18 -07:00
Krrish Dholakia
0734e39a09 docs(index.md): cleanup doc 2025-08-27 20:33:27 -07:00
Ishaan Jaff
d5774d89cc
Update Docker image tag to v1.75.8-stable (#14014)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: ishaan <ishaan@berri.ai>
2025-08-27 16:44:50 -07:00
Ishaan Jaff
04dc1a5351
[Feat] Add support for returning images with gemini/gemini-2.5-flash-image-preview with /chat/completions (#13983)
* add gemini-2.5-flash-image-preview

* add gemini-2.5-flash-image-preview

* add image in ChatCompletionResponseMessage

* test_gemini_image_generation_async

* Revert "Merge pull request #13394 from Deviad/feature/enhance_logging_for_containers"

This reverts commit 539b94ad4e, reversing
changes made to 71af7bcf9c.

* include `image` in Delta

* fix _process_candidates should show the image response

* fix: _handle_special_delta_attributes

* test_gemini_image_generation_async_stream

* image_generation_chat

* UI - allow looking at generated images from /chat/completions

* _create_streaming_choice

* fix import StreamingChoices

* fix ChatCompletionResponseMessage

* test_gemini_image_generation

* add gemini img migration

* fix _extract_candidate_metadata

* ui fix

* fix batch endpoint test
2025-08-27 16:16:19 -07:00
Ishaan Jaff
165242e31f
[Feat] langfuse_otel logger - allow using LANGFUSE_OTEL_HOST for configuring host (#14013)
* feat - add _get_langfuse_otel_host

* test_get_langfuse_otel_config_with_otel_host_priority

* docs: LANGFUSE_OTEL_HOST
2025-08-27 14:43:47 -07:00
Ifta Khairul Alam Adil
75aeca14b2 Merge branch 'main' into fix/gemini-imagen-model-name-validation 2025-08-27 21:52:47 +02:00
Ishaan Jaff
76f78f7b2a fix: LITELLM_LOG_FILE test 2025-08-27 08:25:24 -07:00
Ifta Khairul Alam Adil
8808f78ba6 Merge branch 'main' into fix/gemini-imagen-model-name-validation 2025-08-27 15:45:59 +02:00
Krish Dholakia
ddec6c69c8
Merge pull request #13534 from cometapi-dev/main
docs: Add CometAPI documentation with authentication, usage examples, and error handling
2025-08-26 23:17:04 -07:00
Krish Dholakia
45f465d84f
Merge pull request #13572 from Noma-Security/noma-security-guardrails-support
Add Noma Security guardrail support
2025-08-26 23:15:17 -07:00
Ifta Khairul Alam Adil
0f5b31fd78 fix: resolve invalid model name error for Gemini Imagen models (#13851)
- Fix URL construction in Gemini image generation to strip 'gemini/' prefix
- Google AI API expects base model name without the prefix
- Update model references and pricing information for consistency
- Remove outdated image generation pricing entries

Fixes issue where models like 'gemini/imagen-4.0-fast-generate-preview-06-06'
were being rejected by the Google AI API due to incorrect URL formatting.
2025-08-27 04:17:35 +02:00
Krish Dholakia
ae678a6642
Merge pull request #13573 from Ivy-Interactive/feature/braintrust-span-name-metadata
Feature/braintrust span name metadata
2025-08-25 23:19:56 -07:00
Krish Dholakia
3ed1220f75
Merge pull request #13916 from mubashir1osmani/openai-multiple-images
feat: multiple images in openai images/edits endpoint
2025-08-25 23:11:13 -07:00
Ishaan Jaff
c1ee8c26af
[UI QA] - Allow setting Team Member RPM/TPM limits when creating a team (#13943)
* allow setting team_member_rpm_limit on creating

* create_team_member_rate_limits

* docs fix

* fix img
2025-08-25 09:12:50 -07:00
Ishaan Jaff
7c5e9b666b update release notes 2025-08-25 08:17:30 -07:00
Krish Dholakia
68aaeb4f4a
Merge pull request #13914 from uc4w6c/docs/fix-custom-guardrail-imports
Fix missing and unused imports in custom_guardrail docs example
2025-08-25 00:57:46 -07:00
Yuta Saito
cca1ea1592 Fix missing and unused imports in custom_guardrail docs example 2025-08-24 08:37:17 +09:00
mubashir1osmani
2fa8f971e0 feat: multiple images in openai images/edits endpoint 2025-08-23 19:13:32 -04:00
Krrish Dholakia
66acf6dcdb docs(index.md): initial commit with release notes 2025-08-23 15:45:06 -07:00
Krish Dholakia
242c06e691
Merge pull request #13784 from mubashir1osmani/docs-deploy 2025-08-23 15:40:34 -07:00
Mubashir Osmani
1a8d3cc2d5
Added FAQ under deployment docs (#13912)
* updated faq questions

* updated faq

* added faq under deployment
2025-08-23 13:22:56 -07:00
Ishaan Jaff
9750374081
[Feat] New LLM API - AI/ML API for Image Gen (#13893)
* add LlmProviders.AIML

* add AIMLChatConfig

* add aiml

* fix AimlImageGenerationConfig

* add AimlImageGenerationConfig

* add cost_calculator

* fixes for AI ML API

* add known AIML Flux image models

* add AIML Cost Calc

* add AI/ML API

* add aiml_models
2025-08-23 13:12:44 -07:00
Krish Dholakia
9df6f4ef08
Merge branch 'main' into litellm_dev_08_20_2025_p1 2025-08-23 12:09:53 -07:00
mubashir1osmani
d664860aa1 added openai models to config 2025-08-23 10:02:49 -04:00
Krish Dholakia
867b48a24f
Merge pull request #13866 from jinskjoy/Mistral-File-ID
[Enhancement] Add support for Mistral model file handling and update documentation
2025-08-22 23:54:17 -07:00
Krish Dholakia
28ea6cd35f
Merge pull request #13899 from TeddyAmkie/docs/team-rate-limits-update
docs: clarify prerequisites and env var for team rate limits
2025-08-22 23:50:24 -07:00
Ishaan Jaff
f9e9f8c25e docs AWS_REGION 2025-08-22 17:48:37 -07:00
Ishaan Jaff
56c16fc6f6
[Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895)
* fix: litellm.configured_cold_storage_logger

* fix Session Management - Non-OpenAI Models docs

* ruff fix

* test fix
2025-08-22 16:17:57 -07:00
Teddy Amkie
08d1c96ed1 docs: clarify prerequisites and env var for team rate limits 2025-08-22 18:39:31 +00:00
Sameer Kankute
694a9f0f4c
[Documentation] Litellm rerank deepinfra endpoint (#13845)
* Add documentation for deepinfra rerank endpoint

* Add the missed import

* fix supported param
2025-08-22 09:51:42 -07:00
Krish Dholakia
7c2c1c11d9
Merge pull request #13783 from philipkiely-baseten/main
Update Baseten LiteLLM integration
2025-08-21 18:34:36 -07:00
jinskjoy
d8a33e137d [Enhancement] Add support for Mistral model file handling and update documentation 2025-08-21 20:35:07 +02:00
Krrish Dholakia
5c1b27af99 docs(quick_start.md): add back to navbar
useful for showing setup via cli
2025-08-20 15:09:19 -07:00
Krrish Dholakia
fb5b2d8d47 docs: remove old doc
prevent showing up on searches
2025-08-20 15:01:32 -07:00
Ishaan Jaff
55dcaded72
[Feat] Add VertexAI qwen API Service (#13828)
* add support for vertex AI QWEN API

* streaming QWEN API support

* test_partner_models_httpx

* test_partner_models_httpx_streaming

* add cost tracking for vertex_ai/qwen/qwen3-235b-a22b-instruct-2507-maa

* docs qwen models vertexAI
2025-08-20 15:00:33 -07:00
Ishaan Jaff
e229a6a796 security fix 2025-08-20 08:35:59 -07:00
mubashir1osmani
ef9e50458d removed faq 2025-08-19 17:01:31 -04:00
mubashir1osmani
2edcc51e57 updated claude-code docs and deployment faq 2025-08-19 16:52:46 -04:00
Philip Kiely
7c3d522435 Update Baseten LiteLLM integration 2025-08-19 12:21:05 -07:00
Krish Dholakia
422447b7f1
Responses API - add default api version for openai responses api calls + Openrouter - fix claude-sonnet-4 on openrouter + Azure - Handle openai/v1/responses
Responses API - add default api version for openai responses api calls + Openrouter - fix claude-sonnet-4 on openrouter + Azure - Handle `openai/v1/responses`
2025-08-18 18:59:28 -07:00
Krrish Dholakia
0459604721 docs: document new param 2025-08-18 18:56:39 -07:00
Ishaan Jaff
ba0881d728
[Bug Fix] image_edit() function returns APIConnectionError with litellm_proxy - Support for both image edits and image generations (#13735)
* add image edits litellm proxy on SDK

* add image gen provider

* add IMG Gen support for litellm_proxy provider
2025-08-18 18:26:32 -07:00
Ishaan Jaff
eee93e250a docs v1.75.5-stable 2025-08-18 09:23:18 -07:00
TensorNull
159cfe5b4c
Merge branch 'BerriAI:main' into main 2025-08-18 09:46:12 +08:00
Krrish Dholakia
21549a3463 docs(index.md): write up on session management 2025-08-16 17:55:18 -07:00