Ishaan Jaff
f6e0ef4ee7
[Docs] Key Rotations ( #15455 )
...
* docs keys
* docs key r
2025-10-11 13:24:47 -07:00
Ishaan Jaffer
0cde6a2843
docs key rotations
2025-10-11 13:10:17 -07:00
Krish Dholakia
07ba5c1ea9
Merge branch 'main' into litellm_dev_10_10_2025_p3
2025-10-11 12:58:53 -07:00
Krish Dholakia
88000d09bf
Merge pull request #15454 from BerriAI/litellm_ui_qa_10_11_2025
...
docs: cleanup docs + build ui
2025-10-11 12:54:37 -07:00
Ishaan Jaffer
8292b27073
docs fix
2025-10-11 12:15:30 -07:00
Ishaan Jaff
d45dfa899b
[Docs] v1.78.0-stable ( #15452 )
...
* docs fix
* docs fix
2025-10-11 12:12:41 -07:00
Krrish Dholakia
c03c66266e
docs: cleanup docs
2025-10-11 11:05:55 -07:00
Ishaan Jaffer
698c0b219c
test code QA checks
2025-10-11 08:41:56 -07:00
Ishaan Jaffer
5377b17bdd
doc fix
2025-10-10 19:55:02 -07:00
Ishaan Jaff
527c8f59fa
[Feat] Tag Management - Add support for setting tag based budgets ( #15433 )
...
* feat: add LiteLLM_TagTable
* fix: use new table for tag management
* fix - allow setting budgets for tags
* working tag creation
* fix schema.prisma
* add tag info
* ui fixes
* ui fix tag info
* TAG_CACHE_IN_MEMORY_TTL_SECONDS
* add Litellm_EntityType
* fix get_aggregated_db_spend_update_transactions
* fix: _update_entity_spend_in_db
* fix _tag_max_budget_check
* add tag budget check
* add tag_list_transactions
* test_get_tag_objects_batch
* test_update_tag_db_without_prisma_client
* fix get_tags_from_request_body
* get_tags_from_request_body
* fix get_tags_from_request_body
* fix spend tracking utils
* get_tags_from_request_body
* test_get_tags_from_request_body_with_metadata_tags
* feat: add _update_tag_cache spend tracking
* fix _PROXY_track_cost_callback
* test_tag_cache_update_multiple_tags
* fix tag info
* docs fix
* docs tag budgets
* doc fix
* docs fix
* fix tag budget
* docs tag budgets
* docs fix
* ruff fix
2025-10-10 19:24:50 -07:00
Krrish Dholakia
144ea09549
docs(openai.md): document how to get reasoning content for gpt-5 models
2025-10-10 18:42:19 -07:00
Ishaan Jaff
bf209415da
[Feat] VertexAI Gemma model family streaming support + Added MedGemma ( #15427 )
...
* test_acompletion_filters_stream_and_stream_options
* fix: stream_options
* docs medgemma
* lint fix
* docs
2025-10-10 14:22:27 -07:00
Sameer Kankute
a2123f7596
fix lint errors ( #15406 )
...
* fix lint errors
* fix mypy error
* Update docs error
2025-10-10 14:16:23 -07:00
Sameer Kankute
513925fd12
Add OCI Cohere support with tool calling and streaming capabilities ( #15365 )
...
* Add cohere models for OCI integration
* fix mypy error
2025-10-10 11:20:18 -07:00
Krish Dholakia
d944717d4b
Merge pull request #15278 from xprilion/wandb-inference-docs
...
Add W&B Inference documentation
2025-10-09 22:35:16 -07:00
Krish Dholakia
611a876889
Merge pull request #15380 from BerriAI/litellm_shared_heatlh_status
...
Implement Shared Health Check State Across Pods
2025-10-09 22:25:45 -07:00
Krish Dholakia
e1e1ea31dc
Merge pull request #15379 from PostHog/feat/posthog-per-request-api-key
...
feat: posthog per request api key
2025-10-09 22:24:51 -07:00
Alexsander Hamir
1c7463f42f
[Perf]: optimize SSL/TLS handshake performance with prioritized cipher ( #15398 )
...
* perf: optimize SSL/TLS handshake performance with prioritized cipher suites
Add configurable SSL cipher suite list that strongly prefers fast modern
ciphers (TLS 1.3, ECDHE+GCM) while maintaining backward compatibility with
widely-supported fallback ciphers. Set minimum TLS version to 1.2 for
better performance.
Changes:
- Add DEFAULT_SSL_CIPHERS constant with prioritized cipher list
(configurable via LITELLM_SSL_CIPHERS env var)
- Update get_ssl_configuration() to apply optimized ciphers by default
- Set TLS minimum version to 1.2
- Preserve existing ssl_security_level parameter for custom configs
This balances handshake performance (~50-100ms with modern ciphers) with
broad provider compatibility.
* fix: missing documented constants
2025-10-09 19:21:37 -07:00
Ishaan Jaff
52bbabd788
[Feat] Support for Vertex AI Gemma Models on Custom Endpoints ( #15397 )
...
* TestVertexGemmaiCompletion
* test vertex Gemma
* fix file name
* fix file naming
* add VertexAIGemmaModels
* add cost_router for vertexai
* fix main.py
* fix VertexGemmaConfig
* fix Vertex AI Gemma-AI Models Handler
* docs gemma
* fix ids
* test fix
* ruff check fixes
* docs fix
* docs fix
2025-10-09 19:20:02 -07:00
Ishaan Jaffer
be587363f3
docs fix
2025-10-09 16:28:38 -07:00
Ishaan Jaff
6cf57d85c3
[Feat] Add EnkryptAI Guardrails on LiteLLM ( #15390 )
...
* feat: add EnkryptAIGuardrail
* fix types
* fix EnkryptAIGuardrails
* __all__ = ["EnkryptAIGuardrail"]
fix
* fix EnkryptAIGuardrail
* TestEnkryptAIExtraction
* fix mypy linting
* docs enkrypt ai
* add EnkryptAIGuardrailConfigModel
* fix EnkryptAIGuardrailConfigModel
* fix import struct
* fix EnkryptAIGuardrails
2025-10-09 16:27:04 -07:00
Anubhav Singh
f59f1971cc
Merge branch 'BerriAI:main' into wandb-inference-docs
2025-10-09 22:26:37 +05:30
Sameer Kankute
dce6cd1051
Add shared healthcheck
2025-10-09 22:18:05 +05:30
Carlos Marchal
dd560f792e
feat: posthog per request api key
2025-10-09 18:32:11 +02:00
Krrish Dholakia
f88e3ebdfa
docs: refactor to have function call / computer use / etc. on top level
2025-10-09 07:25:25 -07:00
Krish Dholakia
a02b3caef3
Merge branch 'main' into litellm_dev_10_08_2025_p2
2025-10-08 19:27:24 -07:00
Krrish Dholakia
e2b7b05774
docs(mcp.md): document new openapi to mcp tool support
2025-10-08 19:16:22 -07:00
Krish Dholakia
8cbc85578e
Merge pull request #15351 from BerriAI/litellm_dev_10_08_2025_p3
...
SSO - support EntraID app roles
2025-10-08 19:04:00 -07:00
Krrish Dholakia
697f99c1d5
docs: doc improvements
2025-10-08 18:59:00 -07:00
Krrish Dholakia
8eafb7a8fa
docs: doc improvements
2025-10-08 18:50:42 -07:00
Krrish Dholakia
ff3f356416
docs(docs/): add app role support to docs
2025-10-08 18:46:28 -07:00
Krrish Dholakia
c97495c5d9
docs(mcp.md): document new allow/disallow tool parameters functionality
2025-10-08 17:39:42 -07:00
Pierre-Emmanuel MERCIER
861750790b
feat: add redis ssl and username support ( #11319 )
2025-10-08 16:48:07 -07:00
Krish Dholakia
3f4d2c6ada
Add Cohere Embed v4 support for AWS Bedrock
...
Add Cohere Embed v4 support for AWS Bedrock
2025-10-07 19:10:22 -07:00
Ishaan Jaffer
a8243079d3
doc fix
2025-10-07 18:51:27 -07:00
Ishaan Jaff
36c971a6fd
[MCP Gateway] QA/Fixes - Ensure Team/Key level enforcement works for MCPs ( #15305 )
...
* fix: _set_object_permission
* fix: _set_object_permission on teams
* fix: _set_object_permission
* fixes for team/key permissions
* statsh: object permission view
* fix: MCPServerPermissions
* fix: _get_team_object_permission
* test mcp checks for permissions
* fix server checks with prefix names
* test_list_tools_strips_prefix_when_matching_permissions
* ruff fix
* docs - refactor MCP
* docs update MCP docs
* docs allowed tools
2025-10-07 17:34:48 -07:00
Tim Elfrink
d71d801e4d
Add Cohere Embed v4 support for AWS Bedrock
...
- Add cohere.embed-v4:0 to model pricing configs
- Update bedrock_embedding_models constant
- Update documentation with v4 model support
Fixes #15272
2025-10-07 22:08:12 +02:00
Sameer Kankute
c0d0424eb8
Added streaming support for response api streaming image generation ( #15269 )
2025-10-07 08:15:57 -07:00
xprilion
3e52079509
Add information about personal entities error
2025-10-07 20:10:38 +05:30
xprilion
888391127f
Add W&B Inference documentation
2025-10-07 19:18:45 +05:30
Krrish Dholakia
faeb7484db
docs(vertex.md): fix doc
2025-10-06 20:45:58 -07:00
Krish Dholakia
8b357c24c2
Merge pull request #15226 from otaviofbrito/chore/vertex-ai-context-caching
...
Chore/vertex ai context caching
2025-10-06 20:05:24 -07:00
Teddy Amkie
1ad4ef267d
Add GPT-5 Pro model configuration and documentation ( #15258 )
...
- Added gpt-5-pro entry to model_prices_and_context_window.json with complete specifications
- Mode: responses (Responses API only)
- Pricing: $15.00 input / $120.00 output (Standard), $7.50 input / $60.00 output (Batch)
- Context: 400,000 input tokens, 272,000 output tokens
- Endpoints: /v1/batch, /v1/responses only
- Features: Web Search, Function Calling, Vision, PDF Input, Prompt Caching, Reasoning
- No streaming support, no Code Interpreter, no Computer Use
- Added gpt-5-pro to supported models list in docs/my-website/src/pages/completion/supported.md
- Added gpt-5-pro to OpenAI provider documentation in docs/my-website/docs/providers/openai.md
- Added comprehensive GPT-5 Pro Special Notes section with usage examples and limitations
2025-10-06 19:43:40 -07:00
Ishaan Jaff
1d468a59f3
[MCP Gateway] Fine-grained Database Object Storage Control ( #15255 )
...
* add supported_db_objects
* add _should_load_db_object
* add docs on storing MCP objects in DB
* test_should_load_db_object_with_supported_db_objects
* type fix
2025-10-06 19:31:44 -07:00
Krrish Dholakia
fbf7ca17ba
docs(security_encryption_faq.md): answers common questions about data at rest vs. in transit
2025-10-06 17:34:10 -07:00
Otavio Brito
b2a734c1f8
fix ttl tests
2025-10-06 09:30:23 -03:00
Otavio Brito
251d56ba5e
update docs
2025-10-05 23:47:24 -03:00
Ishaan Jaffer
b348a26bdc
docs fix
2025-10-04 18:32:45 -07:00
Ishaan Jaffer
b2dd50dd3e
docs key rotations
2025-10-04 18:29:01 -07:00
Ishaan Jaffer
e58c2c5c3e
docs fix
2025-10-04 18:13:08 -07:00
