Commit graph

5592 commits

Author SHA1 Message Date
Ishaan Jaff
52bbabd788
[Feat] Support for Vertex AI Gemma Models on Custom Endpoints (#15397)
* TestVertexGemmaiCompletion

* test vertex Gemma

* fix file name

* fix file naming

* add VertexAIGemmaModels

* add cost_router for vertexai

* fix main.py

* fix VertexGemmaConfig

* fix Vertex AI Gemma-AI Models Handler

* docs gemma

* fix ids

* test fix

* ruff check fixes

* docs fix

* docs fix
2025-10-09 19:20:02 -07:00
Ishaan Jaffer
be587363f3 docs fix 2025-10-09 16:28:38 -07:00
Ishaan Jaff
6cf57d85c3
[Feat] Add EnkryptAI Guardrails on LiteLLM (#15390)
* feat: add EnkryptAIGuardrail

* fix types

* fix EnkryptAIGuardrails

* __all__ = ["EnkryptAIGuardrail"]
fix

* fix EnkryptAIGuardrail

* TestEnkryptAIExtraction

* fix mypy linting

* docs enkrypt ai

* add EnkryptAIGuardrailConfigModel

* fix EnkryptAIGuardrailConfigModel

* fix import struct

* fix EnkryptAIGuardrails
2025-10-09 16:27:04 -07:00
Anubhav Singh
f59f1971cc
Merge branch 'BerriAI:main' into wandb-inference-docs 2025-10-09 22:26:37 +05:30
Sameer Kankute
dce6cd1051 Add shared healthcheck 2025-10-09 22:18:05 +05:30
Carlos Marchal
dd560f792e
feat: posthog per request api key 2025-10-09 18:32:11 +02:00
Krrish Dholakia
f88e3ebdfa docs: refactor to have function call / computer use / etc. on top level 2025-10-09 07:25:25 -07:00
Krish Dholakia
a02b3caef3
Merge branch 'main' into litellm_dev_10_08_2025_p2 2025-10-08 19:27:24 -07:00
Krrish Dholakia
e2b7b05774 docs(mcp.md): document new openapi to mcp tool support 2025-10-08 19:16:22 -07:00
Krish Dholakia
8cbc85578e
Merge pull request #15351 from BerriAI/litellm_dev_10_08_2025_p3
SSO - support EntraID app roles
2025-10-08 19:04:00 -07:00
Krrish Dholakia
697f99c1d5 docs: doc improvements 2025-10-08 18:59:00 -07:00
Krrish Dholakia
8eafb7a8fa docs: doc improvements 2025-10-08 18:50:42 -07:00
Krrish Dholakia
ff3f356416 docs(docs/): add app role support to docs 2025-10-08 18:46:28 -07:00
Krrish Dholakia
c97495c5d9 docs(mcp.md): document new allow/disallow tool parameters functionality 2025-10-08 17:39:42 -07:00
Pierre-Emmanuel MERCIER
861750790b feat: add redis ssl and username support (#11319) 2025-10-08 16:48:07 -07:00
Krish Dholakia
3f4d2c6ada
Add Cohere Embed v4 support for AWS Bedrock
Add Cohere Embed v4 support for AWS Bedrock
2025-10-07 19:10:22 -07:00
Ishaan Jaffer
a8243079d3 doc fix 2025-10-07 18:51:27 -07:00
Ishaan Jaff
36c971a6fd
[MCP Gateway] QA/Fixes - Ensure Team/Key level enforcement works for MCPs (#15305)
* fix: _set_object_permission

* fix: _set_object_permission on teams

* fix: _set_object_permission

* fixes for team/key permissions

* statsh: object permission view

* fix: MCPServerPermissions

* fix: _get_team_object_permission

* test mcp checks for permissions

* fix server checks with prefix names

* test_list_tools_strips_prefix_when_matching_permissions

* ruff fix

* docs - refactor MCP

* docs update MCP docs

* docs allowed tools
2025-10-07 17:34:48 -07:00
Tim Elfrink
d71d801e4d Add Cohere Embed v4 support for AWS Bedrock
- Add cohere.embed-v4:0 to model pricing configs
- Update bedrock_embedding_models constant
- Update documentation with v4 model support

Fixes #15272
2025-10-07 22:08:12 +02:00
Sameer Kankute
c0d0424eb8
Added streaming support for response api streaming image generation (#15269) 2025-10-07 08:15:57 -07:00
xprilion
3e52079509 Add information about personal entities error 2025-10-07 20:10:38 +05:30
xprilion
888391127f Add W&B Inference documentation 2025-10-07 19:18:45 +05:30
Krrish Dholakia
faeb7484db docs(vertex.md): fix doc 2025-10-06 20:45:58 -07:00
Krish Dholakia
8b357c24c2
Merge pull request #15226 from otaviofbrito/chore/vertex-ai-context-caching
Chore/vertex ai context caching
2025-10-06 20:05:24 -07:00
Teddy Amkie
1ad4ef267d
Add GPT-5 Pro model configuration and documentation (#15258)
- Added gpt-5-pro entry to model_prices_and_context_window.json with complete specifications
- Mode: responses (Responses API only)
- Pricing: $15.00 input / $120.00 output (Standard), $7.50 input / $60.00 output (Batch)
- Context: 400,000 input tokens, 272,000 output tokens
- Endpoints: /v1/batch, /v1/responses only
- Features: Web Search, Function Calling, Vision, PDF Input, Prompt Caching, Reasoning
- No streaming support, no Code Interpreter, no Computer Use

- Added gpt-5-pro to supported models list in docs/my-website/src/pages/completion/supported.md
- Added gpt-5-pro to OpenAI provider documentation in docs/my-website/docs/providers/openai.md
- Added comprehensive GPT-5 Pro Special Notes section with usage examples and limitations
2025-10-06 19:43:40 -07:00
Ishaan Jaff
1d468a59f3
[MCP Gateway] Fine-grained Database Object Storage Control (#15255)
* add supported_db_objects

* add _should_load_db_object

* add docs on storing MCP objects in DB

* test_should_load_db_object_with_supported_db_objects

* type fix
2025-10-06 19:31:44 -07:00
Krrish Dholakia
fbf7ca17ba docs(security_encryption_faq.md): answers common questions about data at rest vs. in transit 2025-10-06 17:34:10 -07:00
Otavio Brito
b2a734c1f8 fix ttl tests 2025-10-06 09:30:23 -03:00
Otavio Brito
251d56ba5e update docs 2025-10-05 23:47:24 -03:00
Ishaan Jaffer
b348a26bdc docs fix 2025-10-04 18:32:45 -07:00
Ishaan Jaffer
b2dd50dd3e docs key rotations 2025-10-04 18:29:01 -07:00
Ishaan Jaffer
e58c2c5c3e docs fix 2025-10-04 18:13:08 -07:00
Ishaan Jaffer
163416c683 docs fix 2025-10-04 18:12:47 -07:00
Ishaan Jaffer
6cf1806d3b docs fix 2025-10-04 18:12:20 -07:00
Ishaan Jaffer
bd2559e65e docs fix 2025-10-04 18:11:58 -07:00
Ishaan Jaffer
525b86687c fix 1.77.7 stable 2025-10-04 18:11:01 -07:00
Ishaan Jaffer
4e88e21266 docs fix 2025-10-04 18:04:11 -07:00
Ishaan Jaffer
93022361e6 docs fix 2025-10-04 18:03:04 -07:00
Ishaan Jaffer
d12da2e56e docs fix 2025-10-04 18:02:04 -07:00
Alexsander Hamir
9d6c06dc7a
doc: perf update (#15211) 2025-10-04 17:59:08 -07:00
Ishaan Jaffer
02cb7a4c3b docs fix 2025-10-04 17:29:06 -07:00
Ishaan Jaffer
8c495590b1 doc improvement 2025-10-04 17:21:41 -07:00
Ishaan Jaffer
553801c7b4 docs 2025-10-04 17:21:00 -07:00
Krrish Dholakia
b7ca138a8d docs(prometheus.md): fix 2025-10-04 16:23:54 -07:00
Krrish Dholakia
8dc53c0438 docs: document updates 2025-10-04 16:06:18 -07:00
Ishaan Jaff
cb385e080f
Fix "azure_ai/grok-4-fast-reasoning" entry in "model_prices_and_context_window.json" (#15204)
* fix: azure_ai/grok-4-fast-non-reasoning

* fix pricing
2025-10-04 14:50:44 -07:00
Ishaan Jaffer
e1ee428573 docs fix 2025-10-04 13:20:39 -07:00
Ishaan Jaffer
685e027d94 docs Dynamic Rate Limiter v3 2025-10-04 13:19:17 -07:00
Ishaan Jaffer
c947994239 docs fix notes 2025-10-04 13:16:15 -07:00
Ishaan Jaffer
22b6a82105 docs fix 2025-10-04 13:10:27 -07:00