Commit graph

5984 commits

Author SHA1 Message Date
Timothy Lowrimore
a9d4f45a10
Update docs/my-website/docs/providers/heroku.md
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-13 13:18:37 -06:00
Timothy Lowrimore
50de2a09e4
Update docs/my-website/docs/providers/heroku.md
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-13 13:18:26 -06:00
Timothy Lowrimore
fffe6cb6fb
Update docs/my-website/docs/providers/heroku.md
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-13 13:13:20 -06:00
Timothy Lowrimore
ede74a66d2
Update docs/my-website/docs/providers/heroku.md
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-13 13:13:11 -06:00
Jugal Bhatt
3990f61bed Refactor Anthropic Configurations and Add Support for anthropic_beta Headers
- Renamed `AmazonAnthropicClaude3Config` and `AmazonAnthropicClaude3MessagesConfig` to `AmazonAnthropicClaudeConfig` and `AmazonAnthropicClaudeMessagesConfig` respectively for consistency.
- Implemented `get_anthropic_beta_from_headers` function to extract and handle `anthropic-beta` headers across various transformations.
- Updated request transformations in `AmazonConverseConfig` and `AmazonInvokeConfig` to include `anthropic_beta` parameters based on user headers.
- Added tests to ensure proper handling of `anthropic_beta` headers in different scenarios.
2025-08-13 11:47:59 -07:00
Dor Zion
6a1f5bdc2f
Add Noma Security guardrail support 2025-08-13 13:39:21 +03:00
nielsbosma
f2b0b6124c feat(logging): add support for custom span names in Braintrust logging 2025-08-13 12:18:17 +02:00
TensorNull
8de6f0b3ce
Merge branch 'BerriAI:main' into main 2025-08-13 15:23:47 +08:00
Krish Dholakia
f00e891004
LiteLLM SDK <-> Proxy: support user param + Prisma - remove use_prisma_migrate flag - redundant as this is now default (#13555)
* fix(litellm_proxy/chat/transformation.py): support 'user' and all other openai chat completion params

Fixes issue where 'user' was not being sent in request to litellm proxy via sdk

* fix(prisma_migration.py): remove 'use_prisma_migrate' flag, is now default

* docs: cleanup docs

* fix(proxy_cli.py): remove --use_prisma_migrate flag

* refactor: remove references to use_prisma_migrate env var

This is now the default flow for db migrations
2025-08-12 22:03:39 -07:00
TensorNull
7cce327d09
Merge branch 'BerriAI:main' into main 2025-08-13 09:05:33 +08:00
Jorge Piedrahita Ortiz
6a77780c0e
Feat/sambanova embeddings (#13308)
* add sambanova embeddings

* fmt

* minor fix

* add sambanova embeddings call

* fmt

* include embeddings in sambanova docs

* add sambanova embeddigns unit test

* remove unused import

* minor fix

* fmt

* update sambanova embeding to inherit from BaseEmbeddingConfig

* fmt

* fmt

* hot fix

* fmt
2025-08-12 17:15:26 -07:00
Ishaan Jaff
828e3e3deb
[Feat] Add Streaming support + Docs for bedrock gpt-oss model family (#13346)
* add openai.gpt-oss-20b-1:0

* update BEDROCK_CONVERSE_MODELS

* openai.gpt-oss-20b-1:0 fixes

* fix PDF input

* fix for should_fake_stream

* TestBedrockGPTOSS

* should_fake_stream

* update supports vision field for openai.gpt-oss models

* fixes for bedrock gpt oss

* fixes for should_fake_stream

* docs bedrock gpt oss models
2025-08-12 08:39:36 -07:00
Timothy Lowrimore
bb259a651c removes extraneous heading from readme 2025-08-12 09:11:16 -06:00
Timothy Lowrimore
c0d82545d3
Merge branch 'main' into heroku-llms 2025-08-12 09:02:51 -06:00
Timothy Lowrimore
cccf41c0df
Update docs/my-website/docs/providers/heroku.md
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:46:48 -06:00
Timothy Lowrimore
1342abf163
Update docs/my-website/docs/providers/heroku.md
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:46:16 -06:00
Timothy Lowrimore
586c0a7be5
Update docs/my-website/docs/providers/heroku.md
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:45:47 -06:00
Timothy Lowrimore
7b0ecb1847
Update docs/my-website/docs/providers/heroku.md
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:45:36 -06:00
Timothy Lowrimore
d4e320a4ce
Update docs/my-website/docs/providers/heroku.md
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:45:21 -06:00
Timothy Lowrimore
5857d17fad
Update docs/my-website/docs/providers/heroku.md
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:45:06 -06:00
Timothy Lowrimore
3cfb85228f
Update docs/my-website/docs/providers/heroku.md
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:44:52 -06:00
Timothy Lowrimore
417b18a727
Update docs/my-website/docs/providers/heroku.md
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:42:46 -06:00
Timothy Lowrimore
fa587c2eba
Update docs/my-website/docs/providers/heroku.md
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:42:27 -06:00
Timothy Lowrimore
1be33ec47f
Update docs/my-website/docs/providers/heroku.md
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:41:38 -06:00
Timothy Lowrimore
00c9f1fe0e
Update docs/my-website/docs/providers/heroku.md
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:41:22 -06:00
Timothy Lowrimore
e97fa833b3
Update docs/my-website/docs/providers/heroku.md
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:41:08 -06:00
Timothy Lowrimore
b20b28a912
Update docs/my-website/docs/providers/heroku.md
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:40:54 -06:00
Timothy Lowrimore
e2165ff76e
Update docs/my-website/docs/providers/heroku.md
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:40:43 -06:00
TensorNull
fa81c20df6 fix: Remove outdated models from the model list in the CometAPI document 2025-08-12 17:28:10 +08:00
TensorNull
8b602f9507 [Feat] - Add CometAPI documentation with authentication, usage examples, and error handling 2025-08-12 17:18:33 +08:00
Ishaan Jaff
49ca4dc792
Sending tags to LiteLLM Proxy (#13517) 2025-08-11 17:58:50 -07:00
Ishaan Jaff
9f78287000
[Bug Fix]: Azure OpenAI GPT-5 max_tokens + reasoning param support (#13510)
* add AzureOpenAIGPT5Config

* add AzureOpenAIGPT5Config

* add AzureOpenAIGPT5Config

* add AzureOpenAIGPT5Config

* test_azure_gpt5_supports_reasoning_effort

* test_azure_gpt5_reasoning

* test_azure_gpt5_reasoning

* ruff check fixes

* docs azure gpt5
2025-08-11 15:40:53 -07:00
Timothy Lowrimore
95d9e30448
Merge branch 'main' into heroku-llms 2025-08-11 09:45:52 -06:00
Krrish Dholakia
bd8a0ae0d0 docs: fix order 2025-08-10 09:42:55 -07:00
Krrish Dholakia
1dbac75675 docs(index.md): update release with deployment information 2025-08-10 09:31:28 -07:00
Krish Dholakia
c742c76288
Litellm release notes 08 10 2025 (#13479)
* docs(index.md): initial doc

* build(index.md): initial notes

* docs(index.md): add llm translation tickets

* docs(index.md): document new model support

* docs(index.md): document all pricing changes

* docs(index.md): add llm api endpoints

* docs(index.md): add doc on mcp gateway

* docs(index.md): add all remaining rc notes

* docs(index.md): cleanup
2025-08-10 07:32:11 -07:00
Krish Dholakia
9f6f96d76c
Litellm dev 08 07 2025 p1 (#13418)
* fix(router.py): support base model for model group usage

allows model group info to show accurate cost information for azure models

* fix(router.py): fix changes

* test: add unit tests

* build(pyproject.toml): bump openai version requirements

support custom tool from responses api

 Closes https://github.com/BerriAI/litellm/issues/13391

* docs(responses_api.md): add verbosity + free-form function calling parameters

* docs(responses_api.md): add cfg + minimal reasoning to docs

Closes https://github.com/BerriAI/litellm/issues/13391

* docs(responses_api.md): add proxy examples to docs

* refactor: fix ruff error
2025-08-09 16:30:04 -07:00
Sannan Nasir
0e53b1feab
Add digitalocean provider (#12169)
* Add digitalocean provider

* Add digitalocean provider

* Revert "Add digitalocean provider"

This reverts commit 96dda40f45.

* changes

* fixes

* Update transformation

* refactoring

* rename provider to Gradient AI

* fixes

* Incorporte review comments

* revert changes

* fix typo

* revert change

* incorporated review comments

* Revert "Incorporte review comments"

This reverts commit 37bd51bd54.

* changes

* Revert "Revert "Incorporte review comments"

This reverts commit 37bd51bd54ef4fd52ccc12866e47f8de9476d597."

This reverts commit 68c8a198ee.

* changes

* fixes

* Update provider_specific_fields.tsx
2025-08-09 16:26:33 -07:00
Ishaan Jaff
ee40db7b31 docs native litellm prompts 2025-08-09 09:46:31 -07:00
Ishaan Jaff
94c33200a4
docs - native prompt mgmt (#13463) 2025-08-09 09:39:16 -07:00
Ishaan Jaff
3999e65a97 docs update 2025-08-09 09:24:41 -07:00
Jugal D. Bhatt
035e5497e0
added mcp guardrails doc in mcp.md (#13452) 2025-08-08 22:47:31 -07:00
Ishaan Jaff
7e2a00c848
[Docs] Add docs on how router / cooldowns work (#13444)
* add theme-mermaid

* docs cool down

* docs cooldown
2025-08-08 15:13:37 -07:00
Jugal D. Bhatt
3410b293d7
Add presidio docs (#13392) 2025-08-07 16:40:07 -07:00
Ishaan Jaff
2037037258
[Bug Fix] OpenAI gpt-5 series does not support "max_tokens" parameter and temperature values that are not = 1 (#13390)
* add OpenAIGPT5Config

* add map_openai_params for gpt5

* add OpenAIGPT5Config

* add OpenAI gpt 5 transform

* docs gpt 5 openai
2025-08-07 16:35:00 -07:00
Timothy Lowrimore
d3809a7813
Merge branch 'main' into heroku-llms 2025-08-07 11:06:24 -06:00
breno-aumo
e8b4b25774
Update OCI docs (#13336)
* add oci models to model_prices_and_context_window.json

* remove unsupported and unavailable oci models from docs
2025-08-07 09:45:17 -07:00
Edward D'Amato
30fc5b871c
feat(integrations): allow setting of braintrust callback base url (#13368)
* feat(integrations): allow setting of braintrust callback base url

* chore(misc): remove extra additions due to merge
2025-08-07 08:40:11 -07:00
Timothy Lowrimore
1b2dc23e7a
Merge branch 'main' into heroku-llms 2025-08-06 10:11:52 -06:00
Ishaan Jaff
50c4a32c7d docs claude-opus-4-1-20250805 2025-08-05 18:02:22 -07:00