Commit graph

3532 commits

Author SHA1 Message Date
Ishaan Jaff
643d2a8ccb
[Feat] Option to force/always use the litellm proxy (#10559) (#10633) (#10773)
* [Feat] Option to force/always use the litellm proxy (#10559) (#10633)

* fix: add use_litellm_proxy

* fix: update LiteLLMProxyChatConfig

* fix get llm provider logic

* tests get llm provider logic

* add dynamic use_litellm_proxy

* docs forcsing litellm proxy usage

* fix: _should_use_litellm_proxy_by_default

* fixes: get_custom_llm_provider

---------

Co-authored-by: Antoine Legrand <2t.antoine@gmail.com>
2025-05-12 20:22:54 -07:00
Oscar Savolainen
75135ac884
Update Nscale model providers to point to website (#10764)
* Instead of listing models and pricing, we provide a link to our website. We also highlight our free credits.

* Add all models supported tip to top of NScale README

* add space

---------

Co-authored-by: Oscar Savolainen <oscar.savolainen@enscale.com>
2025-05-12 17:10:39 -07:00
Ishaan Jaff
2cc4a87861
[Docs] Using litellm with Google ADK (#10777)
* docs litellm ADK usage

* docs litellm google adk

* docs litellm ADK

* docs litellm with ADK usage examples

* docs litellm proxy with ADK

* cookbook litellm ADK
2025-05-12 16:41:49 -07:00
Krrish Dholakia
0d6efff312 docs: update change on docs 2025-05-10 23:59:40 -07:00
Ishaan Jaff
8bcd5b6094 docs fix order 2025-05-10 23:16:51 -07:00
Ishaan Jaff
e439cdcb9b docs release notes 2025-05-10 23:02:21 -07:00
Ishaan Jaff
97e23f9c03 docs email notifs 2.0 2025-05-10 23:00:20 -07:00
Ishaan Jaff
af201d7c5d docs release notes 2025-05-10 22:48:58 -07:00
Ishaan Jaff
b42c32fae5 docs - stable release 2025-05-10 22:35:05 -07:00
Ishaan Jaff
5764ae5b7c docs release notes 2025-05-10 19:35:01 -07:00
Ishaan Jaff
cba56a8cc1 docs anthropic unified 2025-05-10 17:29:06 -07:00
Ishaan Jaff
9a481c1c05 docs email notifs 2025-05-10 17:27:09 -07:00
Ishaan Jaff
7942f6f595
[Docs] Email notifs (#10733)
* docs emails

* docs email notifs
2025-05-10 17:24:18 -07:00
Ishaan Jaff
037b2f9033 docs complete release note 2025-05-10 17:11:17 -07:00
Ishaan Jaff
893c149f45 docs complete ui, spend management fixes 2025-05-10 17:11:07 -07:00
Ishaan Jaff
e81af78b07 complete Management Endpoints / UI 2025-05-10 17:10:58 -07:00
Ishaan Jaff
c4074ec7a1 docs Logging / Guardrail Integrations 2025-05-10 17:10:43 -07:00
Ishaan Jaff
d087aa1620
[Docs] v1.69.0-stable (#10731)
* docs init 1.69.0-stable

* (docs): New Models / Updated Models

* docs completed apis and new models
2025-05-10 16:31:36 -07:00
Krrish Dholakia
10ce3b478d docs(managed_batches.md): clarify cancel batches is coming soon 2025-05-10 16:29:44 -07:00
Krrish Dholakia
b13ed6b860 docs(litellm_managed_files.md): cleanup 2025-05-10 11:55:12 -07:00
Krrish Dholakia
5c0b972135 docs(managed_batches.md): add line numbers to code examples 2025-05-10 11:54:17 -07:00
Krrish Dholakia
3ec8a394a6 docs(managed_batches.md): file cleanup 2025-05-10 11:52:39 -07:00
Krrish Dholakia
990d6f5c93 docs(managed_batches.md): add docs on unified file id with batches 2025-05-10 11:28:24 -07:00
Marc Abramowitz
3787aa27b0
Add management client docs (#10703)
* Add management client docs

* Docs enhancements

* Add "proxy/management_cli" to sidebar

* Small formatting changes

* Add overview table

* Wrap long line

* Add "Quick Start" section

* Document uv tool upgrade and uninstall

* Add blank lines to eliminate yellow squigglies in VS Code

* For each section link to section on swagger used

* Wrap some long command examples

* Break long http request command on to multiple lines
2025-05-09 18:59:24 -07:00
Tom Matthews
e2a9cd0c75
Add nscale support for streaming (#10698) 2025-05-09 11:39:23 -07:00
GPTLocalhost (Word Add-in)
86f19d2fae
Add GPTLocalhost to "docs/my-website/docs/projects" (#10687)
* Create GPTLocalhost.md

* Update sidebars.js
2025-05-09 07:44:48 -07:00
Tom Matthews
ff279faf35
Add support for Nscale (EU-Sovereign) Provider (#10638)
* Add support for nscale provider

* Add image generation support and fix unit tests

* Add docs for nscale

* Fix unit test import issues

* Minor doc improvement

* Remove redundant null tokens from model cost map

* Address PR review comments for doc updates

* Revert changes to large text
2025-05-08 08:50:15 -07:00
Ishaan Jaff
6a3ea83b23
[Feat] Bedrock Guardrails - Add support for PII Masking with bedrock guardrails (#10642)
* allow defining mask_request_content for guardrails

* allow pii masking with bedrock

* implement bedrock pre call hook

* docs bedrock pii masking

* fix linting error

* fix code quality checks
2025-05-07 18:30:57 -07:00
Thom Lane
5f47df4627
Update instructor.md (#10549)
Simplified examples
2025-05-05 21:15:53 -07:00
Krrish Dholakia
9ae239b3e1 docs(index.md): add graphic 2025-05-05 20:49:47 -07:00
Ishaan Jaff
489f1a6c25
[Feat] v2 Custom Logger API Endpoints (#10575)
* fixes for generic api logger

* tests for generic api logger

* test_generic_api_callback_multiple_logs

* allow health checking generic api endpoints

* docs generic api endpoint for logging

* allow setting headers for generic api  callback

* fix for test_init_custom_logger_compatible_class_as_callback

* fix linting
2025-05-05 16:57:55 -07:00
Young Han
b1e28a3bc4
[Docs] Change llama-api link for litellm (#10556)
* docs: change llama-api link for litellm

* docs: init supported models table
2025-05-05 12:37:37 -07:00
Krrish Dholakia
914ab00805 docs(index.md): add key highlights to docs 2025-05-03 22:04:22 -07:00
Ishaan Jaff
bccab23a6a add vector stores to release note 2025-05-03 21:51:03 -07:00
Krrish Dholakia
3f09da21e3 docs(meta_llama.md): clarify meta llama works on responses api 2025-05-03 21:41:00 -07:00
Ishaan Jaff
8aa57ff0c0 add meta llma api to release notes 2025-05-03 21:00:22 -07:00
Ishaan Jaff
f52593486c
[Contributor PR] Support Llama-api as an LLM provider (#10451) (#10538)
* Support Llama-api as an LLM provider (#10451)

* init: support llama-api as a llm provider

* docs: fix endpoint url

* fix: rename meta dir to meta-llama

* docs: add meta-llama info

* fix: mv LlamaAPIConfig under chat directory

* feat: add LlamaAPIConfig in ProviderConfigManager

* fix: provider_config from ProviderConfigManager

* feat: add supports_tool_choice param

* fix: remove optional_params using model_info

* fix: rename meta-llama to meta_llama

* init: test for meta_llama

* fix: model names

---------

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>

* fix file naming convention

* fix file naming convention for meta_llama

* docs meta llama api litellm

---------

Co-authored-by: Young Han <110819238+seyeong-han@users.noreply.github.com>
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
2025-05-03 16:29:03 -07:00
Krish Dholakia
7ce687ef39
Litellm stable release notes 05 03 2025 (#10536)
* build(release_cycle.md): document bar for minor vs. patch updates

* docs(index.md): initial changelog doc

* docs(index.md): update llama docs

* docs(index.md): add docs for llm api endpoints + spend tracking/budget improvements

* docs: more doc cleanup

* docs(index.md): more doc cleanup

* docs(index.md): final doc cleanup
2025-05-03 12:47:11 -07:00
Ishaan Jaff
ee8aa23c19 docs VectorStoreRegistry 2025-05-03 12:05:49 -07:00
Ishaan Jaff
42ea608b4b docs add section on bedrock provider to show how to use KBs 2025-05-03 11:55:16 -07:00
Ishaan Jaff
a37e4cb0b8
fix typo (#10535) 2025-05-03 11:39:40 -07:00
Ishaan Jaff
071c8a2e26
[Docs] Using LiteLLM with vector stores / knowledge bases (#10534)
* docs vector store registry

* img for kbs

* docs kb with litellm

* fix code qa
2025-05-03 11:28:33 -07:00
user202729
2138170861
Update contributing-to-documentation documentation to include pnpm guide (#10523) 2025-05-03 10:22:50 -07:00
Kevin Montoya
38d1691e20
docs(realtime): yaml config example for realtime model (#10489)
documentation includes outdated example of configuration of realtime
model that does not comply with current healthcheck:
https://github.com/BerriAI/litellm/pull/7453. Provide proper model info
mode in example
2025-05-01 21:43:48 -07:00
Parham Alvani
d7632ca56e
Update mcp.md (#10493) 2025-05-01 20:54:27 -07:00
Ishaan Jaff
de7870cb54
Add llamafile as a provider (#10203) (#10482)
* Update docs for OpenAI compatible providers, add Llamafile docs, include Llamafile in the sidebar

* Add Llamafile as an LlmProviders enum

* Add llamafile as a OpenAI compatible provider (in the list of compatible providers)

* Add Llamafile chat config and tests

* Wire up Llamafile

Co-authored-by: Peter Wilson <peter@mozilla.ai>
2025-05-01 18:36:55 -07:00
Krrish Dholakia
dd5edbc9b6 docs(config_settings.md): document new param 2025-05-01 15:20:33 -07:00
Krrish Dholakia
03718b8b76 docs(prod.md): clarify usage on read-only file system 2025-05-01 14:46:02 -07:00
Krrish Dholakia
c5b2d4a529 docs(document_understanding.md): clarify 'format' param usage 2025-05-01 14:34:16 -07:00
Ishaan Jaff
be885e4a17
[Feat] Vector Stores/KnowledgeBases - Allow defining Vector Store Configs (#10448)
* init vector store configs

* working kb init

* add vector store endpoints

* use litellm_credential_name

* working CRUD vector stores litellm

* working creds with vector DB

* ui cleanup

* clean up vector store id

* fix delete button

* refactored vector store component

* working selector for KBs

* ui vector stores

* add vector store tool calls usage on chat ui

* fixes for vector stores litellm

* test fix

* docs Knowledge Bases

* fixes for vector stores litellm

* fix linting

* add managed vectorstores

* fix orjson ci/cd test

* fix linting

* add types.tsx file
2025-04-30 21:49:59 -07:00