litellm/docs/my-website/docs/proxy
Krish Dholakia 859b47f08b
LiteLLM Minor Fixes & Improvements (11/29/2024) (#6965)
* fix(factory.py): ensure tool call converts image url

Fixes https://github.com/BerriAI/litellm/issues/6953

* fix(transformation.py): support mp4 + pdf url's for vertex ai

Fixes https://github.com/BerriAI/litellm/issues/6936

* fix(http_handler.py): mask gemini api key in error logs

Fixes https://github.com/BerriAI/litellm/issues/6963

* docs(prometheus.md): update prometheus FAQs

* feat(auth_checks.py): ensure specific model access > wildcard model access

if wildcard model is in access group, but specific model is not - deny access

* fix(auth_checks.py): handle auth checks for team based model access groups

handles scenario where model access group used for wildcard models

* fix(internal_user_endpoints.py): support adding guardrails on `/user/update`

Fixes https://github.com/BerriAI/litellm/issues/6942

* fix(key_management_endpoints.py): fix prepare_metadata_fields helper

* fix: fix tests

* build(requirements.txt): bump openai dep version

fixes proxies argument

* test: fix tests

* fix(http_handler.py): fix error message masking

* fix(bedrock_guardrails.py): pass in prepped data

* test: fix test

* test: fix nvidia nim test

* fix(http_handler.py): return original response headers

* fix: revert maskedhttpstatuserror

* test: update tests

* test: cleanup test

* fix(key_management_endpoints.py): fix metadata field update logic

* fix(key_management_endpoints.py): maintain initial order of guardrails in key update

* fix(key_management_endpoints.py): handle prepare metadata

* fix: fix linting errors

* fix: fix linting errors

* fix: fix linting errors

* fix: fix key management errors

* fix(key_management_endpoints.py): update metadata

* test: update test

* refactor: add more debug statements

* test: skip flaky test

* test: fix test

* fix: fix test

* fix: fix update metadata logic

* fix: fix test

* ci(config.yml): change db url for e2e ui testing
2024-12-01 05:24:11 -08:00
..
guardrails LiteLLM Minor Fixes & Improvements (10/15/2024) (#6242) 2024-10-16 07:32:06 -07:00
access_control.md doc onboarding orgs 2024-10-09 19:11:36 +05:30
alerting.md Docs - use 1 page for all logging integrations on proxy + add logging features at top level (#6805) 2024-11-18 18:35:52 -08:00
architecture.md docs clarify how virtual key is read from cache / db 2024-09-18 09:39:54 -07:00
billing.md Update lago.py to accomodate API change (#5495) (#5543) 2024-09-05 17:27:40 -07:00
bucket.md (docs) add benchmarks on 1K RPS (#6704) 2024-11-11 19:25:53 -08:00
caching.md (fix proxy redis) Add redis sentinel support (#6154) 2024-11-12 18:36:46 -08:00
call_hooks.md [Feat] Add proxy level prometheus metrics (#5789) 2024-09-19 17:13:07 -07:00
cli.md (docs + testing) Correctly document the timeout value used by litellm proxy is 6000 seconds + add to best practices for prod (#6339) 2024-10-23 14:09:35 +05:30
config_management.md Revert "Revert "(feat) Allow using include to include external YAML files in a config.yaml (#6922)"" 2024-11-27 16:08:59 -08:00
config_settings.md LiteLLM Minor Fixes & Improvements (11/26/2024) (#6913) 2024-11-28 00:01:38 +05:30
configs.md Revert "Revert "(feat) Allow using include to include external YAML files in a config.yaml (#6922)"" 2024-11-27 16:08:59 -08:00
cost_tracking.md Litellm dev 10 29 2024 (#6502) 2024-10-29 22:04:16 -07:00
custom_pricing.md LiteLLM Minor Fixes & Improvements (10/23/2024) (#6407) 2024-10-24 19:01:41 -07:00
custom_sso.md [Feat-Proxy] Allow using custom sso handler (#5809) 2024-09-20 19:14:33 -07:00
customer_routing.md LiteLLM Minor Fixes & Improvements (10/15/2024) (#6242) 2024-10-16 07:32:06 -07:00
customers.md ui - fix typo on referencing base url 2024-07-18 13:36:05 -07:00
db_info.md (feat) Allow disabling ErrorLogs written to the DB (#6940) 2024-11-27 19:34:51 -08:00
debugging.md docs(debugging.md): cleanup docs 2024-07-27 09:28:53 -07:00
demo.md docs(virtual_keys.md): add enable/disable virtual keys to docs + refactor sidebar 2024-09-21 22:20:39 -07:00
deploy.md (docs improvement) remove emojis, use guides section, categorize uncategorized docs (#6796) 2024-11-18 12:23:54 -08:00
docker_quick_start.md (docs improvement) remove emojis, use guides section, categorize uncategorized docs (#6796) 2024-11-18 12:23:54 -08:00
email.md docs clean up emojis 2024-08-17 13:30:11 -07:00
embedding.md (docs) use port 4000 2024-03-08 21:59:00 -08:00
enterprise.md fix links due to broken list (#6103) 2024-10-07 15:47:29 -04:00
guardrails.md LiteLLM Minor Fixes & Improvements (11/01/2024) (#6551) 2024-11-02 02:09:31 +05:30
health.md fix grammar on health check docs (#5984) 2024-09-30 09:21:42 -07:00
ip_address.md (docs improvement) remove emojis, use guides section, categorize uncategorized docs (#6796) 2024-11-18 12:23:54 -08:00
load_balancing.md docs - have 1 section for routing +load balancing (#6884) 2024-11-23 15:56:57 -08:00
logging.md Docs - use 1 page for all logging integrations on proxy + add logging features at top level (#6805) 2024-11-18 18:35:52 -08:00
metrics.md (docs) show /daily_metrics 2024-02-27 19:34:47 -08:00
model_management.md docs(model_management.md): add section on adding additional model information to proxy config 2024-08-14 14:39:48 -07:00
multiple_admins.md docs clean up emojis 2024-08-17 13:30:11 -07:00
oauth2.md docs oauh 2.0 enterprise feature 2024-08-16 14:00:24 -07:00
pass_through.md (docs) simplify left nav names + use a section for making llm requests (#6799) 2024-11-18 12:53:43 -08:00
perf.md docs - fix build time issues 2024-06-15 16:12:37 -07:00
pii_masking.md docs new presidio language controls 2024-09-04 13:04:19 -07:00
prod.md (feat) Allow disabling ErrorLogs written to the DB (#6940) 2024-11-27 19:34:51 -08:00
prometheus.md LiteLLM Minor Fixes & Improvements (11/29/2024) (#6965) 2024-12-01 05:24:11 -08:00
provider_budget_routing.md (feat) - provider budget improvements - ensure provider budgets work with multiple proxy instances + improve latency to ~90ms (#6886) 2024-11-24 16:36:19 -08:00
quick_start.md Improving the proxy docs for configuring with vllm 2024-08-13 16:07:41 -07:00
reliability.md docs - have 1 section for routing +load balancing (#6884) 2024-11-23 15:56:57 -08:00
response_headers.md docs(response_headers.md): add response headers to docs 2024-09-28 23:33:50 -07:00
rules.md (docs) use port 4000 2024-03-08 21:59:00 -08:00
self_serve.md LiteLLM Minor Fixes & Improvements (11/23/2024) (#6870) 2024-11-23 15:17:40 +05:30
service_accounts.md docs service accounts (#5900) 2024-09-25 15:46:13 -07:00
streaming_logging.md ui cleanup 2024-09-07 11:20:07 -07:00
tag_routing.md add "default" tag 2024-09-09 14:41:22 -07:00
team_based_routing.md docs - have 1 section for routing +load balancing (#6884) 2024-11-23 15:56:57 -08:00
team_budgets.md Update team_budgets.md (#6611) 2024-11-06 18:46:16 -08:00
team_logging.md Docs - use 1 page for all logging integrations on proxy + add logging features at top level (#6805) 2024-11-18 18:35:52 -08:00
token_auth.md [Feat-Router] Allow setting which environment to use a model on (#5892) 2024-09-25 10:12:06 -07:00
ui.md (Doc) Add section on what is stored in the DB + Add clear section on key/team based logging (#6769) 2024-11-16 10:28:44 -08:00
user_keys.md docs(user_keys.md): add regex doc for clientside auth params 2024-10-17 22:42:29 -07:00
users.md docs(users.md): add doc on setting max budget for internal users 2024-08-21 16:22:41 -07:00
virtual_keys.md Litellm dev 11 23 2024 (#6881) 2024-11-23 22:37:16 +05:30