Commit graph

16858 commits

Author SHA1 Message Date
Ishaan Jaff
8fada93fff docs on using vertex tts 2024-08-23 17:57:49 -07:00
Ishaan Jaff
225ff8432d test vertex ai text to speech 2024-08-23 16:06:39 -07:00
Ishaan Jaff
755a0514f6 fix linting 2024-08-23 16:05:31 -07:00
Ishaan Jaff
82c3357454 add example using tts on vertex ai 2024-08-23 16:04:51 -07:00
Ishaan Jaff
5c3a1484c3 docs text to speech 2024-08-23 15:50:03 -07:00
Ishaan Jaff
c3987745fe fix linting errors 2024-08-23 15:44:31 -07:00
Ishaan Jaff
49b25db516 init comit for vtx text to speech 2024-08-23 15:40:52 -07:00
Ishaan Jaff
960a141884 add test_audio_speech_litellm_vertex 2024-08-23 15:36:42 -07:00
Ishaan Jaff
92e5cd113d
Merge pull request #5342 from BerriAI/litellm_add_custom_guardrails
[Feat-Proxy] Add Custom Guardrails
2024-08-23 12:11:31 -07:00
Ishaan Jaff
918e4fcfe5 feat add test for custom guardrails 2024-08-23 12:01:43 -07:00
Ishaan Jaff
5895f0c615 fix custom guardrail test 2024-08-23 11:58:20 -07:00
Ishaan Jaff
1b1e0f2d77 init custom guardrail class 2024-08-23 10:54:42 -07:00
Ishaan Jaff
7d30188f84 custom_callbacks 2024-08-23 09:52:52 -07:00
Ishaan Jaff
d40695b979 docs custom guardrails 2024-08-23 09:50:19 -07:00
Ishaan Jaff
d10430c881 doc custom guardrail 2024-08-23 09:41:54 -07:00
Ishaan Jaff
a99258440c fix use guardrail for pre call hook 2024-08-23 09:34:08 -07:00
Krrish Dholakia
93ed8c7216 fix(utils.py): handle additionalProperties is False for vertex ai / gemini calls
Fixes https://github.com/BerriAI/litellm/issues/5338

Also adds together ai json mode support
2024-08-23 09:21:32 -07:00
Ishaan Jaff
af92cff44d add custom guardrail reference 2024-08-23 08:32:07 -07:00
Ishaan Jaff
e62d0c7922 add the ability to init a custom guardrail 2024-08-23 08:21:07 -07:00
Krrish Dholakia
874d58fe8a fix(factory.py): support 'add_generation_prompt' field for hf chat templates
Fixes https://github.com/BerriAI/litellm/pull/5178#issuecomment-2306362008
2024-08-23 08:06:21 -07:00
Krrish Dholakia
afb00a27cb fix(litellm_pre_call_utils.py): don't override k-v pair sent in spend_logs_metadata by user 2024-08-23 07:10:18 -07:00
Ishaan Jaff
4ac78a0765 fix prom latency metrics 2024-08-23 06:59:19 -07:00
Krrish Dholakia
52fb1e0c38 docs(caching.md): add redis cluster support to docs 2024-08-22 22:16:07 -07:00
Krrish Dholakia
cee69a92ce docs(bedrock.md): add docs on alternating user/assistant messages 2024-08-22 22:10:10 -07:00
Ishaan Jaff
1765976ce0 use with base64 2024-08-22 20:49:39 -07:00
Ishaan Jaff
ed2d3f4bf8 allow load testing sagemaker url 2024-08-22 20:03:27 -07:00
Krrish Dholakia
3f96a8c667 bump: version 1.44.3 → 1.44.4 2024-08-22 19:31:35 -07:00
Krish Dholakia
0a5fc42f5c
Merge pull request #5337 from BerriAI/litellm_azure_batch_apis
feat(batches): add azure openai batches endpoint support
2024-08-22 19:08:00 -07:00
Krish Dholakia
76b3db334b
Merge branch 'main' into litellm_azure_batch_apis 2024-08-22 19:07:54 -07:00
Ishaan Jaff
b054dd0e45 docs fix 2024-08-22 19:04:14 -07:00
Ishaan Jaff
25609a94ad docs moderation 2024-08-22 18:57:54 -07:00
Krrish Dholakia
56cb94ac5e docs(batches.md): add more examples to docs 2024-08-22 18:51:44 -07:00
Ishaan Jaff
b865993b34 docs move pass thru endpoints 2024-08-22 18:49:26 -07:00
Ishaan Jaff
18cd905a1f ci/cd run again 2024-08-22 18:41:10 -07:00
Ishaan Jaff
95beba870e bump: version 1.44.2 → 1.44.3 2024-08-22 18:27:38 -07:00
Krrish Dholakia
11c7e92b58 docs(sidebars.js): refactor docs 2024-08-22 18:22:50 -07:00
Ishaan Jaff
645da5b437
Merge pull request #5332 from BerriAI/litellm_allow_using_azure_ad_token_auth
[Feat] Azure OpenAI add support for using azure_ad_token_provider with LiteLLM Proxy + Router
2024-08-22 18:21:54 -07:00
Ishaan Jaff
228252b92d
Merge branch 'main' into litellm_allow_using_azure_ad_token_auth 2024-08-22 18:21:24 -07:00
Ishaan Jaff
2bf1fb3275 add test for test_azure_tenant_id_auth 2024-08-22 18:09:00 -07:00
Ishaan Jaff
2d57fab79f
Merge pull request #5339 from BerriAI/litellm_add_bedrock_guardrails
[Feat-Proxy] add bedrock guardrails support
2024-08-22 17:28:57 -07:00
Ishaan Jaff
70f9e41ed9
Merge branch 'main' into litellm_add_bedrock_guardrails 2024-08-22 17:28:49 -07:00
Ishaan Jaff
1f0cc72531 test bedrock guardrails 2024-08-22 17:24:42 -07:00
Krrish Dholakia
e445b78490 docs(configs.md): add global_max_parallel_requests to docs 2024-08-22 17:12:52 -07:00
Krrish Dholakia
735fc804ed fix(proxy_server.py): expose flag to disable retries when max parallel request limit is hit 2024-08-22 16:49:52 -07:00
Krrish Dholakia
7398e94472 fix(files_endpoints.py): fix multiple args error 2024-08-22 16:42:44 -07:00
Krrish Dholakia
d7b525f391 feat(auth_checks.py): allow team to call all models, when explicitly set via /* 2024-08-22 16:38:56 -07:00
Ishaan Jaff
9e3d573bcb add async_post_call_success_hook 2024-08-22 16:34:43 -07:00
Ishaan Jaff
499b6b3368 doc bedrock guardrails 2024-08-22 16:25:22 -07:00
Ishaan Jaff
f13a65be2d fix azure_ad_token_provider 2024-08-22 16:15:53 -07:00
Krish Dholakia
3cf009efbf
Merge pull request #5325 from BerriAI/litellm_redis_cluster
feat(caching.py): redis cluster support
2024-08-22 16:13:45 -07:00