Commit graph

17138 commits

Author SHA1 Message Date
Ishaan Jaff
e449bf062d add docs on pass thtough 2024-08-29 16:12:14 -07:00
Ishaan Jaff
41a5daf20c add test for vertex sdk foward headers 2024-08-29 15:50:54 -07:00
Ishaan Jaff
9fb188a3b6 vertex add vertex endpoints 2024-08-29 15:49:25 -07:00
Ishaan Jaff
4b7ceade64 mark test_key_info_spend_values_streaming as flaky 2024-08-29 14:39:53 -07:00
Ishaan Jaff
208fe6cb90
Merge pull request #5430 from Manouchehri/bedrock-cross-inference-1
(bedrock): Add new cross-region inference support for Bedrock.
2024-08-29 14:30:11 -07:00
Ishaan Jaff
5851a8f901
Merge pull request #5431 from BerriAI/litellm_Add_fireworks_ai_health_check
[Fix-Proxy] /health check for provider wildcard models (fireworks/*)
2024-08-29 14:25:05 -07:00
Ishaan Jaff
284b8b3418 add test for health check 2024-08-29 11:16:20 -07:00
David Manouchehri
19db80ffeb
(bedrock): Add new cross-region inference support for Bedrock. 2024-08-29 17:49:16 +00:00
Ishaan Jaff
b576233e66 add support for fireworks ai health check 2024-08-29 09:29:16 -07:00
Ishaan Jaff
45774010f7 add util to pick_cheapest_model_from_llm_provider 2024-08-29 09:27:20 -07:00
Ishaan Jaff
4b6a2fa4f3 add fireworks_ai_models 2024-08-29 09:23:11 -07:00
Krish Dholakia
559a6ad826
fix(google_ai_studio): working context caching (#5421)
* fix(google_ai_studio): working context caching

* feat(vertex_ai_context_caching.py): support async cache check calls

* fix(vertex_and_google_ai_studio_gemini.py): fix setting headers

* fix(vertex_ai_parter_models): fix import

* fix(vertex_and_google_ai_studio_gemini.py): fix input

* test(test_amazing_vertex_completion.py): fix test
2024-08-29 07:00:30 -07:00
Krish Dholakia
8ce1e49fbe
fix(utils.py): correctly log streaming cache hits (#5417) (#5426)
Fixes https://github.com/BerriAI/litellm/issues/5401
2024-08-28 22:50:33 -07:00
Krrish Dholakia
e9957f1265 bump: version 1.44.9 → 1.44.10 2024-08-28 22:21:38 -07:00
Krish Dholakia
8ae0fc693f
Merge pull request #5414 from BerriAI/litellm_main_staging
fixes: minor litellm fixes
2024-08-28 22:01:01 -07:00
Krish Dholakia
5b5538b039
Merge pull request #5425 from BerriAI/litellm_team_member_info_additional_fix
fix(team_endpoints.py): update to include the budget in the response
2024-08-28 22:00:32 -07:00
Krrish Dholakia
2119030738 fix(team_endpoints.py): update to include the budget in the response 2024-08-28 21:58:41 -07:00
Krish Dholakia
68112e6dec
Merge pull request #5423 from BerriAI/litellm_team_member_info
feat(team_endpoints.py): return team member budgets in /team/info call
2024-08-28 21:52:46 -07:00
Krrish Dholakia
fd1cca207f test(test_amazing_vertex_completion.py): fix test 2024-08-28 21:12:39 -07:00
Krrish Dholakia
18689c25e9 feat(team_endpoints.py): return team member budgets in /team/info call
Fixes https://github.com/BerriAI/litellm/issues/5390
2024-08-28 19:14:01 -07:00
Krrish Dholakia
dd9c5d10bd fix(vertex_ai_partner_models.py): fix vertex import 2024-08-28 18:08:33 -07:00
Krish Dholakia
a857f4a8ee
Merge branch 'main' into litellm_main_staging 2024-08-28 18:05:27 -07:00
Krrish Dholakia
f0fb8bdf45 fix(router.py): fix cooldown check 2024-08-28 16:38:42 -07:00
Ishaan Jaff
25d8cb69a7 bump: version 1.44.8 → 1.44.9 2024-08-28 16:35:35 -07:00
Ishaan Jaff
f5a8f71080
Merge pull request #5422 from BerriAI/fix_promt
[minor fix Proxy] - prometheus - safe update start / end time
2024-08-28 16:35:06 -07:00
Ishaan Jaff
a982cb7ae5
Merge pull request #5420 from BerriAI/litellm_add_oauth2_mapping
[Feat-Proxy] Add hook for oauth2 proxy headers
2024-08-28 16:34:26 -07:00
Ishaan Jaff
020d0ab5b4
Merge pull request #5418 from BerriAI/litellm_add_request_body_safety_checks
[Fix - Proxy] Security fix, don't allow client side to set api_base, base_url
2024-08-28 16:14:57 -07:00
Ishaan Jaff
8948583ddc
Merge branch 'main' into litellm_add_request_body_safety_checks 2024-08-28 16:14:46 -07:00
Ishaan Jaff
443e1b3bba prometheus - safe update start / end time 2024-08-28 16:13:56 -07:00
Ishaan Jaff
946e3b63e1 add hook for oauth2 proxy 2024-08-28 15:51:20 -07:00
Ishaan Jaff
2f3d400148 fix vertex ai test 2024-08-28 15:30:39 -07:00
Ishaan Jaff
a007f865d3 fix batch creation azure 2024-08-28 14:57:36 -07:00
Ishaan Jaff
60e02ae5d1
Merge pull request #5222 from ArbitraryCritter/listen-on-ipv6-and-ipv4
Make helm chart listen on IPv6 (and IPv4).
2024-08-28 14:54:09 -07:00
Ishaan Jaff
068114859a fix failing vertex test 2024-08-28 14:46:57 -07:00
Ishaan Jaff
5f7718db5c
Merge pull request #5415 from BerriAI/litellm_add_ssml_vertex_Ai
Feat - Add Google Text-to-Speech support ssml
2024-08-28 14:44:27 -07:00
Ishaan Jaff
6c49083573
Merge pull request #5409 from BerriAI/litellm_ui_budgets
[UI] Allow editing budget duration
2024-08-28 14:43:57 -07:00
Ishaan Jaff
5ad6d4cf77 new ui build 2024-08-28 14:43:33 -07:00
Krrish Dholakia
7ef38020db test(test_amazing_vertex_completion.py): ignore experimental gemini models in test 2024-08-28 14:29:40 -07:00
Krrish Dholakia
4ce59f1a96 test(test_amazing_vertex_completion.py): update test to not pick experimental gemini models 2024-08-28 14:28:06 -07:00
Ishaan Jaff
277e15e36d add test_user_api_key_auth_fails_with_prohibited_params 2024-08-28 14:11:56 -07:00
Ishaan Jaff
9c2d974f5e fix checking request body 2024-08-28 14:10:09 -07:00
Ishaan Jaff
d3a5162103 add checks for safe request body 2024-08-28 14:07:53 -07:00
Krish Dholakia
d928220ed2
Merge pull request #5393 from BerriAI/litellm_gemini_embedding_support
feat(vertex_ai_and_google_ai_studio): Support Google AI Studio Embedding Endpoint
2024-08-28 13:46:28 -07:00
Krish Dholakia
7de9f8b6ea
Merge pull request #5413 from lilleswing/gemini-experimental
Support for gemini experimental models
2024-08-28 13:41:55 -07:00
Ishaan Jaff
ba1912afd1 add check for is_request_body_safe 2024-08-28 13:40:14 -07:00
Krrish Dholakia
cc411f1e97 docs(reliability.md): cleanup docs 2024-08-28 13:33:13 -07:00
Ishaan Jaff
0b9782a377 retry flaky tests 3 times 2024-08-28 13:10:47 -07:00
Ishaan Jaff
1e12a50cb3 doc add ssml usage 2024-08-28 13:08:49 -07:00
Krrish Dholakia
17646b50ec build(model_prices_and_context_window.json): bedrock/llama3 models - region-based pricing 2024-08-28 13:07:56 -07:00
Krrish Dholakia
023d0f7664 build(model_prices_and_context_window.json): fix bedrock/llama3-1 pricing 2024-08-28 12:54:24 -07:00