Commit graph

13660 commits

Author SHA1 Message Date
Ishaan Jaff
a9d1be71ff
Merge pull request #4395 from BerriAI/litelm_use_spend_calc_aliases
Fix /spend/calculate use model_group_alias when set
2024-06-24 21:15:05 -07:00
Ishaan Jaff
9e7d8ba910 /spend/calculate use model aliases on this endpoint 2024-06-24 21:14:00 -07:00
Krish Dholakia
9902947521
Merge pull request #4390 from BerriAI/litellm_langfuse_router_logging
Log rejected router requests to langfuse
2024-06-24 21:13:45 -07:00
Ishaan Jaff
a64d1de80f test - aliases on /spend/calculate 2024-06-24 21:13:01 -07:00
Ishaan Jaff
7e5f200c6d
Merge pull request #4394 from BerriAI/docs_enterprise_control_routes
docs control available public routes
2024-06-24 20:57:00 -07:00
Ishaan Jaff
7f8c502a44 docs control available public routes 2024-06-24 20:54:43 -07:00
Ishaan Jaff
37f2712bba
Merge pull request #4389 from BerriAI/litellm_allow_user_to_define_public_routes
[Feat-Enterprise] - Allow setting custom public routes
2024-06-24 20:23:35 -07:00
Krish Dholakia
5d570e7c6c
Merge pull request #4392 from BerriAI/litellm_gemini_content_policy_errors
fix(vertex_httpx.py): cover gemini content violation (on prompt)
2024-06-24 20:00:06 -07:00
Ishaan Jaff
2aa0ce50b5 fix importing litellm 2024-06-24 19:58:53 -07:00
Ishaan Jaff
bd2298eba4 example cofnig with public routes 2024-06-24 19:51:23 -07:00
Ishaan Jaff
5e1403cd0a add helper to check route_in_additonal_public_routes 2024-06-24 19:50:35 -07:00
Krrish Dholakia
d182ea0f77 fix(utils.py): catch 422-status errors 2024-06-24 19:41:48 -07:00
Ishaan Jaff
11117665e1 test - spend/calculate endpoints 2024-06-24 19:32:52 -07:00
Krish Dholakia
95f972ee9f
Merge pull request #4388 from BerriAI/litellm_custom_model_info
Support custom model info for router logic (e.g. `max_input_tokens`)
2024-06-24 19:31:37 -07:00
Krrish Dholakia
8e6e5a6d37 fix(vertex_httpx.py): Return empty model response for content filter violations 2024-06-24 19:22:20 -07:00
Krrish Dholakia
1ff0129a94 fix(vertex_httpx.py): cover gemini content violation (on prompt) 2024-06-24 19:13:56 -07:00
Ishaan Jaff
02ffed2545 feat - refactor /spend/calculate 2024-06-24 19:05:34 -07:00
Krrish Dholakia
a4bea47a2d fix(router.py): log rejected router requests to langfuse
Fixes issue where rejected requests weren't being logged
2024-06-24 17:52:01 -07:00
Ishaan Jaff
5309be2456 example config with public routes 2024-06-24 17:46:38 -07:00
Ishaan Jaff
2f90759db5 feat - allow user to define public routes 2024-06-24 17:45:13 -07:00
Krrish Dholakia
341c7857c1 test(test_router.py): add testing 2024-06-24 17:28:12 -07:00
Krrish Dholakia
f5fbdf0fee fix(router.py): use user-defined model_input_tokens for pre-call filter checks 2024-06-24 17:25:26 -07:00
Krrish Dholakia
123477b55a fix(utils.py): fix exception_mapping check for errors
If exception already mapped - don't attach traceback to it
2024-06-24 16:55:19 -07:00
Ishaan Jaff
70a605b3cc docs - update telemetry 2024-06-24 13:21:16 -07:00
Ishaan Jaff
dd048cf342
Merge pull request #4382 from BerriAI/litellm_ui_fix_login_bug
[Fix] - Admin UI login bug
2024-06-24 08:19:37 -07:00
Ishaan Jaff
bd160745f9
Merge pull request #4379 from 7HR4IZ3/main
fix: Lunary integration
2024-06-24 08:11:19 -07:00
Ishaan Jaff
acbcfef5af fix ui login bug 2024-06-24 07:54:08 -07:00
7HR4IZ3
515dc9acc7
fix: Lunary integration
Fixes the bug of litellm not logging system messages to lunary
2024-06-24 14:09:40 +01:00
Krrish Dholakia
769c60e4f6 test: skip unstable tests 2024-06-23 00:30:45 -07:00
Krrish Dholakia
3d09a196a4 test(test_completion.py): handle replicate api error 2024-06-23 00:06:15 -07:00
Krrish Dholakia
9cff2b03f3 test(test_proxy_server_langfuse.py): cleanup tests causing OOM issues. 2024-06-22 23:53:18 -07:00
Krrish Dholakia
d857d82b0e fix(redact_messages.py): fix pr 2024-06-22 23:27:13 -07:00
Krrish Dholakia
9450d2cf77 fix(test_dynamic_rate_limit_handler.py): cleanup 2024-06-22 22:43:56 -07:00
Krrish Dholakia
dc43ffb771 fix(redact_messages.py): fix get 2024-06-22 21:57:54 -07:00
Krrish Dholakia
4d9a0d45b2 docs(team_budgets.md): cleanup docs 2024-06-22 21:38:01 -07:00
Krrish Dholakia
bf12536fdb bump: version 1.40.24 → 1.40.25 2024-06-22 21:34:55 -07:00
Krish Dholakia
9bffa9a48e
Merge pull request #4352 from msabramo/msabramo/turn-on-message-logging-via-request-header
Disable message redaction in logs via request header
2024-06-22 21:30:41 -07:00
Krish Dholakia
5e11702677
Merge pull request #4365 from BerriAI/litellm_azure_content_filter_fallbacks
fix(router.py): Content Policy Fallbacks for Azure 'content_filter' responses
2024-06-22 21:28:36 -07:00
Krish Dholakia
0454c0781a
Merge branch 'main' into litellm_azure_content_filter_fallbacks 2024-06-22 21:28:29 -07:00
Krrish Dholakia
cea630022e fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions
Fixes https://github.com/BerriAI/litellm/issues/4338
2024-06-22 21:26:15 -07:00
Krrish Dholakia
0fd9033502 fix(vertex_httpx.py): flush remaining chunks from stream 2024-06-22 20:33:54 -07:00
Krrish Dholakia
73254987da fix(vertex_httpx.py): ignore vertex finish reason - wait for stream to end
Fixes https://github.com/BerriAI/litellm/issues/4339
2024-06-22 20:21:01 -07:00
Krish Dholakia
eaad36a2cb
Merge pull request #4349 from BerriAI/litellm_dynamic_tpm_limits
feat(dynamic_rate_limiter.py): Dynamic tpm quota (multiple projects)
2024-06-22 19:15:05 -07:00
Krish Dholakia
961e7ac95d
Merge branch 'main' into litellm_dynamic_tpm_limits 2024-06-22 19:14:59 -07:00
Krrish Dholakia
2c7a80d08d fix(router.py): check if azure returns 'content_filter' response + fallback available -> fallback
Exception maps azure content filter response exceptions
2024-06-22 19:10:15 -07:00
Ishaan Jaff
4fc8efd640 bump: version 1.40.23 → 1.40.24 2024-06-22 18:00:40 -07:00
Krrish Dholakia
c4b1540ce0 fix(utils.py): support streamingchoices in 'get_response_string 2024-06-22 15:45:52 -07:00
Krrish Dholakia
bae7377128 docs(team_budgets.md): fix script
/
2024-06-22 15:42:05 -07:00
Krrish Dholakia
fc4e900a23 docs(team_budgets.md): update docs with script for testing dynamic rate limiting 2024-06-22 15:26:58 -07:00
Krrish Dholakia
a31a05d45d feat(dynamic_rate_limiter.py): working e2e 2024-06-22 14:41:22 -07:00