Ishaan Jaff
|
a9d1be71ff
|
Merge pull request #4395 from BerriAI/litelm_use_spend_calc_aliases
Fix /spend/calculate use model_group_alias when set
|
2024-06-24 21:15:05 -07:00 |
|
Ishaan Jaff
|
9e7d8ba910
|
/spend/calculate use model aliases on this endpoint
|
2024-06-24 21:14:00 -07:00 |
|
Krish Dholakia
|
9902947521
|
Merge pull request #4390 from BerriAI/litellm_langfuse_router_logging
Log rejected router requests to langfuse
|
2024-06-24 21:13:45 -07:00 |
|
Ishaan Jaff
|
a64d1de80f
|
test - aliases on /spend/calculate
|
2024-06-24 21:13:01 -07:00 |
|
Ishaan Jaff
|
7e5f200c6d
|
Merge pull request #4394 from BerriAI/docs_enterprise_control_routes
docs control available public routes
|
2024-06-24 20:57:00 -07:00 |
|
Ishaan Jaff
|
7f8c502a44
|
docs control available public routes
|
2024-06-24 20:54:43 -07:00 |
|
Ishaan Jaff
|
37f2712bba
|
Merge pull request #4389 from BerriAI/litellm_allow_user_to_define_public_routes
[Feat-Enterprise] - Allow setting custom public routes
|
2024-06-24 20:23:35 -07:00 |
|
Krish Dholakia
|
5d570e7c6c
|
Merge pull request #4392 from BerriAI/litellm_gemini_content_policy_errors
fix(vertex_httpx.py): cover gemini content violation (on prompt)
|
2024-06-24 20:00:06 -07:00 |
|
Ishaan Jaff
|
2aa0ce50b5
|
fix importing litellm
|
2024-06-24 19:58:53 -07:00 |
|
Ishaan Jaff
|
bd2298eba4
|
example cofnig with public routes
|
2024-06-24 19:51:23 -07:00 |
|
Ishaan Jaff
|
5e1403cd0a
|
add helper to check route_in_additonal_public_routes
|
2024-06-24 19:50:35 -07:00 |
|
Krrish Dholakia
|
d182ea0f77
|
fix(utils.py): catch 422-status errors
|
2024-06-24 19:41:48 -07:00 |
|
Ishaan Jaff
|
11117665e1
|
test - spend/calculate endpoints
|
2024-06-24 19:32:52 -07:00 |
|
Krish Dholakia
|
95f972ee9f
|
Merge pull request #4388 from BerriAI/litellm_custom_model_info
Support custom model info for router logic (e.g. `max_input_tokens`)
|
2024-06-24 19:31:37 -07:00 |
|
Krrish Dholakia
|
8e6e5a6d37
|
fix(vertex_httpx.py): Return empty model response for content filter violations
|
2024-06-24 19:22:20 -07:00 |
|
Krrish Dholakia
|
1ff0129a94
|
fix(vertex_httpx.py): cover gemini content violation (on prompt)
|
2024-06-24 19:13:56 -07:00 |
|
Ishaan Jaff
|
02ffed2545
|
feat - refactor /spend/calculate
|
2024-06-24 19:05:34 -07:00 |
|
Krrish Dholakia
|
a4bea47a2d
|
fix(router.py): log rejected router requests to langfuse
Fixes issue where rejected requests weren't being logged
|
2024-06-24 17:52:01 -07:00 |
|
Ishaan Jaff
|
5309be2456
|
example config with public routes
|
2024-06-24 17:46:38 -07:00 |
|
Ishaan Jaff
|
2f90759db5
|
feat - allow user to define public routes
|
2024-06-24 17:45:13 -07:00 |
|
Krrish Dholakia
|
341c7857c1
|
test(test_router.py): add testing
|
2024-06-24 17:28:12 -07:00 |
|
Krrish Dholakia
|
f5fbdf0fee
|
fix(router.py): use user-defined model_input_tokens for pre-call filter checks
|
2024-06-24 17:25:26 -07:00 |
|
Krrish Dholakia
|
123477b55a
|
fix(utils.py): fix exception_mapping check for errors
If exception already mapped - don't attach traceback to it
|
2024-06-24 16:55:19 -07:00 |
|
Ishaan Jaff
|
70a605b3cc
|
docs - update telemetry
|
2024-06-24 13:21:16 -07:00 |
|
Ishaan Jaff
|
dd048cf342
|
Merge pull request #4382 from BerriAI/litellm_ui_fix_login_bug
[Fix] - Admin UI login bug
|
2024-06-24 08:19:37 -07:00 |
|
Ishaan Jaff
|
bd160745f9
|
Merge pull request #4379 from 7HR4IZ3/main
fix: Lunary integration
|
2024-06-24 08:11:19 -07:00 |
|
Ishaan Jaff
|
acbcfef5af
|
fix ui login bug
|
2024-06-24 07:54:08 -07:00 |
|
7HR4IZ3
|
515dc9acc7
|
fix: Lunary integration
Fixes the bug of litellm not logging system messages to lunary
|
2024-06-24 14:09:40 +01:00 |
|
Krrish Dholakia
|
769c60e4f6
|
test: skip unstable tests
|
2024-06-23 00:30:45 -07:00 |
|
Krrish Dholakia
|
3d09a196a4
|
test(test_completion.py): handle replicate api error
|
2024-06-23 00:06:15 -07:00 |
|
Krrish Dholakia
|
9cff2b03f3
|
test(test_proxy_server_langfuse.py): cleanup tests causing OOM issues.
|
2024-06-22 23:53:18 -07:00 |
|
Krrish Dholakia
|
d857d82b0e
|
fix(redact_messages.py): fix pr
|
2024-06-22 23:27:13 -07:00 |
|
Krrish Dholakia
|
9450d2cf77
|
fix(test_dynamic_rate_limit_handler.py): cleanup
|
2024-06-22 22:43:56 -07:00 |
|
Krrish Dholakia
|
dc43ffb771
|
fix(redact_messages.py): fix get
|
2024-06-22 21:57:54 -07:00 |
|
Krrish Dholakia
|
4d9a0d45b2
|
docs(team_budgets.md): cleanup docs
|
2024-06-22 21:38:01 -07:00 |
|
Krrish Dholakia
|
bf12536fdb
|
bump: version 1.40.24 → 1.40.25
|
2024-06-22 21:34:55 -07:00 |
|
Krish Dholakia
|
9bffa9a48e
|
Merge pull request #4352 from msabramo/msabramo/turn-on-message-logging-via-request-header
Disable message redaction in logs via request header
|
2024-06-22 21:30:41 -07:00 |
|
Krish Dholakia
|
5e11702677
|
Merge pull request #4365 from BerriAI/litellm_azure_content_filter_fallbacks
fix(router.py): Content Policy Fallbacks for Azure 'content_filter' responses
|
2024-06-22 21:28:36 -07:00 |
|
Krish Dholakia
|
0454c0781a
|
Merge branch 'main' into litellm_azure_content_filter_fallbacks
|
2024-06-22 21:28:29 -07:00 |
|
Krrish Dholakia
|
cea630022e
|
fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions
Fixes https://github.com/BerriAI/litellm/issues/4338
|
2024-06-22 21:26:15 -07:00 |
|
Krrish Dholakia
|
0fd9033502
|
fix(vertex_httpx.py): flush remaining chunks from stream
|
2024-06-22 20:33:54 -07:00 |
|
Krrish Dholakia
|
73254987da
|
fix(vertex_httpx.py): ignore vertex finish reason - wait for stream to end
Fixes https://github.com/BerriAI/litellm/issues/4339
|
2024-06-22 20:21:01 -07:00 |
|
Krish Dholakia
|
eaad36a2cb
|
Merge pull request #4349 from BerriAI/litellm_dynamic_tpm_limits
feat(dynamic_rate_limiter.py): Dynamic tpm quota (multiple projects)
|
2024-06-22 19:15:05 -07:00 |
|
Krish Dholakia
|
961e7ac95d
|
Merge branch 'main' into litellm_dynamic_tpm_limits
|
2024-06-22 19:14:59 -07:00 |
|
Krrish Dholakia
|
2c7a80d08d
|
fix(router.py): check if azure returns 'content_filter' response + fallback available -> fallback
Exception maps azure content filter response exceptions
|
2024-06-22 19:10:15 -07:00 |
|
Ishaan Jaff
|
4fc8efd640
|
bump: version 1.40.23 → 1.40.24
|
2024-06-22 18:00:40 -07:00 |
|
Krrish Dholakia
|
c4b1540ce0
|
fix(utils.py): support streamingchoices in 'get_response_string
|
2024-06-22 15:45:52 -07:00 |
|
Krrish Dholakia
|
bae7377128
|
docs(team_budgets.md): fix script
/
|
2024-06-22 15:42:05 -07:00 |
|
Krrish Dholakia
|
fc4e900a23
|
docs(team_budgets.md): update docs with script for testing dynamic rate limiting
|
2024-06-22 15:26:58 -07:00 |
|
Krrish Dholakia
|
a31a05d45d
|
feat(dynamic_rate_limiter.py): working e2e
|
2024-06-22 14:41:22 -07:00 |
|