Commit graph

10748 commits

Author SHA1 Message Date
Ishaan Jaff
38cf04cc38 fix tool tip 2024-05-01 08:26:44 -07:00
Ishaan Jaff
fc5a845838 fix - prisma schema 2024-04-30 23:09:53 -07:00
Ishaan Jaff
eb54b57a44 bump: version 1.35.33 → 1.35.34 2024-04-30 22:55:03 -07:00
Ishaan Jaff
1e94d53a9b (ui - new build) 2024-04-30 22:54:51 -07:00
Ishaan Jaff
b8ca83114a
Merge pull request #3373 from BerriAI/litellm_ui_show_model_exceptions
[UI] show exceptions by model deployments + model latencies - v0
2024-04-30 22:53:47 -07:00
Ishaan Jaff
9bf99df7e2 ui - model analytics 2024-04-30 22:51:25 -07:00
Ishaan Jaff
b9238a00af ui - show tokens / sec 2024-04-30 22:44:28 -07:00
Krrish Dholakia
6a2ddc2791 docs(routing.md): add docs on lowest latency routing buffer 2024-04-30 22:41:50 -07:00
Krrish Dholakia
cfc1eeb3c3 test(test_router_fallbacks.py): rename test to run earlier 2024-04-30 22:04:20 -07:00
Krrish Dholakia
e506e71cb9 fix(test_router_fallbacks.py): reduce test rpm 2024-04-30 22:00:48 -07:00
Krish Dholakia
9f55a99e98
Merge pull request #3376 from BerriAI/litellm_routing_logic
fix(router.py): unify retry timeout logic across sync + async function_with_retries
2024-04-30 19:58:45 -07:00
Krrish Dholakia
e2eddac406 test(test_ratelimit.py): fix test to send below rpm 2024-04-30 19:35:21 -07:00
Krrish Dholakia
4761345311 fix(main.py): fix mock completion response 2024-04-30 19:30:18 -07:00
Krrish Dholakia
bc5c9d7da9 fix(test_router_fallbacks.py): fix tests 2024-04-30 18:48:39 -07:00
Ishaan Jaff
5da931f297 ui - clean up table 2024-04-30 18:48:32 -07:00
Ishaan Jaff
0c464f7f61 fix - viewing model metrics 2024-04-30 18:26:14 -07:00
Ishaan Jaff
ace3b02d97 ui - model analytics show failed requests % 2024-04-30 18:23:31 -07:00
Krish Dholakia
47017f5bc4
Merge pull request #3377 from BerriAI/revert-3374-abramowi/disambiguate-invalid-model-name-errors
Revert "Disambiguate invalid model name errors"
2024-04-30 17:58:00 -07:00
Krish Dholakia
82095731c1
Revert "Disambiguate invalid model name errors" 2024-04-30 17:57:52 -07:00
Krish Dholakia
fe3496961a
Merge pull request #3374 from msabramo/abramowi/disambiguate-invalid-model-name-errors
Disambiguate invalid model name errors
2024-04-30 17:57:29 -07:00
Krrish Dholakia
1baad80c7d fix(router.py): cooldown deployments, for 401 errors 2024-04-30 17:54:00 -07:00
Ishaan Jaff
f2849d0641 fix - track litellm_model_name in LiteLLM_ErrorLogs 2024-04-30 17:31:40 -07:00
Ishaan Jaff
8a1a043801 backend - show model latency per token 2024-04-30 17:23:36 -07:00
Ishaan Jaff
8177ef5ec0 ui - show model latency / token 2024-04-30 17:23:27 -07:00
Ishaan Jaff
ce1817380e feat ui - modelExceptionsCall 2024-04-30 16:56:45 -07:00
Ishaan Jaff
a2a8fef8f4 fix passing starttime and endtime to model/exceptions 2024-04-30 16:53:53 -07:00
Krrish Dholakia
8ee51a96f4 test(test_router_debug_logs.py): fix retry logic 2024-04-30 16:42:10 -07:00
Krish Dholakia
ce9ede6110
Merge pull request #3370 from BerriAI/litellm_latency_buffer
fix(lowest_latency.py): allow setting a buffer for getting values within a certain latency threshold
2024-04-30 16:01:47 -07:00
Ishaan Jaff
26a5d85869 fix - backend return exceptions 2024-04-30 15:41:16 -07:00
Krrish Dholakia
0267069c6a fix(router.py): return routing args as dict 2024-04-30 15:39:14 -07:00
Krrish Dholakia
668a5353ee fix(router.py): fix linting issue 2024-04-30 15:35:16 -07:00
Krrish Dholakia
6a2b4bcab8 fix(router.py): only check /v1 for azure ai studio models
Fixes https://github.com/BerriAI/litellm/issues/3346
2024-04-30 15:29:50 -07:00
Krrish Dholakia
87ff26ff27 fix(router.py): unify retry timeout logic across sync + async function_with_retries 2024-04-30 15:23:19 -07:00
Ishaan Jaff
49f83ce204 ui - show models analytics 2024-04-30 15:16:25 -07:00
Marc Abramowitz
c794c09679 Disambiguate invalid model name errors
because that error can be thrown in several different places, so
knowing the function it's being thrown from can be very useul for debugging.
2024-04-30 14:34:54 -07:00
Ishaan Jaff
b9a0a13516 ui - show model usage 2024-04-30 14:28:19 -07:00
Ishaan Jaff
1f4f1c6f70 stash /model/metrics/exceptions endpoints 2024-04-30 14:19:23 -07:00
Krrish Dholakia
3cc82f558e fix(utils.py): add exception mapping for gemini error 2024-04-30 14:17:10 -07:00
Krrish Dholakia
638477a023 test: fix test 2024-04-30 14:06:09 -07:00
Krrish Dholakia
df43012bdd test(test_router_fallbacks.py): use rpm test -> more stable 2024-04-30 14:01:01 -07:00
Krrish Dholakia
470dbf9745 build(ui): allow user to modify 'lowest_latency_buffer' on UI 2024-04-30 13:54:43 -07:00
Ishaan Jaff
0b0be700fc
Merge pull request #3371 from BerriAI/litellm_log_errors_db
[Feat] Write LLM Exception to LiteLLM Proxy DB
2024-04-30 13:36:41 -07:00
Ishaan Jaff
4b8fda4ac4 log startTime and EndTime for exceptions 2024-04-30 13:34:14 -07:00
Ishaan Jaff
3aad034a8b feat log request kwargs in error logs 2024-04-30 13:28:26 -07:00
Ishaan Jaff
ad5fddef15 fix log model_group 2024-04-30 13:11:09 -07:00
Ishaan Jaff
ee2a2ce559 fix - log api_base in errors 2024-04-30 13:02:42 -07:00
Ishaan Jaff
06804bc70a fix - working exception writing 2024-04-30 12:48:17 -07:00
Ishaan Jaff
22725bd44d fix types for errorLog 2024-04-30 12:31:33 -07:00
Ishaan Jaff
c7f979e0fe fix schema error logs 2024-04-30 12:31:19 -07:00
Ishaan Jaff
ac1cabe963 add LiteLLM_ErrorLogs to types 2024-04-30 12:16:03 -07:00