scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-06 08:16:43 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 79
13641 commits 4106 branches 1402 tags 4.2 GiB
Commit graph

13641 commits

This branch
This branch
All branches
Author SHA1 Message Date
Krish Dholakia
95f972ee9f
Merge pull request #4388 from BerriAI/litellm_custom_model_info 
Support custom model info for router logic (e.g. `max_input_tokens`)
 2024-06-24 19:31:37 -07:00
Krrish Dholakia
341c7857c1 test(test_router.py): add testing 2024-06-24 17:28:12 -07:00
Krrish Dholakia
f5fbdf0fee fix(router.py): use user-defined model_input_tokens for pre-call filter checks 2024-06-24 17:25:26 -07:00
Krrish Dholakia
123477b55a fix(utils.py): fix exception_mapping check for errors 
If exception already mapped - don't attach traceback to it
 2024-06-24 16:55:19 -07:00
Ishaan Jaff
70a605b3cc docs - update telemetry 2024-06-24 13:21:16 -07:00
Ishaan Jaff
dd048cf342
Merge pull request #4382 from BerriAI/litellm_ui_fix_login_bug 
[Fix] - Admin UI login bug
 2024-06-24 08:19:37 -07:00
Ishaan Jaff
bd160745f9
Merge pull request #4379 from 7HR4IZ3/main 
fix: Lunary integration
 2024-06-24 08:11:19 -07:00
Ishaan Jaff
acbcfef5af fix ui login bug 2024-06-24 07:54:08 -07:00
7HR4IZ3
515dc9acc7
fix: Lunary integration 
Fixes the bug of litellm not logging system messages to lunary
 2024-06-24 14:09:40 +01:00
Krrish Dholakia
769c60e4f6 test: skip unstable tests 2024-06-23 00:30:45 -07:00
Krrish Dholakia
3d09a196a4 test(test_completion.py): handle replicate api error 2024-06-23 00:06:15 -07:00
Krrish Dholakia
9cff2b03f3 test(test_proxy_server_langfuse.py): cleanup tests causing OOM issues. 2024-06-22 23:53:18 -07:00
Krrish Dholakia
d857d82b0e fix(redact_messages.py): fix pr 2024-06-22 23:27:13 -07:00
Krrish Dholakia
9450d2cf77 fix(test_dynamic_rate_limit_handler.py): cleanup 2024-06-22 22:43:56 -07:00
Krrish Dholakia
dc43ffb771 fix(redact_messages.py): fix get 2024-06-22 21:57:54 -07:00
Krrish Dholakia
4d9a0d45b2 docs(team_budgets.md): cleanup docs 2024-06-22 21:38:01 -07:00
Krrish Dholakia
bf12536fdb bump: version 1.40.24 → 1.40.25 2024-06-22 21:34:55 -07:00
Krish Dholakia
9bffa9a48e
Merge pull request #4352 from msabramo/msabramo/turn-on-message-logging-via-request-header 
Disable message redaction in logs via request header
 2024-06-22 21:30:41 -07:00
Krish Dholakia
5e11702677
Merge pull request #4365 from BerriAI/litellm_azure_content_filter_fallbacks 
fix(router.py): Content Policy Fallbacks for Azure 'content_filter' responses
 2024-06-22 21:28:36 -07:00
Krish Dholakia
0454c0781a
Merge branch 'main' into litellm_azure_content_filter_fallbacks 2024-06-22 21:28:29 -07:00
Krrish Dholakia
cea630022e fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions 
Fixes https://github.com/BerriAI/litellm/issues/4338
 2024-06-22 21:26:15 -07:00
Krrish Dholakia
0fd9033502 fix(vertex_httpx.py): flush remaining chunks from stream 2024-06-22 20:33:54 -07:00
Krrish Dholakia
73254987da fix(vertex_httpx.py): ignore vertex finish reason - wait for stream to end 
Fixes https://github.com/BerriAI/litellm/issues/4339
 2024-06-22 20:21:01 -07:00
Krish Dholakia
eaad36a2cb
Merge pull request #4349 from BerriAI/litellm_dynamic_tpm_limits 
feat(dynamic_rate_limiter.py): Dynamic tpm quota (multiple projects)
 2024-06-22 19:15:05 -07:00
Krish Dholakia
961e7ac95d
Merge branch 'main' into litellm_dynamic_tpm_limits 2024-06-22 19:14:59 -07:00
Krrish Dholakia
2c7a80d08d fix(router.py): check if azure returns 'content_filter' response + fallback available -> fallback 
Exception maps azure content filter response exceptions
 2024-06-22 19:10:15 -07:00
Ishaan Jaff
4fc8efd640 bump: version 1.40.23 → 1.40.24 2024-06-22 18:00:40 -07:00
Krrish Dholakia
c4b1540ce0 fix(utils.py): support streamingchoices in 'get_response_string 2024-06-22 15:45:52 -07:00
Krrish Dholakia
bae7377128 docs(team_budgets.md): fix script 
/
 2024-06-22 15:42:05 -07:00
Krrish Dholakia
fc4e900a23 docs(team_budgets.md): update docs with script for testing dynamic rate limiting 2024-06-22 15:26:58 -07:00
Krrish Dholakia
a31a05d45d feat(dynamic_rate_limiter.py): working e2e 2024-06-22 14:41:22 -07:00
Ishaan Jaff
cb828a464a fix langfuse tests in_memory_langfuse_clients 2024-06-22 13:59:36 -07:00
Ishaan Jaff
ebbe97910c
Merge pull request #4360 from BerriAI/litellm_fix_access_audio_endpoint 
fix[ - Can't access /v1/audio/speech with some user key
 2024-06-22 13:46:50 -07:00
Ishaan Jaff
ab38a90be0 fix /audio/speech 2024-06-22 13:45:34 -07:00
Ishaan Jaff
c44e5a3d93 testing - use in memory langfuse client cache 2024-06-22 13:40:34 -07:00
Ishaan Jaff
b201402b0b fix testing - we had two files running the exact same langfuse test 2024-06-22 13:32:28 -07:00
Ishaan Jaff
c4f6b903b3 ui - new build 2024-06-22 09:13:34 -07:00
Ishaan Jaff
1a4ddf9a8e
Merge pull request #4356 from BerriAI/litellm_test_routes_on_proxy 
[Test] Test routes on LiteLLM Proxy always includes OpenAI Routes
 2024-06-22 09:12:30 -07:00
Ishaan Jaff
d32b8d589b
Merge pull request #4357 from BerriAI/litellm_use_jwt_in_cookies 
[Security Fix - Proxy Server ADMIN UI] - Store credentials in cookies + use strong JWT signing secret
 2024-06-22 09:12:17 -07:00
Krrish Dholakia
f814f24d9d fix(litellm_logging.py): Fix gemini google ai studio system prompt logging 
Fixes https://github.com/BerriAI/litellm/issues/2963
 2024-06-22 09:11:23 -07:00
Ishaan Jaff
066ed01d0f read token from cookie 2024-06-22 09:05:06 -07:00
Ishaan Jaff
c86efa55a5 use hash of master key encode the jwt 2024-06-22 08:58:31 -07:00
Ishaan Jaff
03d1d9229d ui - use cookies to return JWTs 2024-06-22 08:50:26 -07:00
Ishaan Jaff
204f7725ee ui - read jwts from cookie 2024-06-22 08:47:43 -07:00
Ishaan Jaff
b2a1cadf8c test test_routes_on_litellm_proxy 2024-06-22 08:19:17 -07:00
Krrish Dholakia
709bd9678c bump: version 1.40.22 → 1.40.23 2024-06-22 00:40:11 -07:00
Krrish Dholakia
532f24bfb7 refactor: instrument 'dynamic_rate_limiting' callback on proxy 2024-06-22 00:32:29 -07:00
Krish Dholakia
f192b76ed4
Merge pull request #4344 from BerriAI/litellm_refactor_langfuse_slack_trace_url 
refactor(litellm_logging.py): refactors how slack_alerting generates langfuse trace url
 2024-06-21 23:37:38 -07:00
Krrish Dholakia
068e8dff5b feat(dynamic_rate_limiter.py): passing base case 2024-06-21 22:46:46 -07:00
Marc Abramowitz
54bf89fa27 Document feature 2024-06-21 22:10:31 -07:00