Commit graph

14387 commits

Author SHA1 Message Date
Ishaan Jaff
9e7d8ba910 /spend/calculate use model aliases on this endpoint 2024-06-24 21:14:00 -07:00
Krish Dholakia
9902947521
Merge pull request #4390 from BerriAI/litellm_langfuse_router_logging
Log rejected router requests to langfuse
2024-06-24 21:13:45 -07:00
Ishaan Jaff
a64d1de80f test - aliases on /spend/calculate 2024-06-24 21:13:01 -07:00
Ishaan Jaff
7e5f200c6d
Merge pull request #4394 from BerriAI/docs_enterprise_control_routes
docs control available public routes
2024-06-24 20:57:00 -07:00
Ishaan Jaff
7f8c502a44 docs control available public routes 2024-06-24 20:54:43 -07:00
Ishaan Jaff
b900200c58 fix deps 2024-06-24 20:29:33 -07:00
Ishaan Jaff
60bd5cb6b1 fix config.yaml 2024-06-24 20:28:58 -07:00
Ishaan Jaff
fa57d2e823 feat use custom eviction policy 2024-06-24 20:28:03 -07:00
Ishaan Jaff
37f2712bba
Merge pull request #4389 from BerriAI/litellm_allow_user_to_define_public_routes
[Feat-Enterprise] - Allow setting custom public routes
2024-06-24 20:23:35 -07:00
Krish Dholakia
5d570e7c6c
Merge pull request #4392 from BerriAI/litellm_gemini_content_policy_errors
fix(vertex_httpx.py): cover gemini content violation (on prompt)
2024-06-24 20:00:06 -07:00
Ishaan Jaff
2aa0ce50b5 fix importing litellm 2024-06-24 19:58:53 -07:00
Ishaan Jaff
bd2298eba4 example cofnig with public routes 2024-06-24 19:51:23 -07:00
Ishaan Jaff
5e1403cd0a add helper to check route_in_additonal_public_routes 2024-06-24 19:50:35 -07:00
Krrish Dholakia
d182ea0f77 fix(utils.py): catch 422-status errors 2024-06-24 19:41:48 -07:00
Ishaan Jaff
11117665e1 test - spend/calculate endpoints 2024-06-24 19:32:52 -07:00
Krish Dholakia
95f972ee9f
Merge pull request #4388 from BerriAI/litellm_custom_model_info
Support custom model info for router logic (e.g. `max_input_tokens`)
2024-06-24 19:31:37 -07:00
Krrish Dholakia
8e6e5a6d37 fix(vertex_httpx.py): Return empty model response for content filter violations 2024-06-24 19:22:20 -07:00
Krrish Dholakia
1ff0129a94 fix(vertex_httpx.py): cover gemini content violation (on prompt) 2024-06-24 19:13:56 -07:00
Ishaan Jaff
02ffed2545 feat - refactor /spend/calculate 2024-06-24 19:05:34 -07:00
Krrish Dholakia
a4bea47a2d fix(router.py): log rejected router requests to langfuse
Fixes issue where rejected requests weren't being logged
2024-06-24 17:52:01 -07:00
Ishaan Jaff
5309be2456 example config with public routes 2024-06-24 17:46:38 -07:00
Ishaan Jaff
2f90759db5 feat - allow user to define public routes 2024-06-24 17:45:13 -07:00
Ishaan Jaff
6091c7798e use cache tools as dep 2024-06-24 17:31:59 -07:00
Ishaan Jaff
d0b1d3e9cc fix python3.8 with cachetools 2024-06-24 17:30:48 -07:00
Krrish Dholakia
341c7857c1 test(test_router.py): add testing 2024-06-24 17:28:12 -07:00
Ishaan Jaff
effc7579ac fix install on python 3.8 2024-06-24 17:27:14 -07:00
Krrish Dholakia
f5fbdf0fee fix(router.py): use user-defined model_input_tokens for pre-call filter checks 2024-06-24 17:25:26 -07:00
Ishaan Jaff
b13a93d9bc cleanup InMemoryCache 2024-06-24 17:24:59 -07:00
Ishaan Jaff
4053c7aeb3 use lru cache 2024-06-24 17:15:53 -07:00
Ishaan Jaff
2e3119e75f fix testing env 2024-06-24 17:12:11 -07:00
Ishaan Jaff
5bbbb5a7ee fix router.py 2024-06-24 17:10:34 -07:00
Ishaan Jaff
e5ab0d4ecd fix InMemoryCache 2024-06-24 17:08:30 -07:00
Ishaan Jaff
974d92ff45 fix use caching lib 2024-06-24 17:03:23 -07:00
Krrish Dholakia
123477b55a fix(utils.py): fix exception_mapping check for errors
If exception already mapped - don't attach traceback to it
2024-06-24 16:55:19 -07:00
Krrish Dholakia
bab4a6c5df feat(internal_user_endpoints.py): expose /user/delete endpoint 2024-06-24 13:29:26 -07:00
Ishaan Jaff
70a605b3cc docs - update telemetry 2024-06-24 13:21:16 -07:00
Ishaan Jaff
dd048cf342
Merge pull request #4382 from BerriAI/litellm_ui_fix_login_bug
[Fix] - Admin UI login bug
2024-06-24 08:19:37 -07:00
Ishaan Jaff
bd160745f9
Merge pull request #4379 from 7HR4IZ3/main
fix: Lunary integration
2024-06-24 08:11:19 -07:00
Ishaan Jaff
acbcfef5af fix ui login bug 2024-06-24 07:54:08 -07:00
7HR4IZ3
515dc9acc7
fix: Lunary integration
Fixes the bug of litellm not logging system messages to lunary
2024-06-24 14:09:40 +01:00
Islam Nofl
e2af13550a
Rename ollama prompt 'Function' word to 'Name' 2024-06-24 08:01:15 +03:00
corrm
b8a8b0847c Added improved function name handling in ollama_async_streaming 2024-06-24 05:56:56 +03:00
corrm
423a60c8bc chore: Improved OllamaConfig get_required_params and ollama_acompletion and ollama_async_streaming functions 2024-06-24 05:55:22 +03:00
corrm
b2c1a3ad79 chore: Improved prompt generation in ollama_pt function 2024-06-24 05:54:58 +03:00
Brian Schultheiss
5a6588342c added test for change 2024-06-23 15:19:54 -07:00
Brian Schultheiss
3fbb25f903 Updated more references to AWS session token 2024-06-23 13:37:38 -07:00
Brian Schultheiss
7f91e53548 updated documentation to reference boto3.client credential extraction, and update boto3.client creation to support session_token. 2024-06-23 13:15:04 -07:00
Brian Schultheiss
8ad1ae73e5 Support aws_session_token for bedrock client. https://github.com/BerriAI/litellm/issues/4346 2024-06-23 12:51:25 -07:00
Krrish Dholakia
769c60e4f6 test: skip unstable tests 2024-06-23 00:30:45 -07:00
Krrish Dholakia
3d09a196a4 test(test_completion.py): handle replicate api error 2024-06-23 00:06:15 -07:00