Ishaan Jaff
|
9e7d8ba910
|
/spend/calculate use model aliases on this endpoint
|
2024-06-24 21:14:00 -07:00 |
|
Krish Dholakia
|
9902947521
|
Merge pull request #4390 from BerriAI/litellm_langfuse_router_logging
Log rejected router requests to langfuse
|
2024-06-24 21:13:45 -07:00 |
|
Ishaan Jaff
|
a64d1de80f
|
test - aliases on /spend/calculate
|
2024-06-24 21:13:01 -07:00 |
|
Ishaan Jaff
|
7e5f200c6d
|
Merge pull request #4394 from BerriAI/docs_enterprise_control_routes
docs control available public routes
|
2024-06-24 20:57:00 -07:00 |
|
Ishaan Jaff
|
7f8c502a44
|
docs control available public routes
|
2024-06-24 20:54:43 -07:00 |
|
Ishaan Jaff
|
b900200c58
|
fix deps
|
2024-06-24 20:29:33 -07:00 |
|
Ishaan Jaff
|
60bd5cb6b1
|
fix config.yaml
|
2024-06-24 20:28:58 -07:00 |
|
Ishaan Jaff
|
fa57d2e823
|
feat use custom eviction policy
|
2024-06-24 20:28:03 -07:00 |
|
Ishaan Jaff
|
37f2712bba
|
Merge pull request #4389 from BerriAI/litellm_allow_user_to_define_public_routes
[Feat-Enterprise] - Allow setting custom public routes
|
2024-06-24 20:23:35 -07:00 |
|
Krish Dholakia
|
5d570e7c6c
|
Merge pull request #4392 from BerriAI/litellm_gemini_content_policy_errors
fix(vertex_httpx.py): cover gemini content violation (on prompt)
|
2024-06-24 20:00:06 -07:00 |
|
Ishaan Jaff
|
2aa0ce50b5
|
fix importing litellm
|
2024-06-24 19:58:53 -07:00 |
|
Ishaan Jaff
|
bd2298eba4
|
example cofnig with public routes
|
2024-06-24 19:51:23 -07:00 |
|
Ishaan Jaff
|
5e1403cd0a
|
add helper to check route_in_additonal_public_routes
|
2024-06-24 19:50:35 -07:00 |
|
Krrish Dholakia
|
d182ea0f77
|
fix(utils.py): catch 422-status errors
|
2024-06-24 19:41:48 -07:00 |
|
Ishaan Jaff
|
11117665e1
|
test - spend/calculate endpoints
|
2024-06-24 19:32:52 -07:00 |
|
Krish Dholakia
|
95f972ee9f
|
Merge pull request #4388 from BerriAI/litellm_custom_model_info
Support custom model info for router logic (e.g. `max_input_tokens`)
|
2024-06-24 19:31:37 -07:00 |
|
Krrish Dholakia
|
8e6e5a6d37
|
fix(vertex_httpx.py): Return empty model response for content filter violations
|
2024-06-24 19:22:20 -07:00 |
|
Krrish Dholakia
|
1ff0129a94
|
fix(vertex_httpx.py): cover gemini content violation (on prompt)
|
2024-06-24 19:13:56 -07:00 |
|
Ishaan Jaff
|
02ffed2545
|
feat - refactor /spend/calculate
|
2024-06-24 19:05:34 -07:00 |
|
Krrish Dholakia
|
a4bea47a2d
|
fix(router.py): log rejected router requests to langfuse
Fixes issue where rejected requests weren't being logged
|
2024-06-24 17:52:01 -07:00 |
|
Ishaan Jaff
|
5309be2456
|
example config with public routes
|
2024-06-24 17:46:38 -07:00 |
|
Ishaan Jaff
|
2f90759db5
|
feat - allow user to define public routes
|
2024-06-24 17:45:13 -07:00 |
|
Ishaan Jaff
|
6091c7798e
|
use cache tools as dep
|
2024-06-24 17:31:59 -07:00 |
|
Ishaan Jaff
|
d0b1d3e9cc
|
fix python3.8 with cachetools
|
2024-06-24 17:30:48 -07:00 |
|
Krrish Dholakia
|
341c7857c1
|
test(test_router.py): add testing
|
2024-06-24 17:28:12 -07:00 |
|
Ishaan Jaff
|
effc7579ac
|
fix install on python 3.8
|
2024-06-24 17:27:14 -07:00 |
|
Krrish Dholakia
|
f5fbdf0fee
|
fix(router.py): use user-defined model_input_tokens for pre-call filter checks
|
2024-06-24 17:25:26 -07:00 |
|
Ishaan Jaff
|
b13a93d9bc
|
cleanup InMemoryCache
|
2024-06-24 17:24:59 -07:00 |
|
Ishaan Jaff
|
4053c7aeb3
|
use lru cache
|
2024-06-24 17:15:53 -07:00 |
|
Ishaan Jaff
|
2e3119e75f
|
fix testing env
|
2024-06-24 17:12:11 -07:00 |
|
Ishaan Jaff
|
5bbbb5a7ee
|
fix router.py
|
2024-06-24 17:10:34 -07:00 |
|
Ishaan Jaff
|
e5ab0d4ecd
|
fix InMemoryCache
|
2024-06-24 17:08:30 -07:00 |
|
Ishaan Jaff
|
974d92ff45
|
fix use caching lib
|
2024-06-24 17:03:23 -07:00 |
|
Krrish Dholakia
|
123477b55a
|
fix(utils.py): fix exception_mapping check for errors
If exception already mapped - don't attach traceback to it
|
2024-06-24 16:55:19 -07:00 |
|
Krrish Dholakia
|
bab4a6c5df
|
feat(internal_user_endpoints.py): expose /user/delete endpoint
|
2024-06-24 13:29:26 -07:00 |
|
Ishaan Jaff
|
70a605b3cc
|
docs - update telemetry
|
2024-06-24 13:21:16 -07:00 |
|
Ishaan Jaff
|
dd048cf342
|
Merge pull request #4382 from BerriAI/litellm_ui_fix_login_bug
[Fix] - Admin UI login bug
|
2024-06-24 08:19:37 -07:00 |
|
Ishaan Jaff
|
bd160745f9
|
Merge pull request #4379 from 7HR4IZ3/main
fix: Lunary integration
|
2024-06-24 08:11:19 -07:00 |
|
Ishaan Jaff
|
acbcfef5af
|
fix ui login bug
|
2024-06-24 07:54:08 -07:00 |
|
7HR4IZ3
|
515dc9acc7
|
fix: Lunary integration
Fixes the bug of litellm not logging system messages to lunary
|
2024-06-24 14:09:40 +01:00 |
|
Islam Nofl
|
e2af13550a
|
Rename ollama prompt 'Function' word to 'Name'
|
2024-06-24 08:01:15 +03:00 |
|
corrm
|
b8a8b0847c
|
Added improved function name handling in ollama_async_streaming
|
2024-06-24 05:56:56 +03:00 |
|
corrm
|
423a60c8bc
|
chore: Improved OllamaConfig get_required_params and ollama_acompletion and ollama_async_streaming functions
|
2024-06-24 05:55:22 +03:00 |
|
corrm
|
b2c1a3ad79
|
chore: Improved prompt generation in ollama_pt function
|
2024-06-24 05:54:58 +03:00 |
|
Brian Schultheiss
|
5a6588342c
|
added test for change
|
2024-06-23 15:19:54 -07:00 |
|
Brian Schultheiss
|
3fbb25f903
|
Updated more references to AWS session token
|
2024-06-23 13:37:38 -07:00 |
|
Brian Schultheiss
|
7f91e53548
|
updated documentation to reference boto3.client credential extraction, and update boto3.client creation to support session_token.
|
2024-06-23 13:15:04 -07:00 |
|
Brian Schultheiss
|
8ad1ae73e5
|
Support aws_session_token for bedrock client. https://github.com/BerriAI/litellm/issues/4346
|
2024-06-23 12:51:25 -07:00 |
|
Krrish Dholakia
|
769c60e4f6
|
test: skip unstable tests
|
2024-06-23 00:30:45 -07:00 |
|
Krrish Dholakia
|
3d09a196a4
|
test(test_completion.py): handle replicate api error
|
2024-06-23 00:06:15 -07:00 |
|