Commit graph

16341 commits

Author SHA1 Message Date
Krrish Dholakia
28faafadb1 feat(pass_through_endpoints.py): initial commit of crud endpoints for pass through endpoints 2024-08-14 21:36:07 -07:00
Krrish Dholakia
a020563149 feat(proxy_server.py): support returning available fields for pass_through_endpoints via `/config/field/list 2024-08-14 19:07:10 -07:00
Krrish Dholakia
10f27bb1b5 test(test_pass_through_endpoints.py): fix langfuse base 2024-08-14 14:13:21 -07:00
Krrish Dholakia
5af9794b9d test(test_pass_through_endpoints.py): correctly reset test 2024-08-14 10:48:42 -07:00
Krrish Dholakia
6bcfa90ba8 test(test_pass_through_endpoints.py): fix test 2024-08-14 09:53:19 -07:00
Krrish Dholakia
5fdbfcee44 fix(user_api_key_auth.py): more precisely expand scope to handle 'basic' tokens 2024-08-13 22:00:33 -07:00
Krrish Dholakia
742e3cbccf feat(user_api_key_auth.py): support calling langfuse with litellm user_api_key_auth 2024-08-13 20:26:24 -07:00
Krrish Dholakia
66d77f177f fix(bedrock_httpx.py): raise bad request error if invalid bedrock model given 2024-08-13 19:27:06 -07:00
Ishaan Jaff
b8e5b25dcc
Merge pull request #5184 from fozziethebeat/fix-vllm-docs
Improving the proxy docs for configuring with vllm
2024-08-13 18:47:01 -07:00
Ishaan Jaff
c7804e1ea2 ui new build 2024-08-13 18:45:09 -07:00
Ishaan Jaff
4159897570
Merge pull request #5187 from BerriAI/litellm_handle_session_expired_ui
[Feat-UI] - Handle session expired on UI
2024-08-13 17:15:23 -07:00
Ishaan Jaff
d85762b32f ui - handle session expired on ui 2024-08-13 17:09:56 -07:00
Krrish Dholakia
cdce13434e fix(teams.tsx): add team_id to team table on ui 2024-08-13 16:08:49 -07:00
Keith Stevens
17c6a4e532 Improving the proxy docs for configuring with vllm 2024-08-13 16:07:41 -07:00
Ishaan Jaff
063fb380e1
Merge pull request #5181 from BerriAI/litellm_check_x_fwded_for
[Feat-Proxy Security] Allow Using `x-forwarded-for` for enforcing + tracking  ip address
2024-08-13 16:07:31 -07:00
Ishaan Jaff
d0e6ca659f add test for test_check_valid_ip_sent_with_x_forwarded_for 2024-08-13 15:54:53 -07:00
Ishaan Jaff
b94c982ec9 use _check_valid_ip 2024-08-13 15:41:01 -07:00
Ishaan Jaff
0c6c350c23 feat log use_x_forwarded_for 2024-08-13 15:22:54 -07:00
Krrish Dholakia
a9a3282031 fix(langsmith.py): support langsmith 'extra' field object
Closes https://github.com/BerriAI/litellm/issues/5179
2024-08-13 15:20:50 -07:00
Ishaan Jaff
ab208eb546 check use_x_forwarded_for 2024-08-13 15:18:24 -07:00
Krrish Dholakia
3a1b3227d8 fix(utils.py): ignore none chunk in stream infinite loop check
Fixes https://github.com/BerriAI/litellm/issues/5158#issuecomment-2287156946
2024-08-13 15:06:44 -07:00
Ishaan Jaff
b24da18d2d
Merge pull request #5180 from BerriAI/litellm_allow_controlling_logged_tags_langfuse
[Feat-Proxy+langfuse] LiteLLM-specific Tags on Langfuse - `cache_hit`, `cache_key`
2024-08-13 13:50:01 -07:00
Krrish Dholakia
7e99cfe938 docs(user_keys.md): cleanup instructor docs 2024-08-13 13:15:46 -07:00
Krrish Dholakia
ac8c0ecd85 docs(user_keys.md): cleanup docs 2024-08-13 13:14:27 -07:00
Ishaan Jaff
81680d6b1a docs control langfuse specific tags 2024-08-13 12:48:42 -07:00
Ishaan Jaff
82dd3fcc73 add langfuse_default_tags 2024-08-13 12:28:28 -07:00
Ishaan Jaff
f1df555c79 allow using langfuse_default_tags 2024-08-13 12:26:37 -07:00
Ishaan Jaff
42bd5de7c0 feat allow controlling logged tags on langfuse 2024-08-13 12:24:01 -07:00
Krrish Dholakia
526b196f83 fix(bedrock_httpx.py): handle empty stop string 2024-08-13 07:30:30 -07:00
Krrish Dholakia
6e8d2856b0 fix(bedrock_httpx.py): handle bedrock empty system message 2024-08-13 07:17:17 -07:00
Krrish Dholakia
718c2cfa4e docs(team_logging.md): cleanup docs 2024-08-12 19:53:05 -07:00
Krrish Dholakia
d1d28487f7 refactor(test_users.py): refactor test for user info to use mock endpoints 2024-08-12 18:48:43 -07:00
Ishaan Jaff
66c0d32b1d fix gcs logging test 2024-08-12 17:42:04 -07:00
Krrish Dholakia
ef8fb23334 fix(cost_calculator.py): fix cost calc 2024-08-12 16:47:15 -07:00
Ishaan Jaff
89e3141e2d
Merge pull request #5171 from BerriAI/litellm_log_gcs_in_folders
[Feat] Log GCS logs in folders based on dd-m-yyyy
2024-08-12 16:37:33 -07:00
Ishaan Jaff
6589666028 fix gcs test 2024-08-12 16:34:27 -07:00
Ishaan Jaff
3d06abb55a tes logging to gcs buckets 2024-08-12 16:33:35 -07:00
Krrish Dholakia
a8644d8a7d fix(utils.py): if openai model, don't check hf tokenizers 2024-08-12 16:28:22 -07:00
Ishaan Jaff
49b8dee14d feat log responses in folders 2024-08-12 16:28:12 -07:00
Ishaan Jaff
96f3eb99c9 test gcs logging payload 2024-08-12 16:07:08 -07:00
Ishaan Jaff
19240b6cfd feat gcs log user api key metadata 2024-08-12 16:06:10 -07:00
Krrish Dholakia
e9c88952b9 bump: version 1.43.8 → 1.43.9 2024-08-12 15:50:07 -07:00
Krrish Dholakia
22e2840daa fix(cost_calculator.py): handle openai usage pydantic object
Fixes https://github.com/BerriAI/litellm/issues/5165
2024-08-12 15:45:21 -07:00
Krrish Dholakia
fdd9a07051 fix(utils.py): Break out of infinite streaming loop
Fixes https://github.com/BerriAI/litellm/issues/5158
2024-08-12 14:00:43 -07:00
Ishaan Jaff
d0a68ab123 bump: version 1.43.7 → 1.43.8 2024-08-12 12:27:09 -07:00
Ishaan Jaff
12f9894d69
Merge pull request #5168 from BerriAI/litellm_use_user_api_key_auth_int_usr_endpoints
[Feat Proxy] Send slack alert on CRUD endpoints for Internal Users
2024-08-12 12:20:16 -07:00
Ishaan Jaff
0fbcfef08a
Merge pull request #5167 from BerriAI/litellm_fix_docstring
[Proxy docstring] fix curl on docstring on /team endpoints
2024-08-12 12:20:03 -07:00
Ishaan Jaff
c401970522
Merge pull request #5166 from BerriAI/litellm_log_key_created_slack
[Feat-Security] Send Slack Alert when CRUD ops done on Virtual Keys, Teams, Internal Users
2024-08-12 12:18:04 -07:00
Ishaan Jaff
1c71e4db17 fix internal user tests to pass 2024-08-12 12:11:23 -07:00
Ishaan Jaff
a44bd23631 log new_user, delete user 2024-08-12 12:01:26 -07:00