scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-21 00:21:49 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 117
16040 commits 2565 branches 1413 tags 3.2 GiB
Commit graph

16040 commits

This branch
This branch
All branches
Author SHA1 Message Date
Ishaan Jaff
a0385ff067 auto update the model in cachedContents request 2024-08-08 17:19:12 -07:00
Ishaan Jaff
cf054def4a add native cachedContents endpoint 2024-08-08 17:19:12 -07:00
Ishaan Jaff
0c9f240305 doc on using litellm proxy with vertex ai content caching 2024-08-08 17:19:12 -07:00
Ishaan Jaff
e2e5e46979 add example using litellm proxy with gemini context caching 2024-08-08 17:19:12 -07:00
Ishaan Jaff
3178724579 add tests to make sure correct vertex ai route is used 2024-08-08 17:19:12 -07:00
Ishaan Jaff
ed125b90fd use v1beta1 when using cached_content 2024-08-08 17:19:12 -07:00
Ishaan Jaff
594a71cec3 fix handle case when service logger has no attribute prometheusServicesLogger 2024-08-08 17:19:12 -07:00
Krrish Dholakia
4ac0afef2c fix(anthropic.py): fix translation from /v1/messages format to openai format 2024-08-08 17:19:12 -07:00
Krrish Dholakia
2776d9cb0d fix(internal_user_endpoints.py): expose new 'internal_user_budget_duration' flag 
Relevant to - https://github.com/BerriAI/litellm/issues/5106
 2024-08-08 17:19:05 -07:00
Krrish Dholakia
8831f30e9d test: skip flaky langsmith tests 2024-08-08 17:18:59 -07:00
Krrish Dholakia
d262501344 test(test_langsmith.py): fix test 2024-08-08 17:18:59 -07:00
Krrish Dholakia
f75a31cd11 fix(user_api_key_auth.py): Fixes https://github.com/BerriAI/litellm/issues/5111 2024-08-08 17:18:59 -07:00
Krrish Dholakia
e6a5d43ebc test: skip flaky langsmith tests 2024-08-08 13:44:15 -07:00
Krrish Dholakia
ac601a69fc feat: set max_internal_budget for user w/ sso 2024-08-08 12:44:07 -07:00
Krrish Dholakia
5d664c0441 build(model_prices_and_context_window.json): Fixes https://github.com/BerriAI/litellm/issues/5113 2024-08-08 09:11:59 -07:00
Krrish Dholakia
ee8d2f25b9 build: ui - update to include max budget per team 2024-08-08 09:09:23 -07:00
Krrish Dholakia
2710bec02d docs(scheduler.md): cleanup docs to use /chat/completion endpoint 2024-08-07 21:49:06 -07:00
Krrish Dholakia
381fc213f8 bump: version 1.43.2 → 1.43.3 2024-08-07 20:33:10 -07:00
Krrish Dholakia
a03860b1cf test(test_completion.py): fix merge error 2024-08-07 20:31:38 -07:00
Krish Dholakia
e1610d37b9
Merge pull request #5099 from BerriAI/litellm_personal_user_budgets 
fix(user_api_key_auth.py): respect team budgets over user budget, if key belongs to team
 2024-08-07 20:00:16 -07:00
Krish Dholakia
37ef63f522
Merge pull request #5101 from BerriAI/litellm_router_prioritization 
feat(router.py): allows /chat/completion endpoint to work for request prioritization calls
 2024-08-07 20:00:06 -07:00
Krish Dholakia
baf01b47d8
Merge branch 'main' into litellm_personal_user_budgets 2024-08-07 19:59:50 -07:00
Krrish Dholakia
7e1f296981 docs(self_serve.md): cleanup docs on how to onboard new users + teams 2024-08-07 19:58:36 -07:00
Krrish Dholakia
ec0b511119 fix: use more descriptive flag 2024-08-07 18:59:46 -07:00
Krrish Dholakia
b7e31638fd fix(internal_user_endpoints.py): respect 'max_user_budget' for new internal user's 2024-08-07 18:50:40 -07:00
Ishaan Jaff
e17e959c62 image gen catch when predictions not in json response 2024-08-07 18:50:26 -07:00
Ishaan Jaff
e1a78faf98 run that ci cd again 2024-08-07 18:47:11 -07:00
Krrish Dholakia
b4392d2b67 test(test_amazing_vertex_completion.py): fix test for json schema validation in openai schema 2024-08-07 18:39:20 -07:00
Ishaan Jaff
b571f3e115 run that ci/cd again 2024-08-07 18:25:52 -07:00
Krrish Dholakia
4e02425d8b fix(vertex_ai_partner.py): pass model for llama3 param mapping 2024-08-07 18:16:41 -07:00
Ishaan Jaff
75bfe81748 fix all optional param tests 2024-08-07 18:16:41 -07:00
Ishaan Jaff
472a1df76f fix test for wildcard routing 2024-08-07 18:16:41 -07:00
Ishaan Jaff
4c375d13d6 fix test_drop_params_parallel_tool_calls 2024-08-07 18:16:41 -07:00
Krrish Dholakia
a15317a377 fix(vertex_ai_partner.py): pass model for llama3 param mapping 2024-08-07 18:07:14 -07:00
Ishaan Jaff
4e90a25417 fix all optional param tests 2024-08-07 17:52:40 -07:00
Krrish Dholakia
400653992c feat(router.py): allow using .acompletion() for request prioritization 
allows /chat/completion endpoint to work for request prioritization calls
 2024-08-07 16:43:12 -07:00
Ishaan Jaff
6b03998e32 fix test for wildcard routing 2024-08-07 16:41:00 -07:00
Ishaan Jaff
341e098c32 fix test_drop_params_parallel_tool_calls 2024-08-07 16:26:56 -07:00
Ishaan Jaff
e585dfba92 docs prom 2024-08-07 16:03:11 -07:00
Krrish Dholakia
639f84d609 test(test_completion.py): handle gemini instability 2024-08-07 15:58:47 -07:00
Krish Dholakia
b6df998ac3
Merge pull request #5100 from sammcj/patch-1 
Add deepseek-coder-v2(-lite), mistral-large, codegeex4 to ollama
 2024-08-07 15:56:02 -07:00
Sam
8459046585
Add deepseek-coder-v2(-lite), mistral-large, codegeex4 to ollama 2024-08-08 10:51:59 +12:00
Ishaan Jaff
89050dc4f4 ci/cd run again 2024-08-07 15:44:54 -07:00
Ishaan Jaff
4543dbb2e2 fixinstalling openai on ci/cd 2024-08-07 15:44:36 -07:00
Ishaan Jaff
2c3e068435 fix test_team_update_redis 2024-08-07 15:37:02 -07:00
Krrish Dholakia
f76261af35 refactor(user_api_key_auth.py): refactor to replace user_id_information list with pydantic user_obj 
Allows using the 'get_user_object' function in user_api_key_auth, keeping it consistent across jwt-auth and key-auth
 2024-08-07 15:33:55 -07:00
Ishaan Jaff
be0984009b bump: version 1.43.1 → 1.43.2 2024-08-07 15:26:55 -07:00
Ishaan Jaff
aab91a7314 fix - someone resolved a merge conflict badly 2024-08-07 15:23:15 -07:00
Ishaan Jaff
9cd437135b fix getting provider_specific_deployment 2024-08-07 15:20:59 -07:00
Krrish Dholakia
ff373663a3 fix: fix tests 2024-08-07 15:02:04 -07:00