scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-08-28 05:25:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 8
45043 commits 3745 branches 1395 tags 3.9 GiB
Commit graph

898 commits

Author SHA1 Message Date
Krish Dholakia
3933fba41f
LiteLLM Minor Fixes & Improvements (09/19/2024) (#5793) 
* fix(model_prices_and_context_window.json): add cost tracking for more vertex llama3.1 model

8b and 70b models

* fix(proxy/utils.py): handle data being none on pre-call hooks

* fix(proxy/): create views on initial proxy startup

fixes base case, where user starts proxy for first time

 Fixes https://github.com/BerriAI/litellm/issues/5756

* build(config.yml): fix vertex version for test

* feat(ui/): support enabling/disabling slack alerting

Allows admin to turn on/off slack alerting through ui

* feat(rerank/main.py): support langfuse logging

* fix(proxy/utils.py): fix linting errors

* fix(langfuse.py): log clean metadata

* test(tests): replace deprecated openai model
 2024-09-20 08:19:52 -07:00
Ishaan Jaff
85acdb9193
[Feat] Add max_completion_tokens param (#5691) 
* add max_completion_tokens

* add max_completion_tokens

* add max_completion_tokens support for OpenAI models

* add max_completion_tokens param

* add max_completion_tokens for bedrock converse models

* add test for converse maxTokens

* fix openai o1 param mapping test

* move test optional params

* add max_completion_tokens for anthropic api

* fix conftest

* add max_completion tokens for vertex ai partner models

* add max_completion_tokens for fireworks ai

* add max_completion_tokens for hf rest api

* add test for param mapping

* add param mapping for vertex, gemini + testing

* predibase is the most unstable and unusable llm api in prod, can't handle our ci/cd

* add max_completion_tokens to openai supported params

* fix fireworks ai param mapping
 2024-09-14 14:57:01 -07:00
Ishaan Jaff
ded40e4d41 bump openai to 1.45.0 2024-09-12 14:18:15 -07:00
Ishaan Jaff
bea34c9231 fix config.yml 2024-09-12 09:28:45 -07:00
Ishaan Jaff
9ca7de58d6 fix testing 2024-09-12 08:42:00 -07:00
Ishaan Jaff
e5a776dc07 make separate assistants testing pipeline 2024-09-12 08:30:21 -07:00
Ishaan Jaff
f880e2b958 fix respx 2024-09-12 08:26:31 -07:00
Ishaan Jaff
fbe92df87e fix router tests 2024-09-12 08:24:37 -07:00
Ishaan Jaff
9c79c1c7b2 fix ci/cd tests 2024-09-12 08:23:56 -07:00
Ishaan Jaff
d944bd98b9 fix config.yml 2024-09-12 08:21:05 -07:00
Ishaan Jaff
d65ba87014 add litellm router testing 2024-09-12 08:19:34 -07:00
Ishaan Jaff
da29b070bb print load test results 2024-09-11 20:53:52 -07:00
Ishaan Jaff
a08ad0ea70 add load tests to ci/cd 2024-09-11 20:50:57 -07:00
Ishaan Jaff
f339f9614a fix requirements.txt 2024-09-11 13:35:37 -07:00
Ishaan Jaff
1415bdd6fa fix testing + req.txt 2024-09-11 13:30:42 -07:00
Ishaan Jaff
a66f03f860 fix installing litellm 2024-09-11 12:45:39 -07:00
Ishaan Jaff
edc51f45ac add error message on test 2024-09-05 15:46:13 -07:00
Ishaan Jaff
30137b0b72 run ci - cd again 2024-09-05 15:42:40 -07:00
Ishaan Jaff
05e02fbe76 run ci/cd again 2024-09-05 15:38:49 -07:00
Ishaan Jaff
004a71b8dc use requirements txt 2024-09-05 15:34:17 -07:00
Ishaan Jaff
42b2566906 run ci/cd agaiin 2024-09-05 15:26:12 -07:00
Ishaan Jaff
3d9049df6d move folder key gen prisma is in 2024-09-05 15:24:00 -07:00
Ishaan Jaff
5b1d207cf4 run test again 2024-09-05 15:20:21 -07:00
Ishaan Jaff
e551680fce add step for ui testing 2024-09-05 15:15:41 -07:00
Ishaan Jaff
ed951e5e35 bump langfuse sdk version on docker 2024-09-03 18:09:00 -07:00
Ishaan Jaff
06857d108d fix /spend logs call 2024-08-30 17:02:24 -07:00
Ishaan Jaff
c86d1cb391 fix tests 2024-08-30 16:29:32 -07:00
Ishaan Jaff
f3f85f6141 add test for vertex basic pass throgh 2024-08-30 16:26:00 -07:00
Ishaan Jaff
c8fc5c44e1 ci/cd run again 2024-08-27 22:53:18 -07:00
Ishaan Jaff
bcf7f3e437 handle flaky pytests 2024-08-27 22:44:49 -07:00
Ishaan Jaff
1ee0e8a9c3 undo chage on config.yaml 2024-08-27 22:24:21 -07:00
Ishaan Jaff
01987388c2 allow running contributor PRs 2024-08-27 22:17:01 -07:00
Krrish Dholakia
e542475f39 build(config.yml): bump anyio version 2024-08-27 07:37:06 -07:00
Ishaan Jaff
5895f0c615 fix custom guardrail test 2024-08-23 11:58:20 -07:00
Ishaan Jaff
7d30188f84 custom_callbacks 2024-08-23 09:52:52 -07:00
Ishaan Jaff
18cd905a1f ci/cd run again 2024-08-22 18:41:10 -07:00
Ishaan Jaff
228252b92d
Merge branch 'main' into litellm_allow_using_azure_ad_token_auth 2024-08-22 18:21:24 -07:00
Ishaan Jaff
2bf1fb3275 add test for test_azure_tenant_id_auth 2024-08-22 18:09:00 -07:00
Ishaan Jaff
1f0cc72531 test bedrock guardrails 2024-08-22 17:24:42 -07:00
Krrish Dholakia
c216e2cc2d build(config.yml): pin openai version 2024-08-21 12:50:44 -07:00
Ishaan Jaff
590c5eade6 fix log to OTEL 2024-08-19 19:10:29 -07:00
Ishaan Jaff
a37f087b62 fix ci/cd pipeline 2024-08-13 20:33:33 -07:00
Ishaan Jaff
65b42ac35b pin orjson dep on req.txt 2024-08-08 17:36:12 -07:00
Ishaan Jaff
1f43368110 fix log to otel test 2024-08-08 17:29:38 -07:00
Ishaan Jaff
6b03998e32 fix test for wildcard routing 2024-08-07 16:41:00 -07:00
Ishaan Jaff
4543dbb2e2 fixinstalling openai on ci/cd 2024-08-07 15:44:36 -07:00
Krrish Dholakia
55ad5bb7c6 fix(config.yml): fix build and test 2024-08-07 13:23:04 -07:00
Krrish Dholakia
a2e792d32e test: update build requirements 2024-08-07 13:09:49 -07:00
Ishaan Jaff
404360b28d test pass through endpoint 2024-08-06 12:16:00 -07:00
Krrish Dholakia
1dda67a3ae build(config.yml): pin prisma version 2024-08-05 19:59:00 -07:00