Commit graph

9604 commits

Author SHA1 Message Date
Caixiaopig
3d96e810b0
Updating the default Anthropic Officlal Claude 3 max_tokens to 4096
fix bug
2024-04-05 09:45:57 -05:00
Caixiaopig
09463bc584
Updating the default Anthropic Claude 3 max_tokens to 4096
The default value of max_tokens used to be 256. If the client does not set a larger value, the model's output may be truncated, so the default value has been changed to 4096. This value is also the maximum output value described in the official interface.
see: https://docs.anthropic.com/claude/reference/messages_post
2024-04-05 14:44:40 +08:00
Krrish Dholakia
b0d80de14d docs(vertex.md): fix import routes 2024-04-04 21:32:44 -07:00
Krrish Dholakia
003cd3b102 docs(vertex.md): add tutorial for using vertex ai with gcp service account 2024-04-04 21:28:28 -07:00
Ishaan Jaff
d313f5bd61
Merge pull request #2847 from themrzmaster/feat/add_command_r_plus
Add command-r-plus
2024-04-04 21:06:42 -07:00
Krrish Dholakia
e1aa536ea6 bump: version 1.34.26 → 1.34.27 2024-04-04 20:02:41 -07:00
Krish Dholakia
b5f74bf6b7
Merge pull request #2851 from BerriAI/litellm_add_model_api_fix
feat(ui): add models via ui
2024-04-04 19:43:58 -07:00
Krish Dholakia
24e2535441
Merge branch 'main' into litellm_add_model_api_fix 2024-04-04 19:43:52 -07:00
Krrish Dholakia
1ee78c39e9 fix(proxy_server.py): skip to next model if invalid model (raise logger.error) 2024-04-04 19:22:17 -07:00
Krrish Dholakia
fbfcd57798 fix(proxy_server.py): fix linting issue 2024-04-04 19:15:57 -07:00
Krrish Dholakia
e3c2bdef4d feat(ui): add models via ui
adds ability to add models via ui to the proxy. also fixes additional bugs around new /model/new endpoint
2024-04-04 18:56:20 -07:00
Ishaan Jaff
eaf81ed31c fix github stable releases 2024-04-04 18:26:47 -07:00
Ishaan Jaff
ab368fcfc7 fix use stable / latest tags correctly 2024-04-04 18:15:53 -07:00
Ishaan Jaff
28d55cb511 stable releases 2024-04-04 18:07:36 -07:00
Ishaan Jaff
66f579f923 stable releases - ci/cd 2024-04-04 18:06:17 -07:00
Ishaan Jaff
280a3d580b set release type 2024-04-04 18:02:37 -07:00
Ishaan Jaff
0dd7ab44ed set release type on releases 2024-04-04 18:00:22 -07:00
Ishaan Jaff
7f50b80917 (ci/cd) aws suspended account 2024-04-04 17:43:16 -07:00
Ishaan Jaff
0b748f2eb0 ui - new build 2024-04-04 17:36:26 -07:00
Ishaan Jaff
31e98aa90e
Merge pull request #2850 from BerriAI/litellm_track_cost_tag
[UI] Show Usage Per Tag
2024-04-04 17:31:36 -07:00
Ishaan Jaff
9663ee56f2 ui - view spend by tag 2024-04-04 17:30:28 -07:00
Ishaan Jaff
1f7a741e28 show cost per tag on ui 2024-04-04 17:20:23 -07:00
Ishaan Jaff
73fce02392 ui - view spend per tag 2024-04-04 17:18:01 -07:00
Ishaan Jaff
ac5507bd84 ui show spend per tag 2024-04-04 16:57:45 -07:00
Krrish Dholakia
2472311a3f test(test_caching.py): skip test - aws suspended account
will need to recreate these objects on a new aws account
2024-04-04 15:07:19 -07:00
Krrish Dholakia
2236f283fe fix(router.py): handle id being passed in as int 2024-04-04 14:23:10 -07:00
Ishaan Jaff
12e5118367
Merge pull request #2846 from BerriAI/litellm_docs_delete_cache_keys
docs - `delete`  cache keys
2024-04-04 14:07:50 -07:00
Krrish Dholakia
2e40ab959d test(test_router.py): fix casting 2024-04-04 13:54:16 -07:00
Krrish Dholakia
4dbb46cf42 docs(vertex.md): add docs on setting google_application_credentials 2024-04-04 13:49:03 -07:00
Krrish Dholakia
1441fccf9a fix(main.py): trigger new build 2024-04-04 13:36:21 -07:00
Krrish Dholakia
c372c873a0 test(test_router.py): fix test to check cast 2024-04-04 13:32:50 -07:00
lucca
be265fbb15
initial 2024-04-04 16:58:51 -03:00
Ishaan Jaff
9e9b617934 docs - delete cache keys 2024-04-04 12:20:14 -07:00
Ishaan Jaff
1119cc49a8
Merge pull request #2840 from BerriAI/litellm_return_cache_key_responses
[FEAT] Proxy - Delete Cache Keys + return cache key in responses
2024-04-04 11:52:52 -07:00
Krrish Dholakia
b9030be792 test(test_router.py): fix test to check type 2024-04-04 11:45:12 -07:00
Ishaan Jaff
7e1d5c81b4 return cache key in streming responses 2024-04-04 11:00:00 -07:00
Krrish Dholakia
f88545261c build(config.yml): add missing dep 2024-04-04 10:59:26 -07:00
Ishaan Jaff
c4cb0afa98 feat - delete cache key 2024-04-04 10:56:47 -07:00
Krrish Dholakia
98fa3ff1c5 refactor(main.py): trigger new build 2024-04-04 10:54:13 -07:00
Krrish Dholakia
861efda54d ci(config.yml): reset config.yml 2024-04-04 10:53:29 -07:00
Krrish Dholakia
592241b4eb fix(proxy_server.py): fix linting error 2024-04-04 10:40:32 -07:00
Krrish Dholakia
d34d6e0277 ci(config.yml): run linting test first 2024-04-04 10:33:30 -07:00
Krrish Dholakia
44a344e125 ci(config.yml): reorder steps - install deps first 2024-04-04 10:32:04 -07:00
Krrish Dholakia
ae96c2cfbd build(config.yml): pip install mypy 2024-04-04 10:29:12 -07:00
Krrish Dholakia
468732947f ci(config.yml): install pyyaml stubs 2024-04-04 10:27:57 -07:00
Krrish Dholakia
fbd8e8bc77 ci(config.yml): reorder test steps 2024-04-04 10:27:01 -07:00
Krrish Dholakia
62b8749fe8 build: trigger new build 2024-04-04 10:23:13 -07:00
Krrish Dholakia
f2e22ba17f ci(config.yml): fix import 2024-04-04 10:22:12 -07:00
Krrish Dholakia
7f3a8d2a5e build: trigger new build 2024-04-04 10:20:25 -07:00
Krrish Dholakia
3d46094f5a ci(mypy.ini): ignore missing imports 2024-04-04 10:19:13 -07:00