Caixiaopig
3d96e810b0
Updating the default Anthropic Officlal Claude 3 max_tokens to 4096
...
fix bug
2024-04-05 09:45:57 -05:00
Caixiaopig
09463bc584
Updating the default Anthropic Claude 3 max_tokens to 4096
...
The default value of max_tokens used to be 256. If the client does not set a larger value, the model's output may be truncated, so the default value has been changed to 4096. This value is also the maximum output value described in the official interface.
see: https://docs.anthropic.com/claude/reference/messages_post
2024-04-05 14:44:40 +08:00
Krrish Dholakia
b0d80de14d
docs(vertex.md): fix import routes
2024-04-04 21:32:44 -07:00
Krrish Dholakia
003cd3b102
docs(vertex.md): add tutorial for using vertex ai with gcp service account
2024-04-04 21:28:28 -07:00
Ishaan Jaff
d313f5bd61
Merge pull request #2847 from themrzmaster/feat/add_command_r_plus
...
Add command-r-plus
2024-04-04 21:06:42 -07:00
Krrish Dholakia
e1aa536ea6
bump: version 1.34.26 → 1.34.27
2024-04-04 20:02:41 -07:00
Krish Dholakia
b5f74bf6b7
Merge pull request #2851 from BerriAI/litellm_add_model_api_fix
...
feat(ui): add models via ui
2024-04-04 19:43:58 -07:00
Krish Dholakia
24e2535441
Merge branch 'main' into litellm_add_model_api_fix
2024-04-04 19:43:52 -07:00
Krrish Dholakia
1ee78c39e9
fix(proxy_server.py): skip to next model if invalid model (raise logger.error)
2024-04-04 19:22:17 -07:00
Krrish Dholakia
fbfcd57798
fix(proxy_server.py): fix linting issue
2024-04-04 19:15:57 -07:00
Krrish Dholakia
e3c2bdef4d
feat(ui): add models via ui
...
adds ability to add models via ui to the proxy. also fixes additional bugs around new /model/new endpoint
2024-04-04 18:56:20 -07:00
Ishaan Jaff
eaf81ed31c
fix github stable releases
2024-04-04 18:26:47 -07:00
Ishaan Jaff
ab368fcfc7
fix use stable / latest tags correctly
2024-04-04 18:15:53 -07:00
Ishaan Jaff
28d55cb511
stable releases
2024-04-04 18:07:36 -07:00
Ishaan Jaff
66f579f923
stable releases - ci/cd
2024-04-04 18:06:17 -07:00
Ishaan Jaff
280a3d580b
set release type
2024-04-04 18:02:37 -07:00
Ishaan Jaff
0dd7ab44ed
set release type on releases
2024-04-04 18:00:22 -07:00
Ishaan Jaff
7f50b80917
(ci/cd) aws suspended account
2024-04-04 17:43:16 -07:00
Ishaan Jaff
0b748f2eb0
ui - new build
2024-04-04 17:36:26 -07:00
Ishaan Jaff
31e98aa90e
Merge pull request #2850 from BerriAI/litellm_track_cost_tag
...
[UI] Show Usage Per Tag
2024-04-04 17:31:36 -07:00
Ishaan Jaff
9663ee56f2
ui - view spend by tag
2024-04-04 17:30:28 -07:00
Ishaan Jaff
1f7a741e28
show cost per tag on ui
2024-04-04 17:20:23 -07:00
Ishaan Jaff
73fce02392
ui - view spend per tag
2024-04-04 17:18:01 -07:00
Ishaan Jaff
ac5507bd84
ui show spend per tag
2024-04-04 16:57:45 -07:00
Krrish Dholakia
2472311a3f
test(test_caching.py): skip test - aws suspended account
...
will need to recreate these objects on a new aws account
2024-04-04 15:07:19 -07:00
Krrish Dholakia
2236f283fe
fix(router.py): handle id being passed in as int
2024-04-04 14:23:10 -07:00
Ishaan Jaff
12e5118367
Merge pull request #2846 from BerriAI/litellm_docs_delete_cache_keys
...
docs - `delete` cache keys
2024-04-04 14:07:50 -07:00
Krrish Dholakia
2e40ab959d
test(test_router.py): fix casting
2024-04-04 13:54:16 -07:00
Krrish Dholakia
4dbb46cf42
docs(vertex.md): add docs on setting google_application_credentials
2024-04-04 13:49:03 -07:00
Krrish Dholakia
1441fccf9a
fix(main.py): trigger new build
2024-04-04 13:36:21 -07:00
Krrish Dholakia
c372c873a0
test(test_router.py): fix test to check cast
2024-04-04 13:32:50 -07:00
lucca
be265fbb15
initial
2024-04-04 16:58:51 -03:00
Ishaan Jaff
9e9b617934
docs - delete cache keys
2024-04-04 12:20:14 -07:00
Ishaan Jaff
1119cc49a8
Merge pull request #2840 from BerriAI/litellm_return_cache_key_responses
...
[FEAT] Proxy - Delete Cache Keys + return cache key in responses
2024-04-04 11:52:52 -07:00
Krrish Dholakia
b9030be792
test(test_router.py): fix test to check type
2024-04-04 11:45:12 -07:00
Ishaan Jaff
7e1d5c81b4
return cache key in streming responses
2024-04-04 11:00:00 -07:00
Krrish Dholakia
f88545261c
build(config.yml): add missing dep
2024-04-04 10:59:26 -07:00
Ishaan Jaff
c4cb0afa98
feat - delete cache key
2024-04-04 10:56:47 -07:00
Krrish Dholakia
98fa3ff1c5
refactor(main.py): trigger new build
2024-04-04 10:54:13 -07:00
Krrish Dholakia
861efda54d
ci(config.yml): reset config.yml
2024-04-04 10:53:29 -07:00
Krrish Dholakia
592241b4eb
fix(proxy_server.py): fix linting error
2024-04-04 10:40:32 -07:00
Krrish Dholakia
d34d6e0277
ci(config.yml): run linting test first
2024-04-04 10:33:30 -07:00
Krrish Dholakia
44a344e125
ci(config.yml): reorder steps - install deps first
2024-04-04 10:32:04 -07:00
Krrish Dholakia
ae96c2cfbd
build(config.yml): pip install mypy
2024-04-04 10:29:12 -07:00
Krrish Dholakia
468732947f
ci(config.yml): install pyyaml stubs
2024-04-04 10:27:57 -07:00
Krrish Dholakia
fbd8e8bc77
ci(config.yml): reorder test steps
2024-04-04 10:27:01 -07:00
Krrish Dholakia
62b8749fe8
build: trigger new build
2024-04-04 10:23:13 -07:00
Krrish Dholakia
f2e22ba17f
ci(config.yml): fix import
2024-04-04 10:22:12 -07:00
Krrish Dholakia
7f3a8d2a5e
build: trigger new build
2024-04-04 10:20:25 -07:00
Krrish Dholakia
3d46094f5a
ci(mypy.ini): ignore missing imports
2024-04-04 10:19:13 -07:00