Commit graph

14948 commits

Author SHA1 Message Date
Krish Dholakia
614e292bed
Merge pull request #4788 from BerriAI/litellm_ai21_jamba
feat(bedrock_httpx.py): add ai21 jamba instruct as bedrock model
2024-07-19 17:11:36 -07:00
Ishaan Jaff
f7b1c33208 fix typing errors 2024-07-19 16:43:31 -07:00
Ishaan Jaff
3c779449aa
Merge pull request #4797 from BerriAI/litellm_rename_api_key_virtual_key
ui - rename api_key -> virtual key
2024-07-19 16:41:22 -07:00
Ishaan Jaff
d3e7910c4d
Merge pull request #4798 from BerriAI/litellm_fix_health_check
fix health check - make sure one failing deployment does not stop the health check
2024-07-19 16:41:12 -07:00
Ishaan Jaff
f3ac6493e8 fix typing errors 2024-07-19 16:18:53 -07:00
Ishaan Jaff
43e5890f77 fix health check 2024-07-19 15:56:35 -07:00
Krrish Dholakia
fa7037e48a fix(files/main.py): fix linting error 2024-07-19 15:50:25 -07:00
Ishaan Jaff
d40f24ecd5 ui - rename api_key -> virtual key 2024-07-19 15:49:12 -07:00
Krish Dholakia
f973bd8109
Merge branch 'main' into litellm_ai21_jamba 2024-07-19 15:11:55 -07:00
Ishaan Jaff
1797021d53 ci/cd run again 2024-07-19 14:05:22 -07:00
Ishaan Jaff
af80e271c9 ui new build 2024-07-19 14:02:28 -07:00
Ishaan Jaff
395a3fde50 ui allow editing organization 2024-07-19 14:01:37 -07:00
Ishaan Jaff
86abd573e4 ci/cd fix linting errors 2024-07-19 12:58:24 -07:00
Ishaan Jaff
fa04595328
Merge pull request #4794 from BerriAI/litellm_apply_db_fixes_to_newer_version
fix - add fix to update spend logs discrepancy for team spend
2024-07-19 12:52:57 -07:00
Ishaan Jaff
df1ac92222 fix add fix to update spend logs 2024-07-19 12:49:23 -07:00
Ishaan Jaff
f7f4b9bee7
Merge pull request #4793 from BerriAI/docs_caching
docs fix control cache on / off per request
2024-07-19 12:30:14 -07:00
Ishaan Jaff
0f52870a82 docs- control cache on / off per request 2024-07-19 12:27:44 -07:00
Ishaan Jaff
8f7cb63b8a
Merge pull request #4792 from BerriAI/ui_redirect_logout_after_session
UI redirect logout after session, only show 1 error message
2024-07-19 12:07:36 -07:00
Ishaan Jaff
5d05a4d470
Merge pull request #4791 from BerriAI/litellm_default_session
fix ui - make default session 24 hours
2024-07-19 12:07:25 -07:00
Ishaan Jaff
90824e2d21 ui new build 2024-07-19 11:00:13 -07:00
Ishaan Jaff
210043ff9e ui - only show 1 message when session expires + redirect 2024-07-19 10:47:53 -07:00
Ishaan Jaff
ae316d2d9a fix ui - make default session 24 hours 2024-07-19 10:17:45 -07:00
Ishaan Jaff
9f6e280fe4
Merge pull request #4287 from BerriAI/litellm_docusaurus_fix_base_url
docs(docusaurus.config.js): fix docusaurus base url
2024-07-19 10:13:51 -07:00
Ishaan Jaff
defc341f39 docs fireworks ai 2024-07-19 10:08:48 -07:00
Ishaan Jaff
2e766a7b1f ci/cd run again 2024-07-19 08:25:56 -07:00
Ishaan Jaff
e66a735304 fix lakera ai tests 2024-07-19 07:49:57 -07:00
Krish Dholakia
2ad1c0455a
Merge pull request #4773 from titusz/patch-1
Add missing `num_gpu` ollama configuration parameter
2024-07-18 22:47:39 -07:00
Krish Dholakia
5e7172d0e7
Merge pull request #4783 from areibman/remove_bad_model
Removed weird replicate model from model prices list
2024-07-18 22:47:21 -07:00
Krrish Dholakia
c56456be64 fix(anthropic.py): revert client to requests library 2024-07-18 22:45:41 -07:00
Ishaan Jaff
086486c5c3 bump: version 1.41.24 → 1.41.25 2024-07-18 22:40:51 -07:00
Marc Abramowitz
780a6293dc Alias /health/liveliness as /health/liveness
The latter is the more common term in Kubernetes, so it's nice to support that.
2024-07-18 22:40:51 -07:00
Ishaan Jaff
6f393be66b docs - tag based routing 2024-07-18 22:40:51 -07:00
Ishaan Jaff
d9c051adff add tags to metadata 2024-07-18 22:40:51 -07:00
Ishaan Jaff
fa26d3f96f fix test 2024-07-18 22:40:51 -07:00
Ishaan Jaff
56489ad9cc rename doc 2024-07-18 22:40:51 -07:00
Ishaan Jaff
1ab5c1a227 check if using tag based routing 2024-07-18 22:40:51 -07:00
Ishaan Jaff
52d0f6a808 control using enable_tag_filtering 2024-07-18 22:40:51 -07:00
Ishaan Jaff
e298515034 fix use tags as a litellm param 2024-07-18 22:40:51 -07:00
Ishaan Jaff
79c5788ad9 fix remove previous code on free/paid tier 2024-07-18 22:40:51 -07:00
Ishaan Jaff
ad46e6a61f router - refactor to tag based routing 2024-07-18 22:40:51 -07:00
Ishaan Jaff
38c50e674e fix ui make ui session last 24 hours 2024-07-18 22:40:51 -07:00
Krrish Dholakia
db3063d3d3 test: fix test 2024-07-18 22:40:51 -07:00
Ishaan Jaff
d42963a0ae router - use free paid tier routing 2024-07-18 22:40:51 -07:00
Ishaan Jaff
b0f0898f2f helper to get_deployments_for_tier 2024-07-18 22:40:51 -07:00
Krrish Dholakia
af0d30e41e docs(json_mode.md): add json mode to docs 2024-07-18 22:40:35 -07:00
Krrish Dholakia
f2401d6d5e feat(vertex_ai_anthropic.py): support response_schema for vertex ai anthropic calls
allows passing response_schema for anthropic calls. supports schema validation.
2024-07-18 22:40:35 -07:00
Ishaan Jaff
4bde501ee1 bump: version 1.41.24 → 1.41.25 2024-07-18 22:20:39 -07:00
Ishaan Jaff
154fa64d0a
Merge pull request #4781 from msabramo/liveness-alias-of-liveliness
Alias  `/health/liveliness` as `/health/liveness`
2024-07-18 22:20:09 -07:00
Ishaan Jaff
f04397e19a
Merge pull request #4789 from BerriAI/litellm_router_refactor
[Feat-Router] - Tag based routing
2024-07-18 22:19:18 -07:00
Ishaan Jaff
4dff995932
Merge pull request #4787 from BerriAI/litellm_increase_default_session_time_ui
[Fix] Admin UI - make ui session last 12 hours
2024-07-18 22:19:09 -07:00