Commit graph

14961 commits

Author SHA1 Message Date
Krish Dholakia
156d445597
Merge pull request #4796 from BerriAI/litellm_refactor_requests_factory
fix(factory.py): refactor factory to use httpx client
2024-07-19 21:07:41 -07:00
Krish Dholakia
3053f52c43
Merge pull request #4801 from BerriAI/litellm_dynamic_params_oai_compatible_endpoints
fix(utils.py): support dynamic params for openai-compatible providers
2024-07-19 21:07:06 -07:00
Ishaan Jaff
3bb66ab939 ci/cd run again 2024-07-19 20:08:50 -07:00
Ishaan Jaff
d35aeb3f4f fix test_vertex_ai_medlm_completion_cost 2024-07-19 19:58:44 -07:00
Krrish Dholakia
95a0f6839f fix(utils.py): fix token_counter to handle empty tool calls in messages
Fixes https://github.com/BerriAI/litellm/pull/4749
2024-07-19 19:39:00 -07:00
Krrish Dholakia
e45956d77e fix(utils.py): fix get_llm_provider to support dynamic params for openai-compatible providers 2024-07-19 19:36:31 -07:00
Krrish Dholakia
e2d275f1b7 fix(utils.py): add exception mapping for bedrock image internal server error 2024-07-19 19:30:41 -07:00
Krrish Dholakia
4de19cb116 test(test_router_timeout.py): fix test 2024-07-19 19:00:55 -07:00
Krrish Dholakia
335cf65452 fix(anthropic.py): fix streaming client 2024-07-19 18:55:00 -07:00
Krrish Dholakia
9e098326d0 test: skip duplicate test 2024-07-19 18:51:50 -07:00
Krish Dholakia
614e292bed
Merge pull request #4788 from BerriAI/litellm_ai21_jamba
feat(bedrock_httpx.py): add ai21 jamba instruct as bedrock model
2024-07-19 17:11:36 -07:00
Ishaan Jaff
f7b1c33208 fix typing errors 2024-07-19 16:43:31 -07:00
Ishaan Jaff
3c779449aa
Merge pull request #4797 from BerriAI/litellm_rename_api_key_virtual_key
ui - rename api_key -> virtual key
2024-07-19 16:41:22 -07:00
Ishaan Jaff
d3e7910c4d
Merge pull request #4798 from BerriAI/litellm_fix_health_check
fix health check - make sure one failing deployment does not stop the health check
2024-07-19 16:41:12 -07:00
Ishaan Jaff
f3ac6493e8 fix typing errors 2024-07-19 16:18:53 -07:00
Ishaan Jaff
43e5890f77 fix health check 2024-07-19 15:56:35 -07:00
Krrish Dholakia
fa7037e48a fix(files/main.py): fix linting error 2024-07-19 15:50:25 -07:00
Ishaan Jaff
d40f24ecd5 ui - rename api_key -> virtual key 2024-07-19 15:49:12 -07:00
Krrish Dholakia
bd914c714c fix(files/main.py): fix linting error 2024-07-19 15:48:22 -07:00
Krrish Dholakia
757dedd4c8 fix(factory.py): refactor factory to use httpx client 2024-07-19 15:35:05 -07:00
Krrish Dholakia
4c4f032a75 fix(factory.py): refactor factory to use httpx client 2024-07-19 15:32:01 -07:00
Krish Dholakia
f973bd8109
Merge branch 'main' into litellm_ai21_jamba 2024-07-19 15:11:55 -07:00
Ishaan Jaff
1797021d53 ci/cd run again 2024-07-19 14:05:22 -07:00
Ishaan Jaff
af80e271c9 ui new build 2024-07-19 14:02:28 -07:00
Ishaan Jaff
395a3fde50 ui allow editing organization 2024-07-19 14:01:37 -07:00
Ishaan Jaff
86abd573e4 ci/cd fix linting errors 2024-07-19 12:58:24 -07:00
Ishaan Jaff
fa04595328
Merge pull request #4794 from BerriAI/litellm_apply_db_fixes_to_newer_version
fix - add fix to update spend logs discrepancy for team spend
2024-07-19 12:52:57 -07:00
Ishaan Jaff
df1ac92222 fix add fix to update spend logs 2024-07-19 12:49:23 -07:00
Ishaan Jaff
f7f4b9bee7
Merge pull request #4793 from BerriAI/docs_caching
docs fix control cache on / off per request
2024-07-19 12:30:14 -07:00
Ishaan Jaff
0f52870a82 docs- control cache on / off per request 2024-07-19 12:27:44 -07:00
Ishaan Jaff
8f7cb63b8a
Merge pull request #4792 from BerriAI/ui_redirect_logout_after_session
UI redirect logout after session, only show 1 error message
2024-07-19 12:07:36 -07:00
Ishaan Jaff
5d05a4d470
Merge pull request #4791 from BerriAI/litellm_default_session
fix ui - make default session 24 hours
2024-07-19 12:07:25 -07:00
Ishaan Jaff
90824e2d21 ui new build 2024-07-19 11:00:13 -07:00
Ishaan Jaff
210043ff9e ui - only show 1 message when session expires + redirect 2024-07-19 10:47:53 -07:00
Ishaan Jaff
ae316d2d9a fix ui - make default session 24 hours 2024-07-19 10:17:45 -07:00
Ishaan Jaff
9f6e280fe4
Merge pull request #4287 from BerriAI/litellm_docusaurus_fix_base_url
docs(docusaurus.config.js): fix docusaurus base url
2024-07-19 10:13:51 -07:00
Ishaan Jaff
defc341f39 docs fireworks ai 2024-07-19 10:08:48 -07:00
Ishaan Jaff
2e766a7b1f ci/cd run again 2024-07-19 08:25:56 -07:00
Ishaan Jaff
e66a735304 fix lakera ai tests 2024-07-19 07:49:57 -07:00
Krish Dholakia
2ad1c0455a
Merge pull request #4773 from titusz/patch-1
Add missing `num_gpu` ollama configuration parameter
2024-07-18 22:47:39 -07:00
Krish Dholakia
5e7172d0e7
Merge pull request #4783 from areibman/remove_bad_model
Removed weird replicate model from model prices list
2024-07-18 22:47:21 -07:00
Krrish Dholakia
c56456be64 fix(anthropic.py): revert client to requests library 2024-07-18 22:45:41 -07:00
Ishaan Jaff
086486c5c3 bump: version 1.41.24 → 1.41.25 2024-07-18 22:40:51 -07:00
Marc Abramowitz
780a6293dc Alias /health/liveliness as /health/liveness
The latter is the more common term in Kubernetes, so it's nice to support that.
2024-07-18 22:40:51 -07:00
Ishaan Jaff
6f393be66b docs - tag based routing 2024-07-18 22:40:51 -07:00
Ishaan Jaff
d9c051adff add tags to metadata 2024-07-18 22:40:51 -07:00
Ishaan Jaff
fa26d3f96f fix test 2024-07-18 22:40:51 -07:00
Ishaan Jaff
56489ad9cc rename doc 2024-07-18 22:40:51 -07:00
Ishaan Jaff
1ab5c1a227 check if using tag based routing 2024-07-18 22:40:51 -07:00
Ishaan Jaff
52d0f6a808 control using enable_tag_filtering 2024-07-18 22:40:51 -07:00