Commit graph

15420 commits

Author SHA1 Message Date
Krrish Dholakia
c583cbdbcd fix: fix linting errors 2024-07-31 07:19:45 -07:00
Ishaan Jaff
1b6bf48264 ci/cd run again 2024-07-30 22:55:46 -07:00
Ishaan Jaff
54e1f18832 use timeouts for predibase - never use them in prod ! 2024-07-30 22:54:01 -07:00
Ishaan Jaff
82e5ea059b fix predibase timeout exceptions 2024-07-30 22:52:08 -07:00
Ishaan Jaff
19ab0614c4 fix predibase tests 2024-07-30 22:49:33 -07:00
Ishaan Jaff
da494da12c support timeouts on http handler 2024-07-30 22:49:00 -07:00
Ishaan Jaff
62d4d5e746 fix timeouts for predibase - they are unstable af 2024-07-30 22:48:30 -07:00
Krrish Dholakia
24395492aa test: cleanup duplicate tests + add error handling for backend api errors 2024-07-30 21:47:52 -07:00
Krrish Dholakia
14d54f7af5 test(test_completion.py): handle gemini internal server error 2024-07-30 21:02:58 -07:00
Krrish Dholakia
eecd93c81d test(test_streaming.py): fix streaming test 2024-07-30 20:36:19 -07:00
Krish Dholakia
22ff4a1e95
Merge pull request #4979 from BerriAI/litellm_cost_calc_fix
fix(utils.py): fix model registeration to model cost map
2024-07-30 20:32:58 -07:00
Ishaan Jaff
4ed303f936 ci cd run again 2024-07-30 20:03:24 -07:00
Ishaan Jaff
a6122ac293 fix test proxy routes check 2024-07-30 19:56:46 -07:00
Ishaan Jaff
9d0e196687 fix test proxy routes 2024-07-30 19:53:36 -07:00
Krrish Dholakia
c65a438de2 fix(utils.py): fix linting errors 2024-07-30 18:38:10 -07:00
Krrish Dholakia
b77edc59ed fix(user_api_key_cache): fix check to not raise error if team object is missing 2024-07-30 18:25:04 -07:00
Krrish Dholakia
46634af06f fix(utils.py): fix model registeration to model cost map
Fixes https://github.com/BerriAI/litellm/issues/4972
2024-07-30 18:15:00 -07:00
Ishaan Jaff
6c0506a144 handle predibase failing streaming tests 2024-07-30 17:53:27 -07:00
Krrish Dholakia
142f4fefd0 fix(auth_checks.py): fix redis usage for team cached objects 2024-07-30 17:30:00 -07:00
Ishaan Jaff
c551e5b47a ci/cd run again 2024-07-30 17:21:47 -07:00
Ishaan Jaff
c5157120a2 fix create ft jobs api test 2024-07-30 17:13:27 -07:00
Ishaan Jaff
d611e5817c fix custom auth test 2024-07-30 16:50:55 -07:00
Krish Dholakia
bc8cc4f88e
Merge pull request #4977 from BerriAI/litellm_async_cohere_calls
fix(cohere.py): support async cohere embedding calls
2024-07-30 15:35:27 -07:00
Krish Dholakia
653aefde40
Merge branch 'main' into litellm_async_cohere_calls 2024-07-30 15:35:20 -07:00
Krish Dholakia
3a70849ce0
Merge pull request #4976 from BerriAI/litellm_huggingface_embedding_fixes
feat(huggingface_restapi.py): Support multiple hf embedding types + async hf embeddings
2024-07-30 15:34:44 -07:00
Krrish Dholakia
84513c0254 test(test_streaming.py): move to mock implementation for sagemaker streaming tests 2024-07-30 15:34:27 -07:00
Krrish Dholakia
e1cbb397fe test(test_streaming.py): handle predibase instability 2024-07-30 15:32:36 -07:00
Krrish Dholakia
ec6db03c41 fix(router.py): gracefully handle scenario where completion response doesn't have total tokens
Closes https://github.com/BerriAI/litellm/issues/4968
2024-07-30 15:14:03 -07:00
Krrish Dholakia
311521e56e fix(ollama.py): correctly raise ollama streaming error
Fixes https://github.com/BerriAI/litellm/issues/4974
2024-07-30 15:01:26 -07:00
Krrish Dholakia
9b2eb1702b fix(cohere.py): support async cohere embedding calls 2024-07-30 14:49:07 -07:00
Krrish Dholakia
43958907bf fix(huggingface_restapi.py): fix linting errors 2024-07-30 14:33:08 -07:00
Krrish Dholakia
185a6857f9 fix(utils.py): fix cost tracking for vertex ai partner models 2024-07-30 14:20:52 -07:00
Krrish Dholakia
99dc7d2e97 fix(main.py): fix linting error 2024-07-30 13:55:04 -07:00
Krrish Dholakia
250f28b3a2 style(cohere.py): point to cohere_chat docs for updated doc info 2024-07-30 13:47:15 -07:00
Krrish Dholakia
d0971dd50e docs(supported_embedding.md): add specifying input_type for huggingface embedding calls 2024-07-30 13:45:38 -07:00
Ishaan Jaff
6b17e84204
Merge pull request #4975 from BerriAI/ui_switch_off_console_logs_in_prod
Proxy Admin UI - switch off console logs in production mode
2024-07-30 13:34:59 -07:00
Ishaan Jaff
d5593a9106 ui new build 2024-07-30 13:33:34 -07:00
Krrish Dholakia
69afbc6091 feat(huggingface_restapi.py): Support multiple hf embedding types + async hf embeddings
Closes https://github.com/BerriAI/litellm/issues/3261
2024-07-30 13:32:03 -07:00
Ishaan Jaff
e0d0d45e87
Merge pull request #4973 from BerriAI/litellm_return_code_as_str
[Fix-Proxy] ProxyException code as str - Make OpenAI Compatible
2024-07-30 13:27:33 -07:00
Ishaan Jaff
afad69b147
Merge pull request #4969 from BerriAI/litellm_get_batches
[Feature]: GET /v1/batches to return list of batches
2024-07-30 13:27:22 -07:00
Ishaan Jaff
896026c468 switch off prod logs on ui 2024-07-30 13:23:45 -07:00
Ishaan Jaff
7f847f194d swithc off console log in prod 2024-07-30 13:02:55 -07:00
Ishaan Jaff
66211b42db fix linting errors 2024-07-30 12:51:39 -07:00
Ishaan Jaff
e7b78a3337 add docs on status code from exceptions 2024-07-30 12:38:33 -07:00
Ishaan Jaff
74c4e3def8 return ProxyException code as str 2024-07-30 12:35:46 -07:00
Krrish Dholakia
f1b7d2318c docs(input.md): update docs to show ollama tool calling 2024-07-30 09:56:24 -07:00
Ishaan Jaff
1e1bce4594 docs LIST batches 2024-07-30 09:49:11 -07:00
Ishaan Jaff
563d59a305 test batches endpoint on proxy 2024-07-30 09:46:30 -07:00
Ishaan Jaff
4206354ee7 test - list batches 2024-07-30 08:19:25 -07:00
Ishaan Jaff
43a06f408c feat add support for alist_batches 2024-07-30 08:18:52 -07:00