Commit graph

8503 commits

Author SHA1 Message Date
Ishaan Jaff
5665234b86 (fix) rename chart 2024-03-16 10:40:49 -07:00
Shaun Maher
97deeedaf0
Merge branch 'BerriAI:main' into update_helm_chart_deployment_2024-02-22 2024-03-12 16:58:21 +11:00
Krrish Dholakia
47424b8c90 docs(routing.md): fix routing example on docs 2024-03-11 22:17:04 -07:00
Ishaan Jaff
477056339b
Merge pull request #2465 from BerriAI/litellm_router_docs
(docs) using litellm router
2024-03-11 21:18:38 -07:00
ishaan-jaff
e46980c56c (docs) using litellm router 2024-03-11 21:18:10 -07:00
ishaan-jaff
824b8b1b62 bump: version 1.31.2 → 1.31.3 2024-03-11 21:02:56 -07:00
Ishaan Jaff
1c28b8ee2d
Merge pull request #2462 from BerriAI/litellm_imp_mem_use
[Litellm-Proxy, Router] improve memory usage - don't store messages in memory, previous models in memory
2024-03-11 19:04:25 -07:00
Ishaan Jaff
cd8f25f6f8
Merge branch 'main' into litellm_imp_mem_use 2024-03-11 19:00:56 -07:00
Ishaan Jaff
881063c424
Merge pull request #2461 from BerriAI/litellm_improve_mem_use
LiteLLM -  improve memory utilization - don't use inMemCache on Router
2024-03-11 18:59:57 -07:00
ishaan-jaff
b6e7882fdb (fix) test mem usage 2024-03-11 16:53:03 -07:00
ishaan-jaff
eae1710c4b (fix) mem usage router.py 2024-03-11 16:52:06 -07:00
ishaan-jaff
3dda6f0cf3 (fix) test_mem_usage 2024-03-11 16:38:31 -07:00
ishaan-jaff
1bd3bb1128 (fix) improve mem util 2024-03-11 16:22:04 -07:00
Krish Dholakia
5647d945ff
Merge pull request #2448 from BerriAI/litellm_delete_key_security_fix
fix(proxy_server.py): prevent user from deleting non-user owned keys
2024-03-11 15:47:34 -07:00
Krish Dholakia
b4b3a3ae20
Merge pull request #2458 from eladsegal/eladsegal-patch-1
Make `argon2-cffi` optional
2024-03-11 15:43:48 -07:00
Krish Dholakia
291deeb691
Merge pull request #2459 from BerriAI/litellm_embedding_router_fix
fix(router.py): support fallbacks / retries with sync embedding calls
2024-03-11 15:32:13 -07:00
Krrish Dholakia
917f92800d test(test_key_generate_prisma.py): fix tests 2024-03-11 15:24:42 -07:00
Krrish Dholakia
64aeb088d9 test(test_key_generate_prisma.py): fix test 2024-03-11 14:59:11 -07:00
Krrish Dholakia
9735250db7 fix(router.py): support fallbacks / retries with sync embedding calls 2024-03-11 14:51:22 -07:00
Elad Segal
c4db5d4c33
Make argon2-cffi optional, used only for proxy 2024-03-11 23:35:03 +02:00
Krrish Dholakia
d1644db8ce test(test_key_generate_prisma.py): fix test to only let admin delete a key 2024-03-11 14:18:01 -07:00
Krrish Dholakia
e07174736f refactor(main.py): trigger new build 2024-03-11 13:57:40 -07:00
Krrish Dholakia
f683acda61 build: fix default config 2024-03-11 13:56:10 -07:00
Krrish Dholakia
2addd66393 fix(proxy_server.py): bug fix 2024-03-11 13:54:58 -07:00
Krrish Dholakia
1369e18e85 build: fix default config.yaml 2024-03-11 13:43:50 -07:00
Krrish Dholakia
2f1899284c fix(router.py): add more debug logs 2024-03-11 12:34:35 -07:00
ishaan-jaff
e23c68b15a (fix) failing usage based routing test 2024-03-11 12:14:13 -07:00
Krrish Dholakia
4eb244c3ca fix(proxy_server.py): prevent user from deleting non-user owned keys when they use ui 2024-03-11 12:13:30 -07:00
Ishaan Jaff
ff4f05a3f8
Merge pull request #2446 from BerriAI/litellm_fix_default_config_docker
(fix) fix default dockerfile startup
2024-03-11 11:39:49 -07:00
ishaan-jaff
ab48edca78 (fix) default config users use on startup 2024-03-11 11:39:06 -07:00
Krrish Dholakia
40c9682de7 bump: version 1.31.1 → 1.31.2 2024-03-11 11:38:35 -07:00
Krrish Dholakia
4b64e506f4 fix(proxy_server.py): fix argon import 2024-03-11 11:33:34 -07:00
ishaan-jaff
53c67d302a (fix) fix default dockerfile startup 2024-03-11 11:26:21 -07:00
Krrish Dholakia
eca2889c96 bump: version 1.31.0 → 1.31.1 2024-03-11 10:24:01 -07:00
Krrish Dholakia
312a9d8c26 fix(utils.py): support response_format for mistral ai api 2024-03-11 10:23:41 -07:00
Ishaan Jaff
1f211b10e1
Merge pull request #2443 from eladsegal/patch-1
Add missing `argon2-cffi` poetry dependency
2024-03-11 06:44:27 -07:00
Elad Segal
f14465f13a
Add missing argon2-cffi dependency 2024-03-11 12:16:57 +02:00
Krrish Dholakia
942b5e4145 fix(main.py): trigger new build 2024-03-10 09:48:06 -07:00
Krrish Dholakia
4ea24ac718 fix(pyproject.toml): fix merge conflict 2024-03-10 09:39:52 -07:00
ishaan-jaff
f6ba18cb52 bump: version 1.30.7 → 1.30.8 2024-03-09 19:40:48 -08:00
ishaan-jaff
b01f428f9e (fix) add comments on req.txt 2024-03-09 19:36:02 -08:00
Krrish Dholakia
24d51e49ae bump: version 1.30.7 → 1.31.0 2024-03-09 19:13:25 -08:00
Krish Dholakia
c7d0af0a2e
Merge pull request #2426 from BerriAI/litellm_whisper_cost_tracking
feat: add cost tracking + caching for `/audio/transcription` calls
2024-03-09 19:12:06 -08:00
Krrish Dholakia
1d15dde6de fix(utils.py): fix model setting in completion cost 2024-03-09 19:11:37 -08:00
Ishaan Jaff
34ad95818e
Merge pull request #2427 from BerriAI/litellm_address_memory_usage
tests - monitor memory usage with litellm
2024-03-09 19:10:15 -08:00
Ishaan Jaff
4c2dbf7aff
Merge pull request #2428 from BerriAI/litellm_fix_python3-8
(fix) use python 3.8 on ci/cd
2024-03-09 19:09:45 -08:00
Krrish Dholakia
faad44fc67 bump: version 1.30.6 → 1.30.7 2024-03-09 18:50:58 -08:00
Krrish Dholakia
61d16cb672 fix(test_proxy_server.py): fix test 2024-03-09 18:47:20 -08:00
ishaan-jaff
c51d25b063 (ci/cd) test 2024-03-09 18:45:27 -08:00
Krish Dholakia
8032159b6e
Merge pull request #2394 from BerriAI/litellm_faster_api_key_checking
fix(proxy_server.py): use argon2 for faster api key checking
2024-03-09 18:45:12 -08:00