Commit graph

8498 commits

Author SHA1 Message Date
Krrish Dholakia
82c53d7e2f test(anthropic.py): more logging for test 2024-03-12 19:07:52 -07:00
Krrish Dholakia
e342ecd873 test: set verbose for test 2024-03-12 12:56:38 -07:00
Krrish Dholakia
d07c813ef9 test: add more logging for failing test 2024-03-12 11:15:14 -07:00
Krrish Dholakia
84c7a5b693 fix(anthropic.py): fix linting errors 2024-03-12 10:23:56 -07:00
Krrish Dholakia
f00c489c1b fix(anthropic.py): fix streaming 2024-03-12 09:56:26 -07:00
Krrish Dholakia
86ed0aaba8 fix(anthropic.py): support streaming with function calling 2024-03-12 09:52:11 -07:00
Krrish Dholakia
10f5f342bd docs(virtual_keys.md): cleanup doc 2024-03-12 07:05:55 -07:00
Krrish Dholakia
47424b8c90 docs(routing.md): fix routing example on docs 2024-03-11 22:17:04 -07:00
Ishaan Jaff
477056339b
Merge pull request #2465 from BerriAI/litellm_router_docs
(docs) using litellm router
2024-03-11 21:18:38 -07:00
ishaan-jaff
e46980c56c (docs) using litellm router 2024-03-11 21:18:10 -07:00
ishaan-jaff
824b8b1b62 bump: version 1.31.2 → 1.31.3 2024-03-11 21:02:56 -07:00
Ishaan Jaff
1c28b8ee2d
Merge pull request #2462 from BerriAI/litellm_imp_mem_use
[Litellm-Proxy, Router] improve memory usage - don't store messages in memory, previous models in memory
2024-03-11 19:04:25 -07:00
Ishaan Jaff
cd8f25f6f8
Merge branch 'main' into litellm_imp_mem_use 2024-03-11 19:00:56 -07:00
Ishaan Jaff
881063c424
Merge pull request #2461 from BerriAI/litellm_improve_mem_use
LiteLLM -  improve memory utilization - don't use inMemCache on Router
2024-03-11 18:59:57 -07:00
ishaan-jaff
b6e7882fdb (fix) test mem usage 2024-03-11 16:53:03 -07:00
ishaan-jaff
eae1710c4b (fix) mem usage router.py 2024-03-11 16:52:06 -07:00
ishaan-jaff
3dda6f0cf3 (fix) test_mem_usage 2024-03-11 16:38:31 -07:00
ishaan-jaff
1bd3bb1128 (fix) improve mem util 2024-03-11 16:22:04 -07:00
Krish Dholakia
5647d945ff
Merge pull request #2448 from BerriAI/litellm_delete_key_security_fix
fix(proxy_server.py): prevent user from deleting non-user owned keys
2024-03-11 15:47:34 -07:00
Krish Dholakia
b4b3a3ae20
Merge pull request #2458 from eladsegal/eladsegal-patch-1
Make `argon2-cffi` optional
2024-03-11 15:43:48 -07:00
Krish Dholakia
291deeb691
Merge pull request #2459 from BerriAI/litellm_embedding_router_fix
fix(router.py): support fallbacks / retries with sync embedding calls
2024-03-11 15:32:13 -07:00
Krrish Dholakia
917f92800d test(test_key_generate_prisma.py): fix tests 2024-03-11 15:24:42 -07:00
Krrish Dholakia
64aeb088d9 test(test_key_generate_prisma.py): fix test 2024-03-11 14:59:11 -07:00
Krrish Dholakia
9735250db7 fix(router.py): support fallbacks / retries with sync embedding calls 2024-03-11 14:51:22 -07:00
Elad Segal
c4db5d4c33
Make argon2-cffi optional, used only for proxy 2024-03-11 23:35:03 +02:00
Krrish Dholakia
d1644db8ce test(test_key_generate_prisma.py): fix test to only let admin delete a key 2024-03-11 14:18:01 -07:00
Krrish Dholakia
e07174736f refactor(main.py): trigger new build 2024-03-11 13:57:40 -07:00
Krrish Dholakia
f683acda61 build: fix default config 2024-03-11 13:56:10 -07:00
Krrish Dholakia
2addd66393 fix(proxy_server.py): bug fix 2024-03-11 13:54:58 -07:00
Krrish Dholakia
1369e18e85 build: fix default config.yaml 2024-03-11 13:43:50 -07:00
Krrish Dholakia
2f1899284c fix(router.py): add more debug logs 2024-03-11 12:34:35 -07:00
ishaan-jaff
e23c68b15a (fix) failing usage based routing test 2024-03-11 12:14:13 -07:00
Krrish Dholakia
4eb244c3ca fix(proxy_server.py): prevent user from deleting non-user owned keys when they use ui 2024-03-11 12:13:30 -07:00
Ishaan Jaff
ff4f05a3f8
Merge pull request #2446 from BerriAI/litellm_fix_default_config_docker
(fix) fix default dockerfile startup
2024-03-11 11:39:49 -07:00
ishaan-jaff
ab48edca78 (fix) default config users use on startup 2024-03-11 11:39:06 -07:00
Krrish Dholakia
40c9682de7 bump: version 1.31.1 → 1.31.2 2024-03-11 11:38:35 -07:00
Krrish Dholakia
4b64e506f4 fix(proxy_server.py): fix argon import 2024-03-11 11:33:34 -07:00
ishaan-jaff
53c67d302a (fix) fix default dockerfile startup 2024-03-11 11:26:21 -07:00
Krrish Dholakia
eca2889c96 bump: version 1.31.0 → 1.31.1 2024-03-11 10:24:01 -07:00
Krrish Dholakia
312a9d8c26 fix(utils.py): support response_format for mistral ai api 2024-03-11 10:23:41 -07:00
Ishaan Jaff
1f211b10e1
Merge pull request #2443 from eladsegal/patch-1
Add missing `argon2-cffi` poetry dependency
2024-03-11 06:44:27 -07:00
Elad Segal
f14465f13a
Add missing argon2-cffi dependency 2024-03-11 12:16:57 +02:00
Krrish Dholakia
942b5e4145 fix(main.py): trigger new build 2024-03-10 09:48:06 -07:00
Krrish Dholakia
4ea24ac718 fix(pyproject.toml): fix merge conflict 2024-03-10 09:39:52 -07:00
ishaan-jaff
f6ba18cb52 bump: version 1.30.7 → 1.30.8 2024-03-09 19:40:48 -08:00
ishaan-jaff
b01f428f9e (fix) add comments on req.txt 2024-03-09 19:36:02 -08:00
Krrish Dholakia
24d51e49ae bump: version 1.30.7 → 1.31.0 2024-03-09 19:13:25 -08:00
Krish Dholakia
c7d0af0a2e
Merge pull request #2426 from BerriAI/litellm_whisper_cost_tracking
feat: add cost tracking + caching for `/audio/transcription` calls
2024-03-09 19:12:06 -08:00
Krrish Dholakia
1d15dde6de fix(utils.py): fix model setting in completion cost 2024-03-09 19:11:37 -08:00
Ishaan Jaff
34ad95818e
Merge pull request #2427 from BerriAI/litellm_address_memory_usage
tests - monitor memory usage with litellm
2024-03-09 19:10:15 -08:00