Commit graph

6883 commits

Author SHA1 Message Date
Krish Dholakia
4fe4d0c1f3
Merge branch 'main' into litellm_fix_proxy_health_readiness 2024-02-06 14:31:57 -08:00
Krrish Dholakia
191eef06de build(requirements.txt): fix dependency 2024-02-06 14:10:56 -08:00
ishaan-jaff
223cc88f0c (ci/cd) run again 2024-02-06 14:00:27 -08:00
ishaan-jaff
7f870ebced (feat) redis-semantic cache on proxy 2024-02-06 13:58:20 -08:00
ishaan-jaff
3fa5bba4ea (fix) add redisvl==0.0.7 2024-02-06 13:58:20 -08:00
Krrish Dholakia
c46aca7951 refactor(main.py): trigger deploy
n
2024-02-06 13:58:20 -08:00
ishaan-jaff
2b9a48eb6c (fix) redisvl requirements.txt issue 2024-02-06 13:58:20 -08:00
ishaan-jaff
3a5923cffa (fix) langfuse show semantic-similarity in tags 2024-02-06 13:58:20 -08:00
ishaan-jaff
8bce6d4fb2 (fix) dockerfile requirements.txt 2024-02-06 13:58:20 -08:00
ishaan-jaff
d9f407b4c2 (feat) show semantic-cache on health/readiness 2024-02-06 13:58:20 -08:00
ishaan-jaff
3d1d447db9 (feat) redis-semantic cache on proxy 2024-02-06 13:58:20 -08:00
ishaan-jaff
ff7d05aaef (fix) add redisvl==0.0.7 2024-02-06 13:58:20 -08:00
ishaan-jaff
d05984ef13 (feat) working semantic cache on proxy 2024-02-06 13:58:13 -08:00
Krrish Dholakia
d1549cb2f3 refactor(main.py): trigger deploy
n
2024-02-06 13:55:51 -08:00
ishaan-jaff
4233e2b850 (fix) redisvl requirements.txt issue 2024-02-06 13:52:32 -08:00
ishaan-jaff
a6afba8cf2 (fix) langfuse show semantic-similarity in tags 2024-02-06 13:41:22 -08:00
ishaan-jaff
f19b2becac (fix) dockerfile requirements.txt 2024-02-06 13:36:35 -08:00
ishaan-jaff
3d0ece828a (feat) show semantic-cache on health/readiness 2024-02-06 13:35:34 -08:00
Krrish Dholakia
cde96b8ba0 test(test_completion.py): fix test 2024-02-06 13:30:31 -08:00
ishaan-jaff
667e006dbf (ci/cd) run again 2024-02-06 13:30:31 -08:00
ishaan-jaff
548d56ac42 (fix) mark semantic caching as beta test 2024-02-06 13:30:31 -08:00
ishaan-jaff
ca26ecc4dc (fix) semantic caching 2024-02-06 13:30:31 -08:00
ishaan-jaff
4d1b437d0a (docs) litellm semantic caching 2024-02-06 13:30:31 -08:00
ishaan-jaff
06ac218d9f (docs) redis cache 2024-02-06 13:30:31 -08:00
ishaan-jaff
b2c78108c8 (fix) test-semantic caching 2024-02-06 13:30:31 -08:00
ishaan-jaff
a8d190f507 (feat) redis-semantic cache on proxy 2024-02-06 13:30:31 -08:00
ishaan-jaff
ee80987c8f (docs) using semantic caching on proxy 2024-02-06 13:30:31 -08:00
ishaan-jaff
63e91eb2c4 (fix) use semantic cache on proxy 2024-02-06 13:30:31 -08:00
ishaan-jaff
000afc1391 allow setting redis_semantic cache_embedding model 2024-02-06 13:30:31 -08:00
ishaan-jaff
74fb4e4cba (feat) log semantic_sim to langfuse 2024-02-06 13:30:31 -08:00
ishaan-jaff
e0c464cc71 (fix) add redisvl==0.0.7 2024-02-06 13:30:31 -08:00
ishaan-jaff
a7b3148c99 (feat) working semantic cache on proxy 2024-02-06 13:30:30 -08:00
ishaan-jaff
2b86c3a9b4 (feat) redis-semantic cache 2024-02-06 13:30:17 -08:00
ishaan-jaff
ba0d92c712 (feat) working semantic-cache on litellm proxy 2024-02-06 13:30:17 -08:00
ishaan-jaff
87b5b418d8 (test) async semantic cache 2024-02-06 13:30:17 -08:00
ishaan-jaff
b2f9dde360 (feat) RedisSemanticCache - async 2024-02-06 13:30:17 -08:00
ishaan-jaff
b63fe39ed2 (fix) semantic cache 2024-02-06 13:30:17 -08:00
ishaan-jaff
4450be0a64 (test) semantic caching 2024-02-06 13:30:17 -08:00
ishaan-jaff
80e1d901d8 (test) semantic cache 2024-02-06 13:30:17 -08:00
ishaan-jaff
80865f93b8 (feat) working - sync semantic caching 2024-02-06 13:30:17 -08:00
ishaan-jaff
168a2f7806 (feat )add semantic cache 2024-02-06 13:30:17 -08:00
ishaan-jaff
a73d57b32b (feat) show langfuse logging tags better through proxy 2024-02-06 13:30:17 -08:00
Krrish Dholakia
fa5f4b9774 test(test_completion.py): fix test 2024-02-06 13:29:47 -08:00
ishaan-jaff
79c225a60f (ci/cd) run again 2024-02-06 13:26:48 -08:00
Ishaan Jaff
8a8f538329
Merge pull request #1829 from BerriAI/litellm_add_semantic_cache
[Feat] Add Semantic Caching to litellm💰
2024-02-06 13:18:59 -08:00
Krrish Dholakia
31f85d65ae bump: version 1.22.8 → 1.22.9 2024-02-06 13:15:51 -08:00
Krrish Dholakia
b7f1bd696e fix(utils.py): round max tokens to be int always 2024-02-06 13:15:51 -08:00
ishaan-jaff
eb779c61c6 (ci/cd) run again 2024-02-06 13:15:51 -08:00
ishaan-jaff
2a7b07ffca (ci/cd) run again 2024-02-06 13:15:51 -08:00
ishaan-jaff
79f444edda (ci/cd) fix test_config_no_auth 2024-02-06 13:15:51 -08:00