6826 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Krrish Dholakia	cde96b8ba0	test(test_completion.py): fix test	2024-02-06 13:30:31 -08:00
ishaan-jaff	667e006dbf	(ci/cd) run again	2024-02-06 13:30:31 -08:00
ishaan-jaff	548d56ac42	(fix) mark semantic caching as beta test	2024-02-06 13:30:31 -08:00
ishaan-jaff	ca26ecc4dc	(fix) semantic caching	2024-02-06 13:30:31 -08:00
ishaan-jaff	4d1b437d0a	(docs) litellm semantic caching	2024-02-06 13:30:31 -08:00
ishaan-jaff	06ac218d9f	(docs) redis cache	2024-02-06 13:30:31 -08:00
ishaan-jaff	b2c78108c8	(fix) test-semantic caching	2024-02-06 13:30:31 -08:00
ishaan-jaff	a8d190f507	(feat) redis-semantic cache on proxy	2024-02-06 13:30:31 -08:00
ishaan-jaff	ee80987c8f	(docs) using semantic caching on proxy	2024-02-06 13:30:31 -08:00
ishaan-jaff	63e91eb2c4	(fix) use semantic cache on proxy	2024-02-06 13:30:31 -08:00
ishaan-jaff	000afc1391	allow setting redis_semantic cache_embedding model	2024-02-06 13:30:31 -08:00
ishaan-jaff	74fb4e4cba	(feat) log semantic_sim to langfuse	2024-02-06 13:30:31 -08:00
ishaan-jaff	e0c464cc71	(fix) add redisvl==0.0.7	2024-02-06 13:30:31 -08:00
ishaan-jaff	a7b3148c99	(feat) working semantic cache on proxy	2024-02-06 13:30:30 -08:00
ishaan-jaff	2b86c3a9b4	(feat) redis-semantic cache	2024-02-06 13:30:17 -08:00
ishaan-jaff	ba0d92c712	(feat) working semantic-cache on litellm proxy	2024-02-06 13:30:17 -08:00
ishaan-jaff	87b5b418d8	(test) async semantic cache	2024-02-06 13:30:17 -08:00
ishaan-jaff	b2f9dde360	(feat) RedisSemanticCache - async	2024-02-06 13:30:17 -08:00
ishaan-jaff	b63fe39ed2	(fix) semantic cache	2024-02-06 13:30:17 -08:00
ishaan-jaff	4450be0a64	(test) semantic caching	2024-02-06 13:30:17 -08:00
ishaan-jaff	80e1d901d8	(test) semantic cache	2024-02-06 13:30:17 -08:00
ishaan-jaff	80865f93b8	(feat) working - sync semantic caching	2024-02-06 13:30:17 -08:00
ishaan-jaff	168a2f7806	(feat )add semantic cache	2024-02-06 13:30:17 -08:00
ishaan-jaff	a73d57b32b	(feat) show langfuse logging tags better through proxy	2024-02-06 13:30:17 -08:00
Krrish Dholakia	31f85d65ae	bump: version 1.22.8 → 1.22.9	2024-02-06 13:15:51 -08:00
Krrish Dholakia	b7f1bd696e	fix(utils.py): round max tokens to be int always	2024-02-06 13:15:51 -08:00
ishaan-jaff	eb779c61c6	(ci/cd) run again	2024-02-06 13:15:51 -08:00
ishaan-jaff	2a7b07ffca	(ci/cd) run again	2024-02-06 13:15:51 -08:00
ishaan-jaff	79f444edda	(ci/cd) fix test_config_no_auth	2024-02-06 13:15:51 -08:00
ishaan-jaff	9355fc62a7	(fix) test_normal_router_tpm_limit	2024-02-06 13:15:51 -08:00
ishaan-jaff	b4372457c4	(fix) parallel_request_limiter debug	2024-02-06 13:15:51 -08:00
ishaan-jaff	84942bb694	(ci/cd) run again	2024-02-06 13:15:51 -08:00
ishaan-jaff	0fc721eb31	(ci/cd) run pytest without -s	2024-02-06 13:15:51 -08:00
ishaan-jaff	0719c32f9e	(fix) proxy_startup test	2024-02-06 13:15:51 -08:00
ishaan-jaff	acf2474d68	(fix) rename proxy startup test	2024-02-06 13:15:51 -08:00
ishaan-jaff	9ed1d033fe	(ci/cd) run in verbose mode	2024-02-06 13:15:51 -08:00
Krrish Dholakia	e5fec98e1f	fix(proxy_server.py): do a health check on db before returning if proxy ready (if db connected)	2024-02-06 12:57:05 -08:00
Krrish Dholakia	e542aa10cc	bump: version 1.22.7 → 1.22.8	2024-02-06 10:12:13 -08:00
Krrish Dholakia	d1db67890c	fix(ollama.py): support format for ollama	2024-02-06 10:11:52 -08:00
Krish Dholakia	dd87386cad	Merge pull request #1846 from BerriAI/litellm_proxy_update_requirements_txt ... build(requirements.txt): update the proxy requirements.txt	2024-02-06 07:51:48 -08:00
Krrish Dholakia	f2ef32bcee	bump: version 1.22.6 → 1.22.7	2024-02-06 07:44:04 -08:00
Krrish Dholakia	9e091a0624	fix(ollama_chat.py): explicitly state if ollama call is streaming or not	2024-02-06 07:43:47 -08:00
Krrish Dholakia	4a5b635e35	build(requirements.txt): update the proxy requirements.txt	2024-02-06 07:35:46 -08:00
Krrish Dholakia	c2a523b954	fix(utils.py): use print_verbose for statements, so debug can be seen when running sdk	2024-02-06 07:30:26 -08:00
Krrish Dholakia	2e3748e6eb	fix(ollama_chat.py): fix ollama chat completion token counting	2024-02-06 07:30:26 -08:00
ishaan-jaff	47bed68c7f	(fix) test_normal_router_tpm_limit	2024-02-06 06:46:49 -08:00
ishaan-jaff	9a8abdb1ae	(ci/cd) print debug info for test_proxy_gunicorn_startup_config_dict	2024-02-05 22:53:31 -08:00
ishaan-jaff	4d625818d6	(fix) proxy startup test	2024-02-05 22:51:11 -08:00
Ishaan Jaff	ed53f34537	Merge pull request #1844 from BerriAI/litellm_set_upperbound_budgets ... [Feat] Proxy set upperbound params for key/generate	2024-02-05 22:42:01 -08:00
ishaan-jaff	71814d8149	(feat) proxy - upperbound params /key/generate	2024-02-05 22:40:52 -08:00