4392 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Krish Dholakia	bbbc5db104	Merge pull request #1080 from nbaldwin98/fixing-replicate-sys-prompt ... fix replicate system prompt: forgot to add **optional_params to input data	2023-12-11 07:11:52 -08:00
chabala98	c5ce11541b	adfix: ded **optional_params in input data when system prompt is available (allows to papass other optional params apart from sys prompt)	2023-12-11 14:42:05 +01:00
Krrish Dholakia	80821f62d1	docs(logging.md): add sentry logging to proxy docs	2023-12-09 23:03:48 -08:00
ishaan-jaff	7977f92bd2	(test) langfuse	2023-12-09 22:58:23 -08:00
ishaan-jaff	f6a8ade91a	(test) langfuse	2023-12-09 22:52:02 -08:00
ishaan-jaff	ee53139ce2	(fix) langfuse test	2023-12-09 22:47:52 -08:00
Krrish Dholakia	1ef9bfa125	test(test_proxy_server.py): add testing for /model/new endpoint	2023-12-09 22:44:11 -08:00
Krrish Dholakia	22f04e3b33	fix(proxy_server.py): fix /model/new adding new model issue	2023-12-09 22:44:11 -08:00
ishaan-jaff	3c8603f148	(test) langfuse	2023-12-09 22:44:02 -08:00
ishaan-jaff	127f25703a	(fix) proxy /model/info	2023-12-09 22:35:09 -08:00
ishaan-jaff	d46a52b8f4	(test) langfuse	2023-12-09 22:33:41 -08:00
ishaan-jaff	9909e49171	(test) langfuse	2023-12-09 22:27:07 -08:00
ishaan-jaff	b4c5bacea9	(test) langfuse - read ddebug logs to find status 200	2023-12-09 22:27:07 -08:00
ishaan-jaff	3acd393c5e	(feat) langfuse - print traceback.exec()	2023-12-09 22:27:07 -08:00
Krrish Dholakia	45d59ba64f	bump: version 1.12.2 → 1.12.3	2023-12-09 22:05:20 -08:00
Krrish Dholakia	07b4c72a98	fix(proxy_server.py): fix key gen error	2023-12-09 22:04:59 -08:00
Krrish Dholakia	f10bb708c0	fix: fix run_ollama_serve to only run if api base is none	2023-12-09 21:31:46 -08:00
Krrish Dholakia	82484691cb	fix: minor bug fixes	2023-12-09 21:24:52 -08:00
ishaan-jaff	bf1044444c	(test) caching	2023-12-09 16:58:56 -08:00
ishaan-jaff	8a52e17300	(test) caching - get cache key	2023-12-09 16:42:59 -08:00
ishaan-jaff	2879b36636	(fix) setting cache keys	2023-12-09 16:42:59 -08:00
Krrish Dholakia	149c1b3557	docs(configs.md): added docs on how to configure routing strategy on proxy	2023-12-09 16:31:31 -08:00
Krrish Dholakia	6ef0e8485e	fix(proxy_server.py): support for streaming	2023-12-09 16:23:04 -08:00
ishaan-jaff	0c8b8200b8	(ci/cd) run tests again	2023-12-09 16:02:02 -08:00
ishaan-jaff	adbdb31b9d	(docs) proxy caching	2023-12-09 15:56:57 -08:00
ishaan-jaff	1f1f749ad9	(feat) proxy - cache allow bool	2023-12-09 15:55:38 -08:00
ishaan-jaff	da08be1f43	(test) router + caching	2023-12-09 15:41:36 -08:00
ishaan-jaff	60bf552fe8	(fix) caching + proxy - use model group	2023-12-09 15:40:22 -08:00
ishaan-jaff	994c204e45	(fix) proxy - show logging when Cache created	2023-12-09 15:21:04 -08:00
ishaan-jaff	0b7f8265d6	(fix) router - only init cache when its none	2023-12-09 15:20:08 -08:00
ishaan-jaff	a9f103995d	(test) async completion + caching on router	2023-12-09 14:25:38 -08:00
ishaan-jaff	d18d5a3133	(feat) async completion caching	2023-12-09 14:22:10 -08:00
ishaan-jaff	67c730e264	(feat) async + stream cache	2023-12-09 14:22:10 -08:00
ishaan-jaff	6f8a35d539	(test) cache async + stream test	2023-12-09 14:22:10 -08:00
Krish Dholakia	cc4a1d2603	Merge pull request #985 from estill01/patch-1 ... Enable setting default `model` value for `LiteLLM`, `Chat`, `Completions`	2023-12-09 13:59:00 -08:00
ishaan-jaff	5e5ffc3d8a	(fix) use cache + custom logger	2023-12-09 12:41:26 -08:00
ishaan-jaff	0dcdf5f6ea	(fix) use cache + custom callbacks	2023-12-09 12:41:26 -08:00
Krrish Dholakia	b4aa9f0ae4	test(test_router.py): fix init issue	2023-12-09 12:28:51 -08:00
Krrish Dholakia	a250489405	test(test_router.py): run as asyncio.run	2023-12-09 12:28:28 -08:00
Krrish Dholakia	dd6caa8b55	fix(proxy_server.py): fix linting errors	2023-12-09 12:17:33 -08:00
Krrish Dholakia	ed50522863	fix(proxy_server.py): fix pydantic version errors	2023-12-09 12:09:49 -08:00
ishaan-jaff	0294e1119e	(fix) success_handler / logging	2023-12-09 11:38:42 -08:00
ishaan-jaff	8cbd6010c8	(test) redis caching init calbacks to be empty	2023-12-09 11:32:35 -08:00
Krrish Dholakia	c1c81af9d4	fix(proxy_server.py): add custom json helper func to work across multiple pydantic versions	2023-12-09 11:13:03 -08:00
Krish Dholakia	7ed68da149	Updated config.yml	2023-12-09 11:09:18 -08:00
Krrish Dholakia	9433c3c11b	test: trigger ci/cd build	2023-12-09 11:03:19 -08:00
Krish Dholakia	4d0615391b	Updated config.yml	2023-12-09 11:00:40 -08:00
ishaan-jaff	875b7d1c7f	(test) custom logger	2023-12-09 10:42:50 -08:00
Krrish Dholakia	c482c399ff	fix(proxy_server.py): add logging around /key/generate	2023-12-09 10:26:12 -08:00
Krish Dholakia	c8eca35015	Updated config.yml	2023-12-09 10:23:36 -08:00