46528 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
ishaan-jaff	886b52d448	(test) init router clients	2023-12-04 17:31:12 -08:00
ishaan-jaff	cba98cf530	(test) init router with 4 clients	2023-12-04 17:31:12 -08:00
Krrish Dholakia	7adb8f493d	docs(custom_callback.md): add async callbacks to docs	2023-12-04 17:01:46 -08:00
Krrish Dholakia	e0ccb281d8	feat(utils.py): add async success callbacks for custom functions	2023-12-04 16:42:40 -08:00
Krish Dholakia	b90fcbdac4	Merge pull request #970 from nbaldwin98/fixing-replicate-sys-prompt ... fix system prompts for replicate	2023-12-04 16:39:44 -08:00
ishaan-jaff	1247afb7a4	(feat) router: set max_retries + timeout	2023-12-04 16:09:31 -08:00
ishaan-jaff	a9905bcd0a	(test) fix config	2023-12-04 16:00:04 -08:00
ishaan-jaff	bbdfd143b8	(docs) input	2023-12-04 15:47:27 -08:00
ishaan-jaff	9b3a0c69f5	(fix) config testing	2023-12-04 15:24:46 -08:00
ishaan-jaff	b7281825d3	(test) add streaming sagemaker test	2023-12-04 15:20:06 -08:00
ishaan-jaff	bc691cbbcd	(fix) streaming init response_obj as {}	2023-12-04 15:19:47 -08:00
ishaan-jaff	74d520b1b5	(docs) sagemaker - clarify max tokens	2023-12-04 15:15:39 -08:00
ishaan-jaff	41365b6e47	(test) palm/stream	2023-12-04 15:07:07 -08:00
ishaan-jaff	3a4e512a75	(fix) palm: streaming	2023-12-04 15:06:52 -08:00
ishaan-jaff	533b93f714	(test) proxy: reading configs	2023-12-04 14:49:59 -08:00
ishaan-jaff	32ecc1a677	(feat) replicate/deployments: add POST Req view	2023-12-04 13:43:03 -08:00
ishaan-jaff	07a2035651	(chore) rm old config examples	2023-12-04 13:26:55 -08:00
ishaan-jaff	50284771b7	(test) test_reading proxy	2023-12-04 13:24:41 -08:00
Ishaan Jaff	a99f471d29	Update README.md	2023-12-04 13:20:23 -08:00
ishaan-jaff	de4a7b719d	(test) proxy: reading config.yaml	2023-12-04 13:16:19 -08:00
Krrish Dholakia	f20bdc9b79	test: fix linting errors	2023-12-04 12:45:15 -08:00
Krrish Dholakia	728b879c33	fix(utils.py): fix azure streaming bug	2023-12-04 12:38:22 -08:00
Krish Dholakia	90c13d39ac	Updated config.yml	2023-12-04 12:01:22 -08:00
ishaan-jaff	6f8765125b	(docs) embedding: add api_base for HF	2023-12-04 11:57:41 -08:00
ishaan-jaff	333e77d161	(docs) custom logger	2023-12-04 11:44:12 -08:00
ishaan-jaff	533b5bcc44	(docs) clean up proxy logging	2023-12-04 11:37:15 -08:00
Krrish Dholakia	d0d8ba46c5	test(test_proxy_server_keys.py): fix relative import	2023-12-04 11:35:43 -08:00
ishaan-jaff	15f54c3072	(docs) default config proxy	2023-12-04 11:30:53 -08:00
ishaan-jaff	85ac2b179a	(docs) custom logger: proxy	2023-12-04 11:30:09 -08:00
ishaan-jaff	4ef0378e6e	(fix) proxy: custom callbacks	2023-12-04 11:29:26 -08:00
ishaan-jaff	c5b92837c2	(docs) custom callbacks proxy	2023-12-04 11:20:27 -08:00
Krrish Dholakia	bfe0172108	bump: version 1.10.2 → 1.10.3	2023-12-04 10:51:32 -08:00
ishaan-jaff	e96a608938	(feat) proxy: set custom headers in metadata	2023-12-04 10:49:01 -08:00
ishaan-jaff	ec579d4821	(chore) rename proxy: custom_callbacks	2023-12-04 10:49:01 -08:00
ishaan-jaff	9b1e02cdf1	(chore) rename: proxy-custom logger	2023-12-04 10:49:01 -08:00
Krrish Dholakia	63e55f1865	fix(proxy_server.py): fix /key/generate post endpoint	2023-12-04 10:44:13 -08:00
ishaan-jaff	d7d8c5f6e6	(fix) proxy	2023-12-04 10:23:55 -08:00
ishaan-jaff	ebd9404cfd	(test) proxy: don't overwrite user	2023-12-04 10:19:35 -08:00
ishaan-jaff	88cec3b9ab	(fix) proxy: don't overwrite user	2023-12-04 10:17:56 -08:00
ishaan-jaff	f3b939e603	(fix) access user in custom logger	2023-12-04 09:50:36 -08:00
ishaan-jaff	93f5c266da	(test) test completion: if 'user' passed to API	2023-12-04 09:50:36 -08:00
Krrish Dholakia	31d9762b50	fix(model_management.md): add docs on model management on proxy	2023-12-04 09:36:45 -08:00
ishaan-jaff	0d44f5e441	(feat) proxy:custom_logger	2023-12-04 09:23:55 -08:00
ishaan-jaff	6599263a85	(feat) proxy: custom callbacks	2023-12-04 09:10:12 -08:00
ishaan-jaff	65e00b438e	(feat) proxy-read litellm custom callback class	2023-12-04 09:09:54 -08:00
ishaan-jaff	ed8c666922	(feat) proxy: custom_logger for I/O logging	2023-12-04 08:44:20 -08:00
ishaan-jaff	b1bd799be8	(feat) proxy: use custom_logger	2023-12-04 08:26:06 -08:00
ishaan-jaff	f2625bca24	(docs) quick start proxy	2023-12-04 08:07:05 -08:00
Cameron	15057d717a	multistage docker build	2023-12-03 18:38:44 +10:00
Ayush Somani	fe075a1a7f	Merge branch 'BerriAI:main' into main	2023-12-03 12:29:51 +05:30