45043 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Krrish Dholakia	763ecf681a	test(test_text_completion.py): fixing print verbose	2023-11-04 14:03:09 -07:00
Krrish Dholakia	49bca64098	test(test_batch_completions.py): handle timeouts	2023-11-04 13:35:04 -07:00
ishaan-jaff	cef7ae7896	(fix) linting	2023-11-04 13:28:09 -07:00
ishaan-jaff	9132efe7c4	(test) anyscale stream	2023-11-04 13:23:19 -07:00
ishaan-jaff	ae3071e8f8	(test) anyscale streaming	2023-11-04 13:23:02 -07:00
ishaan-jaff	56ba58b35b	(fix) anyscale streaming detect [DONE] special char	2023-11-04 13:23:02 -07:00
Krrish Dholakia	6b40546e59	refactor(all-files): removing all print statements; adding pre-commit + flake8 to prevent future regressions	2023-11-04 12:50:15 -07:00
ishaan-jaff	38ff9f2b6f	(fix) test get_model_cost_map	2023-11-04 09:12:22 -07:00
ishaan-jaff	5f26da58a1	(test) model prices json	2023-11-04 09:01:26 -07:00
ishaan-jaff	3976cd27d7	(feat) add palm llms for model_prices json	2023-11-04 09:01:08 -07:00
ishaan-jaff	3e508ea257	(test) text_completion responses	2023-11-03 22:14:36 -07:00
ishaan-jaff	cc9f17a1a8	(feat) add TextCompletionResponse	2023-11-03 22:14:07 -07:00
ishaan-jaff	d4430fc51e	(feat) text completion response now OpenAI Object	2023-11-03 22:13:52 -07:00
Krrish Dholakia	4c895d2e91	test(test_completion.py): cleanup	2023-11-03 18:31:41 -07:00
Krrish Dholakia	1c4dd0671b	fix(bedrock.py): add exception mapping coverage for authentication scenarios	2023-11-03 18:25:34 -07:00
Krrish Dholakia	142750adff	fix(bedrock.py): fix bedrock exception mapping	2023-11-03 18:14:12 -07:00
ishaan-jaff	53371d37b7	(docs) lm eval harness	2023-11-03 18:11:07 -07:00
ishaan-jaff	49650af444	(fix) bedrock: remove check for - if "error" in outputText	2023-11-03 18:06:23 -07:00
ishaan-jaff	34751d8562	(test) add text_completion with prompt list	2023-11-03 18:03:19 -07:00
ishaan-jaff	df57e9247a	(fix) hf calculating usage non blocking	2023-11-03 18:03:19 -07:00
Krrish Dholakia	4e1885734a	refactor(proxy_server.py): print statement showing how to add debug for logs	2023-11-03 17:41:14 -07:00
ishaan-jaff	6c4816e214	(fix) remove print statements	2023-11-03 16:45:28 -07:00
ishaan-jaff	f3dc06da04	(fix) temp_top_logprobs	2023-11-03 16:45:10 -07:00
ishaan-jaff	e29b2e8ce4	(fix) testing text_completion	2023-11-03 16:39:06 -07:00
ishaan-jaff	382e31d7b7	(test) text_completion requests	2023-11-03 16:36:38 -07:00
ishaan-jaff	b8d0a0fbd1	(test) cleanup remove text_completion testing from completion()	2023-11-03 16:36:38 -07:00
ishaan-jaff	0fa7c1ec3a	(feat) text_com support batches for non openai llms	2023-11-03 16:36:38 -07:00
ishaan-jaff	b45d438e63	(fix) proxy server remove errant print	2023-11-03 16:36:38 -07:00
Krrish Dholakia	432520ffcf	docs(simple_proxy.md): improving tutorial	2023-11-03 14:06:08 -07:00
Krrish Dholakia	22fd8953c1	docs(simple_proxy.md): adding docs	2023-11-03 14:03:48 -07:00
Krrish Dholakia	7ed8f8dac8	fix(proxy_server.py): fix linting issues	2023-11-03 13:44:35 -07:00
ishaan-jaff	b5751bd040	(cleanup) cookbook notebooks	2023-11-03 13:29:28 -07:00
ishaan-jaff	a8d65741f5	(cleanup) cookbooks	2023-11-03 13:25:10 -07:00
Ishaan Jaff	fe0699cc6c	Update README.md	2023-11-03 13:15:39 -07:00
Ishaan Jaff	9abfb45f0c	Update README.md	2023-11-03 13:12:09 -07:00
ishaan-jaff	af674701af	(test) add palm streaming	2023-11-03 13:09:39 -07:00
Krrish Dholakia	9f180831fe	docs(simple_proxy.md): doc cleanup	2023-11-03 13:07:07 -07:00
ishaan-jaff	6fc0c74878	(fix) remove errant print statements	2023-11-03 13:02:52 -07:00
ishaan-jaff	89e32db321	(fix) remove errant tg ai print statements	2023-11-03 12:59:23 -07:00
Krrish Dholakia	f6486b9df9	docs(simple_proxy.md): adding bedrock tutorial	2023-11-03 12:58:48 -07:00
ishaan-jaff	43e69a7aa8	(test) vertex ai	2023-11-03 12:54:36 -07:00
ishaan-jaff	6c82abf5bf	(fix) vertex ai streaming	2023-11-03 12:54:36 -07:00
Krrish Dholakia	6b3671b593	fix(proxy_server.py): accept config.yaml	2023-11-03 12:50:52 -07:00
ishaan-jaff	e09b4cb01a	bump: version 0.12.11 → 0.12.12	2023-11-03 10:04:14 -07:00
ishaan-jaff	539bdae364	(fix) remove errant print statements	2023-11-03 08:20:14 -07:00
ishaan-jaff	8b389e9e8a	(fix) proxy correctly handle reading data using ast, fallback to json.loads if ast parse fails	2023-11-02 21:14:08 -07:00
ishaan-jaff	4d82c81531	(fix) proxy cli tests	2023-11-02 21:14:08 -07:00
ishaan-jaff	104239dbe7	(fix) proxy server - verbose = False always	2023-11-02 21:14:08 -07:00
Krrish Dholakia	e3a1c58dd9	build(litellm_server/utils.py): add support for general settings + num retries as a module variable	2023-11-02 20:56:41 -07:00
ishaan-jaff	3f1b4c0759	(fix) linting fix	2023-11-02 17:28:45 -07:00