Commit graph

45043 commits

Author SHA1 Message Date
ishaan-jaff
5fcf9fc799 (docs) proxy setting default models 2023-11-10 13:06:22 -08:00
ishaan-jaff
ebcd29b1ec (docs) proxy pass headers 2023-11-10 12:59:34 -08:00
ishaan-jaff
9d4cbf1d22 (docs) pass headers in config 2023-11-10 12:56:53 -08:00
ishaan-jaff
af98f74c82 (feat) replicate add exception mapping for streaming + better logging when polling 2023-11-10 12:46:33 -08:00
ishaan-jaff
1c1a260065 (test) replicate with streaming, num retries 2023-11-10 12:46:33 -08:00
ishaan-jaff
49c8c8a74f (fix) streaming replicate 2023-11-10 12:46:33 -08:00
ishaan-jaff
bf2cb91841 (docs) add replicate cold boots info 2023-11-10 12:46:33 -08:00
ishaan-jaff
4c3765119b (fix) replicate print verbose 2023-11-10 12:46:33 -08:00
ishaan-jaff
49c7c851a8 (feat) replicate exception mapping 2023-11-10 12:46:33 -08:00
ishaan-jaff
00e1b46e68 (feat) replicate exception mapping 2023-11-10 12:46:33 -08:00
Krrish Dholakia
62290ec5d9 fix(utils.py): fix exception raised 2023-11-10 11:28:17 -08:00
Krrish Dholakia
18a8bd5543 fix(utils.py): return function call as part of response object 2023-11-10 11:02:10 -08:00
Krrish Dholakia
a4c9e6bd46 fix(utils.py): fix cached responses - translate dict to objects 2023-11-10 10:38:20 -08:00
Krrish Dholakia
84460b8222 docs(input.md): adding anyscale supported params 2023-11-10 09:26:57 -08:00
Krish Dholakia
271238536f
Merge pull request #790 from nathankim7/standardize-available-deployments
Fix bad returns in get_available_deployment
2023-11-10 08:59:48 -08:00
ishaan-jaff
2f07460333 (feat) completion ollama raise exception when ollama resp != 200 2023-11-10 08:54:05 -08:00
Nathan Kim
f7dc2bf545 first commit 2023-11-09 22:12:39 -08:00
Nathan Kim
ee92c9c8b6 first commit 2023-11-09 22:07:19 -08:00
Ishaan Jaff
8f10d1a3e3
Merge pull request #789 from PrathamSoni/psoni2002/fix_async
add custom open ai models to asyncio call
2023-11-09 21:12:22 -08:00
Pratham Soni
2f37baa690
add custom open ai models to asyncio call 2023-11-09 20:47:46 -08:00
Krrish Dholakia
86f9bb0af6 test(test_completion.py): fix openai testing 2023-11-09 19:05:34 -08:00
Krrish Dholakia
7769abe432 fix(test_caching.py): flaky test 2023-11-09 18:54:21 -08:00
Krrish Dholakia
3d4c5e10a7 fix(utils.py): fix sync streaming 2023-11-09 18:47:20 -08:00
ishaan-jaff
76d8ea674e (docs) replicate 2023-11-09 18:16:21 -08:00
Krrish Dholakia
249cde3d40 fix(main.py): accepting azure deployment_id 2023-11-09 18:16:02 -08:00
ishaan-jaff
523c540051 (replicate) deployments 2023-11-09 18:10:38 -08:00
ishaan-jaff
6f639f30c5 (docs) replicate deployments 2023-11-09 18:10:38 -08:00
ishaan-jaff
d0c9bfd14a (feat) completion - replicate custom deployments 2023-11-09 18:10:38 -08:00
Krrish Dholakia
62e83ce75a test(test_completion.py): fix test case 2023-11-09 17:43:18 -08:00
ishaan-jaff
e355a0674f (docs) using auto evals 2023-11-09 17:31:50 -08:00
ishaan-jaff
7ddd29da93 (docs) litellm eval suites 2023-11-09 17:22:42 -08:00
ishaan-jaff
108336aeef (docs) using proxy with mlfow eval 2023-11-09 17:21:43 -08:00
ishaan-jaff
953593e137 (docs) add mlflow 2023-11-09 17:18:32 -08:00
ishaan-jaff
88111fbb36 (docs) auto evals 2023-11-09 17:18:32 -08:00
Krrish Dholakia
b19e7dcc5a fix(utils.py): fix logging integrations 2023-11-09 17:09:49 -08:00
Krrish Dholakia
b9e6989e41 test: fix linting issues 2023-11-09 16:50:43 -08:00
Krrish Dholakia
e12bff6d7f refactor(azure.py): enabling async streaming with aiohttp 2023-11-09 16:41:06 -08:00
Krrish Dholakia
c053782d96 refactor(openai.py): support aiohttp streaming 2023-11-09 16:15:30 -08:00
ishaan-jaff
bba62b56d3 (docs) auto eval tutorial 2023-11-09 15:43:55 -08:00
ishaan-jaff
87328a973e (docs) add tutorial on using litellm with autoeval 2023-11-09 15:42:12 -08:00
ishaan-jaff
40e7e2ce48 (docs) cleanup 2023-11-09 13:24:13 -08:00
ishaan-jaff
9fd51f66d0 (docs) cleanup 2023-11-09 13:20:15 -08:00
ishaan-jaff
376dae73f9 (docs) openai proxy configs 2023-11-09 13:18:35 -08:00
ishaan-jaff
4b4d9bf142 (feat) proxy use default model in config 2023-11-09 13:08:23 -08:00
ishaan-jaff
c4a948ff96 (feat) proxy add config 2023-11-09 13:06:38 -08:00
ishaan-jaff
d48ed083ab (docs) cleanup 2023-11-09 11:51:55 -08:00
ishaan-jaff
4bc70329a4 (docs) proxy with config 2023-11-09 11:50:13 -08:00
ishaan-jaff
64a50d6b98 (fix) proxy cleanup 2023-11-09 11:31:31 -08:00
ishaan-jaff
333268c8b7 (fix) proxy cli default local debug to False 2023-11-09 11:30:11 -08:00
ishaan-jaff
24bb6558a7 (feat) show well documented config 2023-11-09 11:29:53 -08:00