Commit graph

46528 commits

Author SHA1 Message Date
Krrish Dholakia
68ca2a28d4 docs: adds redis url to router + proxy docs 2023-12-05 15:08:00 -08:00
Cam Parry
3fc9272640
fix: theNav hrefs 2023-12-06 08:55:53 +10:00
Krrish Dholakia
4d7ff1b33b fix(proxy_server.py): don't override exceptions if they're of type httpexception 2023-12-05 14:33:28 -08:00
ishaan-jaff
c717ed4d05 (test) router: test async embedding + embedding 2023-12-05 14:28:23 -08:00
ishaan-jaff
3ff57493f4 (test) router: openai async, sync, stream, no stream 2023-12-05 14:21:37 -08:00
ishaan-jaff
bc70a6fba8 (test) router: add tests for azure completion, acompletion 2023-12-05 13:59:27 -08:00
ishaan-jaff
0d1b42eda5 (test) azure - test async + sync embedding 2023-12-05 13:35:05 -08:00
Krrish Dholakia
d606a9cb4c refactor(router.py): linting fixes 2023-12-05 13:33:44 -08:00
ishaan-jaff
63939c0a11 (fix) linting 2023-12-05 13:30:12 -08:00
ishaan-jaff
1463cc6023 (test) router Azure regular chat completion call 2023-12-05 13:28:07 -08:00
ishaan-jaff
4e3040b357 (chore) linting fix 2023-12-05 13:23:35 -08:00
ishaan-jaff
e579918dd9 (test) Router: Test Azure acompletion, stream 2023-12-05 13:22:27 -08:00
Krrish Dholakia
58ab0a3f03 fix(router.py): fix cache init 2023-12-05 12:54:27 -08:00
ishaan-jaff
5829227d86 (test) router streaming + azure 2023-12-05 12:54:00 -08:00
ishaan-jaff
3f84ab04c4 (fix) router: Azure Client Init 2023-12-05 12:54:00 -08:00
ishaan-jaff
d9f083b5f8 (fix) router: remove misleading print statement 2023-12-05 12:54:00 -08:00
Krrish Dholakia
397eefabe1 test: remove local test 2023-12-05 12:45:52 -08:00
Krrish Dholakia
a9b50a12c5 bump: version 1.10.7 → 1.10.8 2023-12-05 12:38:42 -08:00
Krrish Dholakia
2a02fcbffb fix(utils.py): map cohere finish reasons 2023-12-05 12:38:18 -08:00
Krrish Dholakia
55b34f969c bump: version 1.10.6 → 1.10.7 2023-12-05 12:26:44 -08:00
Krrish Dholakia
ef7795add6 fix(utils.py): set text if empty string 2023-12-05 12:26:44 -08:00
ishaan-jaff
d5f67a0a25 (docs) proxy + langchain 2023-12-05 12:20:42 -08:00
ishaan-jaff
4f9f53f7dc (docs) proxy: config example with langchain 2023-12-05 12:20:42 -08:00
ishaan-jaff
951bcfc043 (fix) router init: raise error Azure API Base not set 2023-12-05 12:20:42 -08:00
Krrish Dholakia
88c95ca259 fix(_redis.py): support additional params for redis 2023-12-05 12:16:51 -08:00
ishaan-jaff
e615f2670a (docs) proxy + configs 2023-12-05 12:02:35 -08:00
ishaan-jaff
a85a9d7e00 (docs) using proxy with curl, OpenAI, langchain 2023-12-05 11:55:02 -08:00
ishaan-jaff
41075dc977 (docs) litellm proxy + langchain 2023-12-05 11:46:42 -08:00
ishaan-jaff
a0f8bf23ab (test) proxy: langchain compatible 2023-12-05 11:45:35 -08:00
ishaan-jaff
f0c704f3c2 (docs) add example on using proxy with OpenAI 2023-12-05 11:45:35 -08:00
Krrish Dholakia
ddea62fdb1 refactor(proxy_server.py): clean up print statements in proxy server 2023-12-05 11:14:16 -08:00
Krrish Dholakia
b46c73a46e fix: fix proxy testing 2023-12-05 11:13:09 -08:00
ishaan-jaff
a602d59645 (fix) bug in completion: _check_valid_arg 2023-12-05 10:00:54 -08:00
ishaan-jaff
33cf5a3371 bump: version 1.10.5 → 1.10.6 2023-12-05 09:36:59 -08:00
ishaan-jaff
732a049513 (fix) patch max_retries for non openai llms 2023-12-05 09:36:38 -08:00
ishaan-jaff
3bdf61f02a (test) test bedrock on router 2023-12-05 09:35:08 -08:00
ishaan-jaff
13261287ec (fix) proxy: bug non OpenAI LLMs 2023-12-05 09:05:53 -08:00
Krrish Dholakia
943bf53b0b bump: version 1.10.4 → 1.10.5 2023-12-05 07:28:21 -08:00
Krrish Dholakia
71e64c34cb fix(huggingface_restapi.py): raise better exceptions for unprocessable hf responses 2023-12-05 07:28:21 -08:00
Krish Dholakia
1ff8f75752 Updated config.yml 2023-12-04 21:19:32 -08:00
ishaan-jaff
9ba17657ad (feat) init redis cache with **kwargs 2023-12-04 20:50:08 -08:00
Krrish Dholakia
31f3187670 test: fix linting errors 2023-12-04 18:43:01 -08:00
Krrish Dholakia
030bd22078 feat(proxy_server.py): allow user to override api key auth 2023-12-04 18:32:58 -08:00
ishaan-jaff
51cddf1e97 bump: version 1.10.3 → 1.10.4 2023-12-04 18:09:25 -08:00
ishaan-jaff
ac486a3c4a (docs) add example config.yaml 2023-12-04 18:08:57 -08:00
ishaan-jaff
05f585153f (docs) add health check on load balancing 2023-12-04 18:01:21 -08:00
ishaan-jaff
acd1678d14 (docs) router 2023-12-04 17:51:31 -08:00
ishaan-jaff
3f541fe999 (docs) custom timeouts proxy 2023-12-04 17:37:09 -08:00
ishaan-jaff
fa5b453d39 (test) init router 2023-12-04 17:31:12 -08:00
ishaan-jaff
19646091fd (feat) router: init stream, async stream, async, clients 2023-12-04 17:31:12 -08:00