Commit graph

45043 commits

Author SHA1 Message Date
ishaan-jaff
b8ebab5d4f (test) router functionality 2023-11-08 09:48:48 -08:00
ishaan-jaff
39ca8b5043 bump: version 0.13.7 → 0.13.8 2023-11-08 09:46:57 -08:00
Ishaan Jaff
8cedacfa2d
Merge pull request #781 from clalanliu/main
fix: fix bug for the case --model is not specified
2023-11-08 08:26:32 -08:00
Alan Liu
6c17ab6e75 fix: fix bug for the case --model is not specified 2023-11-08 23:57:24 +08:00
ishaan-jaff
3239ec80c9 (docs) embedding models 2023-11-07 21:43:02 -08:00
Krrish Dholakia
e7735274de fix(factory.py): fixing llama-2 non-chat models prompt templating 2023-11-07 21:33:54 -08:00
Krrish Dholakia
ce27e08e7d (fix): llama-2 non-chat models prompt template 2023-11-07 21:33:54 -08:00
ishaan-jaff
4ca4038246 (docs) proxy server 2023-11-07 17:27:58 -08:00
ishaan-jaff
febb163850 (docs) proxy server openai api base 2023-11-07 17:24:47 -08:00
Krrish Dholakia
193cbe632f fix(utils.py): llmmonitor integration 2023-11-07 15:49:32 -08:00
ishaan-jaff
83ef369871 (docs) proxy server 2023-11-07 15:39:59 -08:00
ishaan-jaff
c972e4acf2 (docs) proxy server 2023-11-07 15:30:29 -08:00
ishaan-jaff
adf7539be2 (docs) proxy server 2023-11-07 15:27:29 -08:00
ishaan-jaff
7c37d24b46 (docs) proxy 2023-11-07 15:16:28 -08:00
ishaan-jaff
4c31045cee (docs) proxy 2023-11-07 15:14:06 -08:00
ishaan-jaff
813da8ec04 (docs) proxy 2023-11-07 15:11:47 -08:00
ishaan-jaff
ff482f2eb9 (docs) proxy server 2023-11-07 12:16:30 -08:00
Krish Dholakia
ae676116ac
Update README.md 2023-11-07 12:11:15 -08:00
Krish Dholakia
6a5671c576
Update README.md 2023-11-07 12:10:52 -08:00
Krish Dholakia
7a5debb796
Update README.md 2023-11-07 12:10:23 -08:00
Krish Dholakia
9a9c78e9b7
Update README.md 2023-11-07 12:08:59 -08:00
Krish Dholakia
4785fc39bc
Update README.md 2023-11-07 12:08:31 -08:00
Krish Dholakia
dbdd4c2ff2
Update README.md 2023-11-07 12:07:59 -08:00
Krish Dholakia
8e52058c3c
Update README.md 2023-11-07 12:07:46 -08:00
ishaan-jaff
3ef75029cb (docs) proxy server 2023-11-07 12:06:25 -08:00
ishaan-jaff
a16707fc1a (docs) proxy 2023-11-07 11:49:40 -08:00
ishaan-jaff
10b94c8a0a (docs) proxy 2023-11-07 11:39:10 -08:00
ishaan-jaff
0f23f04d06 (docs) cleanup 2023-11-07 11:34:02 -08:00
ishaan-jaff
87d0b72a4a (docs) proxy 2023-11-07 09:48:58 -08:00
Krrish Dholakia
50564ab38e docs(routing.md): adding comparison to docs 2023-11-06 18:57:50 -08:00
Krrish Dholakia
ba66294a3d fix(router.py): fix linting issues 2023-11-06 18:50:09 -08:00
ishaan-jaff
7309fd6225 (fix) ignore rate limit error for gpt4 turbo 2023-11-06 18:34:45 -08:00
Krrish Dholakia
2b48a1fc3e fix(router.py): adding health checks 2023-11-06 18:26:41 -08:00
Krrish Dholakia
6a45879932 bump: version 0.13.6.dev3 → 0.13.6 2023-11-06 18:19:20 -08:00
ishaan-jaff
81d3230651 (test) run ci/cd again 2023-11-06 18:13:18 -08:00
ishaan-jaff
6185d73db5 (test) run ci/cd again 2023-11-06 18:11:29 -08:00
ishaan-jaff
d9a8e01b2a (ci/cd) fix openai==0.28.0 2023-11-06 18:05:18 -08:00
ishaan-jaff
884030078d (docs) bedrock cookbook 2023-11-06 18:00:52 -08:00
ishaan-jaff
2498d95dc5 (feat) parallel HF text completion + completion_with_retries show exception 2023-11-06 17:58:06 -08:00
ishaan-jaff
7219fcb968 (test) hf inference api - text_completion 2023-11-06 17:56:41 -08:00
ishaan-jaff
fbe887f8f9 (fix) proxy server - print error msg on exceptions 2023-11-06 17:55:33 -08:00
ishaan-jaff
ce4423e213 (fix) stability imp: completion() timeout during high traffic, should not raise exception 2023-11-06 17:54:35 -08:00
ishaan-jaff
e0116d2991 (fix) proxy server remove bloat 2023-11-06 15:55:18 -08:00
ishaan-jaff
592fc12710 (fix) linting errors 2023-11-06 14:42:12 -08:00
ishaan-jaff
1df6dd986d (test) hf max tokens, temp 2023-11-06 14:38:21 -08:00
ishaan-jaff
8481e21317 (fix) HF round up temperature 0 -> 0.01 2023-11-06 14:35:06 -08:00
ishaan-jaff
68b6e07aa7 (fix) hf fix this error: Failed: Error occurred: HuggingfaceException - Input validation error: temperature must be strictly positive 2023-11-06 14:22:33 -08:00
ishaan-jaff
3c67de7f04 (fix) hf don't fail when logprob is None 2023-11-06 14:22:09 -08:00
ishaan-jaff
8d9e2574cf (test) add gpt-4-turbo 2023-11-06 13:32:53 -08:00
ishaan-jaff
f7990525ff (docs) add gpt-4 turbo 2023-11-06 13:32:08 -08:00