Commit graph

2979 commits

Author SHA1 Message Date
ishaan-jaff
4c31045cee (docs) proxy 2023-11-07 15:14:06 -08:00
ishaan-jaff
813da8ec04 (docs) proxy 2023-11-07 15:11:47 -08:00
ishaan-jaff
ff482f2eb9 (docs) proxy server 2023-11-07 12:16:30 -08:00
Krish Dholakia
ae676116ac
Update README.md 2023-11-07 12:11:15 -08:00
Krish Dholakia
6a5671c576
Update README.md 2023-11-07 12:10:52 -08:00
Krish Dholakia
7a5debb796
Update README.md 2023-11-07 12:10:23 -08:00
Krish Dholakia
9a9c78e9b7
Update README.md 2023-11-07 12:08:59 -08:00
Krish Dholakia
4785fc39bc
Update README.md 2023-11-07 12:08:31 -08:00
Krish Dholakia
dbdd4c2ff2
Update README.md 2023-11-07 12:07:59 -08:00
Krish Dholakia
8e52058c3c
Update README.md 2023-11-07 12:07:46 -08:00
ishaan-jaff
3ef75029cb (docs) proxy server 2023-11-07 12:06:25 -08:00
ishaan-jaff
a16707fc1a (docs) proxy 2023-11-07 11:49:40 -08:00
ishaan-jaff
10b94c8a0a (docs) proxy 2023-11-07 11:39:10 -08:00
ishaan-jaff
0f23f04d06 (docs) cleanup 2023-11-07 11:34:02 -08:00
ishaan-jaff
87d0b72a4a (docs) proxy 2023-11-07 09:48:58 -08:00
Krrish Dholakia
50564ab38e docs(routing.md): adding comparison to docs 2023-11-06 18:57:50 -08:00
Krrish Dholakia
ba66294a3d fix(router.py): fix linting issues 2023-11-06 18:50:09 -08:00
ishaan-jaff
7309fd6225 (fix) ignore rate limit error for gpt4 turbo 2023-11-06 18:34:45 -08:00
Krrish Dholakia
2b48a1fc3e fix(router.py): adding health checks 2023-11-06 18:26:41 -08:00
Krrish Dholakia
6a45879932 bump: version 0.13.6.dev3 → 0.13.6 2023-11-06 18:19:20 -08:00
ishaan-jaff
81d3230651 (test) run ci/cd again 2023-11-06 18:13:18 -08:00
ishaan-jaff
6185d73db5 (test) run ci/cd again 2023-11-06 18:11:29 -08:00
ishaan-jaff
d9a8e01b2a (ci/cd) fix openai==0.28.0 2023-11-06 18:05:18 -08:00
ishaan-jaff
884030078d (docs) bedrock cookbook 2023-11-06 18:00:52 -08:00
ishaan-jaff
2498d95dc5 (feat) parallel HF text completion + completion_with_retries show exception 2023-11-06 17:58:06 -08:00
ishaan-jaff
7219fcb968 (test) hf inference api - text_completion 2023-11-06 17:56:41 -08:00
ishaan-jaff
fbe887f8f9 (fix) proxy server - print error msg on exceptions 2023-11-06 17:55:33 -08:00
ishaan-jaff
ce4423e213 (fix) stability imp: completion() timeout during high traffic, should not raise exception 2023-11-06 17:54:35 -08:00
ishaan-jaff
e0116d2991 (fix) proxy server remove bloat 2023-11-06 15:55:18 -08:00
ishaan-jaff
592fc12710 (fix) linting errors 2023-11-06 14:42:12 -08:00
ishaan-jaff
1df6dd986d (test) hf max tokens, temp 2023-11-06 14:38:21 -08:00
ishaan-jaff
8481e21317 (fix) HF round up temperature 0 -> 0.01 2023-11-06 14:35:06 -08:00
ishaan-jaff
68b6e07aa7 (fix) hf fix this error: Failed: Error occurred: HuggingfaceException - Input validation error: temperature must be strictly positive 2023-11-06 14:22:33 -08:00
ishaan-jaff
3c67de7f04 (fix) hf don't fail when logprob is None 2023-11-06 14:22:09 -08:00
ishaan-jaff
8d9e2574cf (test) add gpt-4-turbo 2023-11-06 13:32:53 -08:00
ishaan-jaff
f7990525ff (docs) add gpt-4 turbo 2023-11-06 13:32:08 -08:00
Krish Dholakia
7edb37f1a5
Update model_prices_and_context_window.json 2023-11-06 13:19:31 -08:00
ishaan-jaff
07761ac93f (test) text_completion 2023-11-06 13:17:49 -08:00
ishaan-jaff
b4797bec3b (fix) bug fix: completion, text_completion, check if optional params are not None and pass to LLM 2023-11-06 13:17:19 -08:00
ishaan-jaff
f591d79376 (fix) linting fixes 2023-11-06 13:02:11 -08:00
ishaan-jaff
9d65867354 (fix) text_completion naming 2023-11-06 12:47:06 -08:00
Krrish Dholakia
356025cd90 bump: version 0.13.4 → 0.13.5 2023-11-06 12:21:50 -08:00
Krrish Dholakia
6e7e409615 fix(utils.py): remove special characters from streaming output 2023-11-06 12:21:50 -08:00
ishaan-jaff
a2f2fd3841 (fix) text completion linting 2023-11-06 11:53:50 -08:00
Krrish Dholakia
d597746911 bump: version 0.13.3 → 0.13.4 2023-11-06 11:43:12 -08:00
Krrish Dholakia
65c01eae23 fix(huggingface_restapi.py): output parsing chat template models 2023-11-06 11:43:12 -08:00
ishaan-jaff
c46c193c96 (feat) add gpt-4-1106-preview 2023-11-06 10:49:02 -08:00
ishaan-jaff
deddb48683 (docs) litelm custom openai server 2023-11-06 09:24:35 -08:00
ishaan-jaff
7e9c635186 (docs) custom openai proxy 2023-11-06 09:20:20 -08:00
ishaan-jaff
1407ef15a8 (fix) text_completion fixes 2023-11-06 09:11:10 -08:00