Commit graph

4350 commits

Author SHA1 Message Date
Krrish Dholakia
dd6caa8b55 fix(proxy_server.py): fix linting errors 2023-12-09 12:17:33 -08:00
Krrish Dholakia
ed50522863 fix(proxy_server.py): fix pydantic version errors 2023-12-09 12:09:49 -08:00
ishaan-jaff
0294e1119e (fix) success_handler / logging 2023-12-09 11:38:42 -08:00
ishaan-jaff
8cbd6010c8 (test) redis caching init calbacks to be empty 2023-12-09 11:32:35 -08:00
Krrish Dholakia
c1c81af9d4 fix(proxy_server.py): add custom json helper func to work across multiple pydantic versions 2023-12-09 11:13:03 -08:00
Krish Dholakia
7ed68da149 Updated config.yml 2023-12-09 11:09:18 -08:00
Krrish Dholakia
9433c3c11b test: trigger ci/cd build 2023-12-09 11:03:19 -08:00
Krish Dholakia
4d0615391b Updated config.yml 2023-12-09 11:00:40 -08:00
ishaan-jaff
875b7d1c7f (test) custom logger 2023-12-09 10:42:50 -08:00
Krrish Dholakia
c482c399ff fix(proxy_server.py): add logging around /key/generate 2023-12-09 10:26:12 -08:00
Krish Dholakia
c8eca35015 Updated config.yml 2023-12-09 10:23:36 -08:00
ishaan-jaff
4643a9ac18 (test) custom logger + stream + sync compl() 2023-12-09 10:22:45 -08:00
Krish Dholakia
341382cb97 Updated config.yml 2023-12-09 10:20:46 -08:00
ishaan-jaff
c8b699c0aa (feat) custom logger: async stream,assemble chunks 2023-12-09 10:10:48 -08:00
ishaan-jaff
5d65550732 (test) custom logger print success handler 2023-12-09 10:04:10 -08:00
ishaan-jaff
8b144451e6 (test) model_info calback 2023-12-08 22:00:36 -08:00
Krrish Dholakia
4bf875d3ed fix(router.py): fix least-busy routing 2023-12-08 20:29:49 -08:00
ishaan-jaff
d9b115b8fb (ci/cd) run again 2023-12-08 19:26:55 -08:00
ishaan-jaff
9e9781d193 (Docs) Proxy,remove traceloop api key req 2023-12-08 19:26:05 -08:00
ishaan-jaff
db51a95a42 (test) init success_callback = [] for ci/cd 2023-12-08 19:16:12 -08:00
ishaan-jaff
04ec363788 (test) redis cache 2023-12-08 19:14:46 -08:00
ishaan-jaff
d7265a84c9 (test) caching reset success_callback 2023-12-08 19:10:35 -08:00
ishaan-jaff
4cdada62c5 (ci/cd) run another test 2023-12-08 19:04:45 -08:00
ishaan-jaff
fcc9f3c504 (ci/cd) q up another test 2023-12-08 18:55:18 -08:00
ishaan-jaff
dface6a36f (docs) traceloop 2023-12-08 18:47:18 -08:00
ishaan-jaff
c7eebf75a8 (ci/cd) test proxy custom logger 2023-12-08 18:46:19 -08:00
ishaan-jaff
0dc7d538b5 (docs) proxy - OTEL + traceloop 2023-12-08 18:39:52 -08:00
ishaan-jaff
13731f4bd8 (test) fix 2023-12-08 18:25:11 -08:00
ishaan-jaff
1ca50c5fa2 (ci/cd) run again 2023-12-08 18:11:01 -08:00
ishaan-jaff
b84f6670ea (docs) custom callbacks proxy 2023-12-08 18:00:58 -08:00
ishaan-jaff
ccee0cefe4 (ci/cd) run tests 2023-12-08 17:50:14 -08:00
ishaan-jaff
39ea2e0909 (ci/cd) add langfuse 2023-12-08 17:49:43 -08:00
Krish Dholakia
f2bba58a24 Updated config.yml 2023-12-08 17:49:42 -08:00
ishaan-jaff
5efe336968 (fix) linting 2023-12-08 17:26:14 -08:00
ishaan-jaff
8c628b64e0 (test) proxy - custom logger 2023-12-08 17:25:05 -08:00
ishaan-jaff
88c1d6649f (fix) asyc callback + stream-stop dbl cnt chunk 2023-12-08 17:25:05 -08:00
ishaan-jaff
e237361891 (test) async logger + streaming 2023-12-08 17:25:05 -08:00
ishaan-jaff
b50faed5ab (test) callback - strict test - async callback resp 2023-12-08 17:25:05 -08:00
ishaan-jaff
34428a8e67 (docs) fix 2023-12-08 17:25:05 -08:00
ishaan-jaff
4e8e3ff33a (fix) async custom logger - trigger when stream completed 2023-12-08 17:25:05 -08:00
Krrish Dholakia
5fa2b6e5ad fix(proxy_server.py): enable pre+post-call hooks and max parallel request limits 2023-12-08 17:11:30 -08:00
ishaan-jaff
977bfaaab9 (docs) proxy - get model_info,server_request 2023-12-08 14:57:29 -08:00
ishaan-jaff
76d0c50523 (ci/cd) comment beta test 2023-12-08 14:27:53 -08:00
ishaan-jaff
73984504e9 (test) proxy: access model_info and request_obj 2023-12-08 14:26:18 -08:00
ishaan-jaff
14d57ec7de (feat) proxy: log model_info + proxy_server request 2023-12-08 14:26:18 -08:00
ishaan-jaff
93b1df1c79 (feat) embedding - pass model_info, proxy_server request 2023-12-08 14:26:18 -08:00
ishaan-jaff
9805269bd7 (feat) proxy: pass model_info as kwargs 2023-12-08 14:26:18 -08:00
ishaan-jaff
be94a8c478 (feat) pass model_info, proxy_server_request to callback 2023-12-08 14:26:18 -08:00
ishaan-jaff
72cca2e5a7 (feat) pass model_info, proxy_server_request callback 2023-12-08 14:26:18 -08:00
Krrish Dholakia
bab958561e fix(proxy/utils.py): correctly raise exceptions on db call fail 2023-12-08 13:35:42 -08:00