Commit graph

45043 commits

Author SHA1 Message Date
ishaan-jaff
accd6eb97f (docs) move litellm proxy higher up 2023-10-11 10:54:11 -07:00
ishaan-jaff
db90f96659 (docs) add ollama higher up in litellm docs 2023-10-11 10:52:56 -07:00
Krrish Dholakia
5e5466dfaf fix(proxy_server.py): use tomli instead of tomllib 2023-10-11 10:43:53 -07:00
ishaan-jaff
6e2e020428 (docs) ollama add mistral, code llama and llama2 2023-10-11 10:18:58 -07:00
ishaan-jaff
f84fb8c76d (docs) ollama models 2023-10-11 08:55:38 -07:00
ishaan-jaff
41cd1bbfd6 (docs) add ollama docker image 2023-10-11 08:42:03 -07:00
ishaan-jaff
2694dd34b0 (docs) new ollama_docker image 2023-10-11 08:42:03 -07:00
ishaan-jaff
d40aeec131 (fix) proxy_server add LiteLLM: Running 2023-10-11 08:42:03 -07:00
Krrish Dholakia
ca7e2f6a05 docs(proxy_server.md): add docker image details to docs 2023-10-11 08:28:08 -07:00
Ishaan Jaff
24ea5e00b7
Merge pull request #581 from pchalasani/langroid-example
shorter langroid example, update section title
2023-10-11 07:57:28 -07:00
Prasad Chalasani
9fe795dc81 shorter langroid example, update section title 2023-10-11 10:48:58 -04:00
Krrish Dholakia
dfd91c5d46 fix(openai-py): fix linting errors 2023-10-10 21:56:14 -07:00
Krrish Dholakia
68461f5863 fix(openai-py): fix linting issues 2023-10-10 21:49:14 -07:00
Krrish Dholakia
208a6d365b fix(openai.py): fix linting errors 2023-10-10 21:04:13 -07:00
Krrish Dholakia
d280a8c434 fix(proxy_cli-and-utils.py): fixing how config file is read + infering llm_provider for known openai endpoints 2023-10-10 20:53:02 -07:00
Krrish Dholakia
d99d6a99f1 bump: version 0.7.1.dev3 → 0.7.1 2023-10-10 18:44:05 -07:00
Krrish Dholakia
1b88868f2c fix(env-template): fixing togetherai api key naming in env template 2023-10-10 18:43:42 -07:00
Krrish Dholakia
65364713b9 bump: version 0.7.1.dev2 → 0.7.1.dev3 2023-10-10 18:18:04 -07:00
Krrish Dholakia
1df3f349fe style(proxy_cli): additional tracing 2023-10-10 18:17:57 -07:00
Krrish Dholakia
c5a039be99 bump: version 0.7.1.dev1 → 0.7.1.dev2 2023-10-10 18:12:36 -07:00
Krrish Dholakia
661ea2359b refactor(proxy_cli): adding additional tracing 2023-10-10 18:12:31 -07:00
Krrish Dholakia
a6f35c8d7a bump: version 0.7.0 → 0.7.1.dev1 2023-10-10 18:07:57 -07:00
Krrish Dholakia
5a72688648 docs(proxy_server): name fix 2023-10-10 16:51:38 -07:00
Krrish Dholakia
15afa6cde9 docs(proxy_server): adding langdroid tutorial 2023-10-10 16:28:58 -07:00
Krrish Dholakia
109826e868 docs(proxy_server): fix autogen tutorial docs 2023-10-10 16:27:04 -07:00
Krrish Dholakia
0e7b83785b fix(init.py): expose complete client session 2023-10-10 15:16:10 -07:00
Krrish Dholakia
b2b724a35c style(proxy_cli.py): adding feedback box 2023-10-10 13:49:54 -07:00
Krrish Dholakia
544740bc21 bump: version 0.6.6 → 0.7.0 2023-10-10 13:23:49 -07:00
Krrish Dholakia
b50013386f fix(openai.py): enable custom proxy to pass in ca_bundle_path 2023-10-10 13:23:27 -07:00
ishaan-jaff
7125016d24 (docs) custom callback for tracking costs 2023-10-10 11:36:02 -07:00
ishaan-jaff
7496afdf64 (feat) proxy_server add a track_cost_callback for streaming 2023-10-10 11:33:08 -07:00
ishaan-jaff
68b655df51 (docs) proxy_server 2023-10-10 10:38:10 -07:00
ishaan-jaff
449403e2b3 (docs) proxy_server 2023-10-10 10:26:44 -07:00
ishaan-jaff
cf580a4995 (docs) add cost tracking to proxy server 2023-10-10 10:19:15 -07:00
Krrish Dholakia
af2fd0e0de fix: fix value error if model returns empty completion 2023-10-10 10:11:40 -07:00
ishaan-jaff
6d81bcc248 bump: version 0.6.5 → 0.6.6 2023-10-10 10:05:47 -07:00
ishaan-jaff
b16cbb069a (test) update supabase logger test 2023-10-10 10:05:20 -07:00
ishaan-jaff
2b8a8297af (docs) fix tracking end users 2023-10-10 10:04:47 -07:00
ishaan-jaff
f97811fb1c (fix) remove print from supabaseClient 2023-10-10 09:59:38 -07:00
ishaan-jaff
228d77d345 (fix) identify users in logging 2023-10-10 09:56:16 -07:00
ishaan-jaff
5de280c9e5 (fix) identify users in callbacks 2023-10-10 09:55:57 -07:00
ishaan-jaff
a89d3ed2af (fix) supabase fix upsert bug 2023-10-10 09:55:10 -07:00
ishaan-jaff
35b9f34751 (fix) supabase callback use litellm.completion_cost 2023-10-10 08:58:16 -07:00
ishaan-jaff
e19b4fc114 (feat) proxy_server: begin using callback for tracking costs 2023-10-10 08:35:31 -07:00
ishaan-jaff
a27d9ad6bc (docs) add ollama/llama2 llm max_tokens + cost 2023-10-10 08:35:31 -07:00
ishaan-jaff
c94ee62bcf (feat) allow messages to be passed in completion_cost 2023-10-10 08:35:31 -07:00
Krrish Dholakia
29b2fa7f75 fix(test-fixes): test fixes 2023-10-10 08:09:42 -07:00
Krrish Dholakia
0d863f00ad refactor(bedrock.py): take model names from model cost dict 2023-10-10 07:35:03 -07:00
Krrish Dholakia
152ffca815 docs(model-price-json): add bedrock models 2023-10-10 07:35:03 -07:00
Krish Dholakia
7a0dc6487b
Update README.md 2023-10-10 07:15:10 -07:00