Commit graph

8851 commits

Author SHA1 Message Date
Krrish Dholakia
9ce7aeab67 build: fix build 2024-03-19 17:09:23 -07:00
Krrish Dholakia
8c91156842 build: build fixes 2024-03-19 16:59:59 -07:00
Krrish Dholakia
a8d3d51d21 docs(token_based_auth.md): add jwt auth to docs 2024-03-19 16:34:27 -07:00
Krrish Dholakia
7aff716c68 build(requirements.txt): add jwt to docker requirements 2024-03-19 16:23:24 -07:00
Krrish Dholakia
302bab6f1f feat(handle_jwt.py): support authenticating admins into the proxy via jwt's 2024-03-19 15:00:27 -07:00
Krrish Dholakia
4913ad41db bump: version 1.32.4 → 1.32.5 2024-03-19 12:09:24 -07:00
Krrish Dholakia
7c74a0e6e2 fix(proxy_server.py): expose disable_spend_logs flag in config general settings
Writing each spend log adds +300ms latency

https://github.com/BerriAI/litellm/issues/1714#issuecomment-1924727281
2024-03-19 12:08:37 -07:00
Krish Dholakia
c840fecdeb
Merge pull request #2142 from vilmar-hillow/azure_embedding_ad_token
Fixed azure ad token not being processed properly in embedding models
2024-03-19 11:51:28 -07:00
Krish Dholakia
97130bb34b
Merge pull request #2558 from lucasmrdt/main
fix(anthropic): tool calling detection
2024-03-19 11:48:05 -07:00
Krish Dholakia
25e0d9ac3a
Merge pull request #2562 from dragosMC91/add-mistral-medium-latest-to-prices-reference
Add mistral medium latest to model prices
2024-03-19 11:38:35 -07:00
Dragos Campean
40c2c343be Update small model name 2024-03-19 20:05:32 +02:00
Dragos Campean
28d5175908 Correct prices for mistral models 2024-03-19 20:02:09 +02:00
Krrish Dholakia
c03694ae1e fix(proxy/utils.py): cleanup logging 2024-03-19 09:29:29 -07:00
Krrish Dholakia
c63259ebcd docs(deploy.md): update docker start command 2024-03-19 07:58:08 -07:00
Krrish Dholakia
b6f094c5ec test(test_streaming.py): fix test 2024-03-18 22:06:29 -07:00
Krrish Dholakia
f18250df48 bump: version 1.32.3 → 1.32.4 2024-03-18 21:51:44 -07:00
Krish Dholakia
c4dbd0407e
Merge pull request #2561 from BerriAI/litellm_batch_writing_db
fix(proxy/utils.py): move to batch writing db updates
2024-03-18 21:50:47 -07:00
Ishaan Jaff
56f2f1b901 (test) usage based routing test 2024-03-18 21:39:59 -07:00
Krrish Dholakia
2fdc20f549 test: handle vertex ai rate limit errors 2024-03-18 21:33:08 -07:00
Krrish Dholakia
2827acc487 refactor(main.py): trigger new build 2024-03-18 21:27:32 -07:00
Ishaan Jaff
52a5ed410b (ci/cd) run again 2024-03-18 21:24:24 -07:00
Krrish Dholakia
693b5eb376 docs(main.py): add timeout to docstring 2024-03-18 21:23:46 -07:00
Krrish Dholakia
7eaddaef10 refactor(proxy_server.py): re-add custom db client logic - prevent regressions 2024-03-18 21:16:28 -07:00
Ishaan Jaff
a524918140 (fix) test load config proxy with redis 2024-03-18 20:42:41 -07:00
Krrish Dholakia
0b39bc141b test(test_update_spend.py): fix test 2024-03-18 20:38:21 -07:00
Ishaan Jaff
ef39b1bc43
Merge pull request #2581 from BerriAI/litellm_ui_show_global_spend
[FIX] UI show global spend - when proxy budget not set
2024-03-18 20:34:30 -07:00
Ishaan Jaff
a3397dd6c5 (feat) update ui build 2024-03-18 20:32:28 -07:00
Ishaan Jaff
51d658e878 (fix) if litellm-proxy-budget set use it 2024-03-18 20:31:23 -07:00
Krrish Dholakia
f588bff69b fix(proxy_server.py): fix spend log update 2024-03-18 20:26:28 -07:00
Krish Dholakia
c669943292
Merge pull request #2577 from BerriAI/litellm_vertex_ai_streaming_func_call
feat(vertex_ai.py): support gemini (vertex ai) function calling when streaming
2024-03-18 20:10:00 -07:00
Krish Dholakia
5edb703d78
Merge pull request #1527 from TheDiscoMole/litellm_non_openai_tool_call_prompt
improving non-openai tool_call prompt
2024-03-18 18:29:42 -07:00
Krish Dholakia
59a4e1bfb6
Merge branch 'main' into litellm_non_openai_tool_call_prompt 2024-03-18 18:29:36 -07:00
Ishaan Jaff
3d890ff396 (ui) show spend when budget not set 2024-03-18 18:28:30 -07:00
Ishaan Jaff
a8473042d1 (ui) show users their spend when max budget not set 2024-03-18 18:28:13 -07:00
Krish Dholakia
0ca619dc5d
Merge pull request #2548 from zdsfwy/main
fix bug: custom prompt templates registered are never applied to vllm provider
2024-03-18 18:19:45 -07:00
Ishaan Jaff
87dd3f1235 (fix) show global spend on UI 2024-03-18 18:15:08 -07:00
Ishaan Jaff
be6fb579df bump: version 1.32.2 → 1.32.3 2024-03-18 17:14:04 -07:00
Ishaan Jaff
faddf5d351 bump: version 1.32.1 → 1.32.2 2024-03-18 17:14:01 -07:00
Ishaan Jaff
436de920e4
Merge pull request #2579 from BerriAI/litellm_datadog_docs
[Docs] datadog docs + LiteLLM Proxy
2024-03-18 17:12:52 -07:00
Ishaan Jaff
bb54d692ec
Merge pull request #2578 from BerriAI/litellm_datadog_int
[FEAT] DataDog Logging Provider
2024-03-18 17:10:59 -07:00
Ishaan Jaff
038c9d5781 (docs) litellm + datadog 2024-03-18 17:06:00 -07:00
Krrish Dholakia
8fefe625d9 fix(proxy/utils.py): batch writing updates to db 2024-03-18 16:47:02 -07:00
Ishaan Jaff
0dab5841cd (fix) proxy extra spacing 2024-03-18 16:43:04 -07:00
Ishaan Jaff
fedb4e5703 (fix) clean dd imports 2024-03-18 16:40:58 -07:00
Ishaan Jaff
17295286d3 (cleanup) extra line 2024-03-18 16:40:01 -07:00
Ishaan Jaff
325eb35b44 (cleanup) proxy 2024-03-18 16:31:16 -07:00
Ishaan Jaff
2bce2ee7e3 (fix) log to datadog 2024-03-18 16:27:55 -07:00
Ishaan Jaff
2afddf4536 (feat) init datadog logger 2024-03-18 16:27:01 -07:00
Ishaan Jaff
6a7c86fc58 (test) dd test 2024-03-18 16:22:59 -07:00
Ishaan Jaff
ac826851fa (feat) v0 datadog logger 2024-03-18 16:01:47 -07:00