Commit graph

8515 commits

Author SHA1 Message Date
ishaan-jaff
8bfb00cdab (fix) default langfuse setting 2024-03-12 17:42:31 -07:00
Krish Dholakia
0d18f3c0ca
Merge pull request #2473 from BerriAI/litellm_fix_compatible_provider_model_name
fix(openai.py): return model name with custom llm provider for openai-compatible endpoints (e.g. mistral, together ai, etc.)
2024-03-12 12:58:29 -07:00
Krish Dholakia
1ba102c618
Merge pull request #2475 from BerriAI/litellm_azure_dall_e_3_cost_tracking
fix(azure.py): support cost tracking for azure/dall-e-3
2024-03-12 12:57:31 -07:00
ishaan-jaff
a18c941621 (fix) failing cohere test 2024-03-12 12:44:19 -07:00
Ishaan Jaff
b2d5f775ca
Merge pull request #2478 from BerriAI/litellm_fix_dynamo_team_alias
(fix) patch dynamoDB team_model_alias bug
2024-03-12 12:34:53 -07:00
ishaan-jaff
6f069d26f3 (fix) patch dynamoDB tea_model_alias bug 2024-03-12 11:17:12 -07:00
Ishaan Jaff
5172fb1de9
Merge pull request #2474 from BerriAI/litellm_support_command_r
[New-Model] Cohere/command-r
2024-03-12 11:11:56 -07:00
Krrish Dholakia
5d12236457 bump: version 1.31.3 → 1.31.4 2024-03-12 11:07:45 -07:00
Krrish Dholakia
d2286fb93c fix(main.py): trigger new build 2024-03-12 11:07:14 -07:00
Krrish Dholakia
fd4086d5da fix(proxy_server.py): fix /user/info for non-existent user id 2024-03-12 11:05:41 -07:00
Krrish Dholakia
7dd94c802e fix(azure.py): support cost tracking for azure/dall-e-3 2024-03-12 10:55:54 -07:00
ishaan-jaff
777cf094e5 (feat) use model json to get cohere_models 2024-03-12 10:53:26 -07:00
ishaan-jaff
aa8b5e9768 (feat) add cohere_chat to model_prices 2024-03-12 10:51:33 -07:00
ishaan-jaff
e5bb65669d (feat) exception mapping for cohere_chat 2024-03-12 10:45:42 -07:00
ishaan-jaff
8fabaed543 (docs) cohere-comand-r 2024-03-12 10:34:08 -07:00
ishaan-jaff
f50539ace9 (test) command_r 2024-03-12 10:30:33 -07:00
Krrish Dholakia
0033613b9e fix(openai.py): return model name with custom llm provider for openai compatible endpoints 2024-03-12 10:30:10 -07:00
ishaan-jaff
7635c764cf (feat) cohere_chat provider 2024-03-12 10:29:26 -07:00
Ishaan Jaff
01921aeb5a
Merge pull request #2471 from BerriAI/litellm_azure_instruct
(feat) support azure/gpt-instruct models
2024-03-12 10:27:24 -07:00
ishaan-jaff
042a71cdc7 (feat) v0 support command-r 2024-03-12 10:26:58 -07:00
ishaan-jaff
ea83c8c9b0 (docs) using azure_text models 2024-03-12 09:54:34 -07:00
ishaan-jaff
223ac464d7 (fix) support streaming for azure/instruct models 2024-03-12 09:50:43 -07:00
ishaan-jaff
b193b01f40 (feat) support azure/gpt-instruct models 2024-03-12 09:30:15 -07:00
Krrish Dholakia
10f5f342bd docs(virtual_keys.md): cleanup doc 2024-03-12 07:05:55 -07:00
Krrish Dholakia
47424b8c90 docs(routing.md): fix routing example on docs 2024-03-11 22:17:04 -07:00
Ishaan Jaff
477056339b
Merge pull request #2465 from BerriAI/litellm_router_docs
(docs) using litellm router
2024-03-11 21:18:38 -07:00
ishaan-jaff
e46980c56c (docs) using litellm router 2024-03-11 21:18:10 -07:00
ishaan-jaff
824b8b1b62 bump: version 1.31.2 → 1.31.3 2024-03-11 21:02:56 -07:00
Ishaan Jaff
1c28b8ee2d
Merge pull request #2462 from BerriAI/litellm_imp_mem_use
[Litellm-Proxy, Router] improve memory usage - don't store messages in memory, previous models in memory
2024-03-11 19:04:25 -07:00
Ishaan Jaff
cd8f25f6f8
Merge branch 'main' into litellm_imp_mem_use 2024-03-11 19:00:56 -07:00
Ishaan Jaff
881063c424
Merge pull request #2461 from BerriAI/litellm_improve_mem_use
LiteLLM -  improve memory utilization - don't use inMemCache on Router
2024-03-11 18:59:57 -07:00
ishaan-jaff
b6e7882fdb (fix) test mem usage 2024-03-11 16:53:03 -07:00
ishaan-jaff
eae1710c4b (fix) mem usage router.py 2024-03-11 16:52:06 -07:00
ishaan-jaff
3dda6f0cf3 (fix) test_mem_usage 2024-03-11 16:38:31 -07:00
ishaan-jaff
1bd3bb1128 (fix) improve mem util 2024-03-11 16:22:04 -07:00
Krish Dholakia
5647d945ff
Merge pull request #2448 from BerriAI/litellm_delete_key_security_fix
fix(proxy_server.py): prevent user from deleting non-user owned keys
2024-03-11 15:47:34 -07:00
Krish Dholakia
b4b3a3ae20
Merge pull request #2458 from eladsegal/eladsegal-patch-1
Make `argon2-cffi` optional
2024-03-11 15:43:48 -07:00
Krish Dholakia
291deeb691
Merge pull request #2459 from BerriAI/litellm_embedding_router_fix
fix(router.py): support fallbacks / retries with sync embedding calls
2024-03-11 15:32:13 -07:00
Krrish Dholakia
917f92800d test(test_key_generate_prisma.py): fix tests 2024-03-11 15:24:42 -07:00
Krrish Dholakia
64aeb088d9 test(test_key_generate_prisma.py): fix test 2024-03-11 14:59:11 -07:00
Krrish Dholakia
9735250db7 fix(router.py): support fallbacks / retries with sync embedding calls 2024-03-11 14:51:22 -07:00
Elad Segal
c4db5d4c33
Make argon2-cffi optional, used only for proxy 2024-03-11 23:35:03 +02:00
Krrish Dholakia
d1644db8ce test(test_key_generate_prisma.py): fix test to only let admin delete a key 2024-03-11 14:18:01 -07:00
Krrish Dholakia
e07174736f refactor(main.py): trigger new build 2024-03-11 13:57:40 -07:00
Krrish Dholakia
f683acda61 build: fix default config 2024-03-11 13:56:10 -07:00
Krrish Dholakia
2addd66393 fix(proxy_server.py): bug fix 2024-03-11 13:54:58 -07:00
Krrish Dholakia
1369e18e85 build: fix default config.yaml 2024-03-11 13:43:50 -07:00
Krrish Dholakia
2f1899284c fix(router.py): add more debug logs 2024-03-11 12:34:35 -07:00
ishaan-jaff
e23c68b15a (fix) failing usage based routing test 2024-03-11 12:14:13 -07:00
Krrish Dholakia
4eb244c3ca fix(proxy_server.py): prevent user from deleting non-user owned keys when they use ui 2024-03-11 12:13:30 -07:00