scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-07 02:59:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 103
17204 commits 3222 branches 1436 tags 4.7 GiB
Commit graph

17204 commits

This branch
This branch
All branches
Author SHA1 Message Date
Krrish Dholakia
826bb125e8 test(test_router.py): handle azure api instability 2024-07-25 19:54:40 -07:00
Ishaan Jaff
646b2d50f9 docs -quick start 2024-07-25 19:52:53 -07:00
Krrish Dholakia
a2fd8459fc fix(utils.py): don't raise error on openai content filter during streaming - return as is 
Fixes issue where we would raise an error vs. openai who return the chunk with finish reason as 'content_filter'
 2024-07-25 19:50:52 -07:00
Ishaan Jaff
68e94f0976 example mistral sdk 2024-07-25 19:48:54 -07:00
Ishaan Jaff
bb6f72b315 add mistral sdk usage 2024-07-25 19:47:54 -07:00
David Manouchehri
533426e876 Add mistral.mistral-large-2407-v1:0 on Amazon Bedrock. 2024-07-25 19:36:18 -07:00
fracapuano
c86f8e1eb4 fix: now supports single tokens prediction 2024-07-25 19:35:52 -07:00
Krrish Dholakia
a190bc750f fix(custom_llm.py): pass input params to custom llm 2024-07-25 19:35:52 -07:00
Krrish Dholakia
f5fd9bd3ce feat(proxy_server.py): support custom llm handler on proxy 2024-07-25 19:35:52 -07:00
Krrish Dholakia
acda75b96f docs(custom_llm_server.md): add calling custom llm server to docs 2024-07-25 19:35:48 -07:00
Krrish Dholakia
3b8f357af4 feat(utils.py): support async streaming for custom llm provider 2024-07-25 19:35:48 -07:00
Krrish Dholakia
8c12f7f820 feat(utils.py): support sync streaming for custom llm provider 2024-07-25 19:35:48 -07:00
Krrish Dholakia
7a5c1e7599 fix(custom_llm.py): support async completion calls 2024-07-25 19:35:48 -07:00
Krrish Dholakia
b9b0612c79 feat(custom_llm.py): initial working commit for writing your own custom LLM handler 
Fixes https://github.com/BerriAI/litellm/issues/4675

 Also Addresses https://github.com/BerriAI/litellm/discussions/4677
 2024-07-25 19:35:48 -07:00
Ishaan Jaff
7d68536763 docs - add info about routing strategy on load balancing docs 2024-07-25 19:35:48 -07:00
Ishaan Jaff
fe3c57e1c1 feat support audio health checks for azure 2024-07-25 19:35:48 -07:00
Ishaan Jaff
5ff0e47f22 docs add example on using text to speech models 2024-07-25 19:35:48 -07:00
Ishaan Jaff
1a89f9e86d feat - support health check audio_speech 2024-07-25 19:35:48 -07:00
Ishaan Jaff
734d0c3643 fix whisper health check with litellm 2024-07-25 19:35:48 -07:00
Krrish Dholakia
c23cf1ecc5 fix(router.py): add support for diskcache to router 2024-07-25 19:35:48 -07:00
Krrish Dholakia
a5ecf6b1c1 fix(proxy_server.py): check if input list > 0 before indexing into it 
resolves 'list index out of range' error
 2024-07-25 19:35:48 -07:00
David Manouchehri
fb1a805959 Check for converse support first. 2024-07-25 19:35:40 -07:00
David Manouchehri
2dd30d59ae Support tool calling for Llama 3.1 on Amazon bedrock. 2024-07-25 19:35:40 -07:00
David Manouchehri
35776d7e73 Add Llama 3.1 405b for Bedrock 2024-07-25 19:35:40 -07:00
Krrish Dholakia
52648ebac6 docs(enterprise.md): cleanup docs 2024-07-25 19:35:40 -07:00
Krrish Dholakia
24ff9882ee docs(enterprise.md): cleanup docs 2024-07-25 19:35:40 -07:00
Krrish Dholakia
9ec34313b0 docs(caching.md): update caching docs to include ttl info 2024-07-25 19:35:40 -07:00
Krrish Dholakia
86973d6aca fix(main.py): fix calling openai gpt-3.5-turbo-instruct via /completions 
Fixes https://github.com/BerriAI/litellm/issues/749
 2024-07-25 19:35:40 -07:00
Krrish Dholakia
9955b1b486 fix(internal_user_endpoints.py): support updating budgets for /user/update 2024-07-25 19:35:29 -07:00
Ishaan Jaff
993920ca6c docs add mistral api large 2 2024-07-25 19:35:29 -07:00
Ishaan Jaff
53075030ff feat - add mistral large 2 2024-07-25 19:35:29 -07:00
Ishaan Jaff
bb44d69152 bump: version 1.42.0 → 1.42.1 2024-07-25 19:35:29 -07:00
Ishaan Jaff
910597fcfa docs groq models 2024-07-25 19:35:29 -07:00
Ishaan Jaff
6579095124 feat - add groq/llama-3.1 2024-07-25 19:35:29 -07:00
Krrish Dholakia
11cdb79fc0 test: cleanup testing 2024-07-25 19:35:29 -07:00
Krrish Dholakia
2c71f6dd04 feat(auth_check.py): support using redis cache for team objects 
Allows team update / check logic to work across instances instantly
 2024-07-25 19:35:29 -07:00
Ishaan Jaff
5bec2bf513
Merge pull request #4894 from BerriAI/litellm_logfire_dotenv 
fix logfire - don't load_dotenv
 2024-07-25 19:34:35 -07:00
Ishaan Jaff
693bcfac39 fix using pass_through_all_models 2024-07-25 19:32:49 -07:00
Krish Dholakia
53752100f6
Merge pull request #4870 from BerriAI/litellm_redis_team_object 
feat(auth_check.py): support using redis cache for team objects
 2024-07-25 19:32:04 -07:00
Krish Dholakia
c2086300b7
Merge branch 'main' into litellm_redis_team_object 2024-07-25 19:31:52 -07:00
Krish Dholakia
80e2facf3d
Merge pull request #4883 from Manouchehri/bedrock-llama3.1-405b 
Add Llama 3.1 405b & Tool Calling for Amazon Bedrock
 2024-07-25 19:29:18 -07:00
Krish Dholakia
b6ca4406b6
Merge branch 'main' into bedrock-llama3.1-405b 2024-07-25 19:29:10 -07:00
Ishaan Jaff
a0655b4192
Merge pull request #4884 from Manouchehri/add-mistral-large-2407-bedrock-1 
Add mistral.mistral-large-2407-v1:0 on Amazon Bedrock
 2024-07-25 19:22:46 -07:00
Ishaan Jaff
fcd834b277 fix logfire - don't load_dotenv 2024-07-25 19:22:26 -07:00
Ishaan Jaff
af1cd9e06f docs on pass through support 2024-07-25 19:17:20 -07:00
Krish Dholakia
c0c934d9cf
Merge pull request #4879 from fracapuano/main 
Add Single-Token predictions support for Replicate
 2024-07-25 19:10:57 -07:00
Krish Dholakia
a306b83b2d
Merge pull request #4887 from BerriAI/litellm_custom_llm 
feat(custom_llm.py): Support Custom LLM Handlers
 2024-07-25 19:05:29 -07:00
Krrish Dholakia
41abd51240 fix(custom_llm.py): pass input params to custom llm 2024-07-25 19:03:52 -07:00
Ishaan Jaff
ff0f21a1f3 docs - anthropic 2024-07-25 19:02:22 -07:00
Ishaan Jaff
26a9f694e1
Merge pull request #4890 from BerriAI/docs_set_routing_strategies 
docs - add info about routing strategy on load balancing docs
 2024-07-25 18:55:51 -07:00