scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-05 08:07:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 137
9436 commits 4051 branches 1400 tags 4.1 GiB
Commit graph

9436 commits

This branch
This branch
All branches
Author SHA1 Message Date
Krrish Dholakia
2fc7aede12 refactor(main.py): trigger new build 2024-04-02 08:51:18 -07:00
Krrish Dholakia
0d949d71ab fix(main.py): support text completion input being a list of strings 
addresses - https://github.com/BerriAI/litellm/issues/2792, https://github.com/BerriAI/litellm/issues/2777
 2024-04-02 08:50:16 -07:00
Ishaan Jaff
71db88115d bump: version 1.34.19 → 1.34.20 2024-04-01 19:55:07 -07:00
Ishaan Jaff
91269257f2 (docs) openai wildcard models 2024-04-01 19:53:34 -07:00
Ishaan Jaff
92984a1c6f
Merge pull request #2788 from BerriAI/litellm_support_-_models 
[Feat] Allow using model = * on proxy config.yaml
 2024-04-01 19:46:50 -07:00
Ishaan Jaff
98df2b027b test test_wildcard_openai_routing 2024-04-01 19:46:07 -07:00
Krrish Dholakia
6b35436c2a bump: version 1.34.18 → 1.34.19 2024-04-01 19:17:25 -07:00
Krish Dholakia
da85384649
Merge pull request #2787 from BerriAI/litellm_optional_team_jwt_claim 
fix(proxy_server.py): don't require scope for team-based jwt access
 2024-04-01 19:16:39 -07:00
Ishaan Jaff
037b624c89 (fix) allow wildcard models 2024-04-01 19:07:05 -07:00
Ishaan Jaff
aabd7eff1f feat router allow * models 2024-04-01 19:00:24 -07:00
Krrish Dholakia
c52819d47c fix(proxy_server.py): don't require scope for team-based jwt access 
If team with the client_id exists then it should be allowed to make a request, if it doesn't then as we discussed it should return an error
 2024-04-01 18:52:00 -07:00
Ishaan Jaff
b14b6083f5
Merge pull request #2785 from BerriAI/litellm_high_traffic_redis_caching_fixes 
[Feat] Proxy - high traffic redis caching - when using `url`
 2024-04-01 18:38:27 -07:00
Krrish Dholakia
ceabf726b0 fix(main.py): support max retries for transcription calls 2024-04-01 18:37:53 -07:00
Krrish Dholakia
c3e4af76cf refactor: fix linting issue 2024-04-01 18:11:38 -07:00
Krrish Dholakia
ca54b62656 refactor(main.py): trigger new build 2024-04-01 18:03:46 -07:00
Krrish Dholakia
6467dd4e11 fix(tpm_rpm_limiter.py): fix cache init logic 2024-04-01 18:01:38 -07:00
Ishaan Jaff
4ebb4570be (fix) handle urls correctly 2024-04-01 17:08:48 -07:00
Ishaan Jaff
916e4032ee redis show client_list, info 2024-04-01 16:54:42 -07:00
Ishaan Jaff
9accc544e9 add /cache/redis/info endpoint 2024-04-01 16:51:23 -07:00
Krrish Dholakia
9c0aecf9b8 fix(proxy/utils.py): support redis caching for alerting 2024-04-01 16:13:59 -07:00
Krrish Dholakia
cdae08f3c3 docs(openai.md): fix docs to include example of calling openai on proxy 2024-04-01 12:09:22 -07:00
Krish Dholakia
d3e61a0adc
Merge pull request #2783 from BerriAI/litellm_context_window_Fallback_fix 
fix(router.py): fix check for context window fallbacks
 2024-04-01 11:55:49 -07:00
Krrish Dholakia
a917fadf45 docs(routing.md): refactor docs to show how to use pre-call checks and fallback across model groups 2024-04-01 11:21:27 -07:00
Ishaan Jaff
d5d800e141 (fix) _update_end_user_cache 2024-04-01 11:18:00 -07:00
Krrish Dholakia
52b1538b2e fix(router.py): support context window fallbacks for pre-call checks 2024-04-01 10:51:54 -07:00
Krrish Dholakia
f46a9d09a5 fix(router.py): fix check for context window fallbacks 
fallback if list is not none
 2024-04-01 10:41:12 -07:00
Krrish Dholakia
c9e6b05cfb test(test_max_tpm_rpm_limiter.py): add unit testing for redis namespaces working for tpm/rpm limits 2024-04-01 10:39:03 -07:00
Ishaan Jaff
f58436d6a0
Merge pull request #2782 from phact/patch-1 
support cohere_chat in get_api_key
 2024-04-01 10:33:43 -07:00
Sebastián Estévez
e50e76bbd5
support cohere_chat in get_api_key 2024-04-01 13:24:03 -04:00
Ishaan Jaff
53d7b95364 (fix) load testing key used 2024-04-01 08:28:19 -07:00
Ishaan Jaff
bbfd850e12
Merge pull request #2774 from BerriAI/litellm_async_perf 
(fix) improve async perf by 100ms
 2024-04-01 08:12:34 -07:00
Krrish Dholakia
f3e47323b9 test(test_max_tpm_rpm_limiter.py): unit tests for key + team based tpm rpm limits on proxy 2024-04-01 08:11:30 -07:00
Krrish Dholakia
19fc120081 fix(proxy/utils.py): uncomment max parallel request limit check 2024-04-01 08:11:30 -07:00
Krrish Dholakia
1bb4f3ad6d fix(utils.py): set redis_usage_cache to none by default 2024-04-01 08:11:30 -07:00
Krrish Dholakia
2dd5f2bc8c fix(tpm_rpm_limiter.py): enable redis caching for tpm/rpm checks on keys/user/teams 
allows tpm/rpm checks to work across instances

https://github.com/BerriAI/litellm/issues/2730
 2024-04-01 08:11:30 -07:00
Krrish Dholakia
383f12bbd3 test(test_max_tpm_rpm_limiter.py): unit tests for key + team based tpm rpm limits on proxy 2024-04-01 08:00:01 -07:00
Ishaan Jaff
ddb35facc0 ci/cd run again 2024-04-01 07:40:05 -07:00
DaxServer
3f25049dc8 fix(docs): Correct Docker pull command in deploy.md 
Corrected the Docker pull command in deploy.md to remove duplicated 'docker pull' command.
 2024-04-01 07:29:56 -07:00
DaxServer
a2c7455c3d docs: Update references to Ollama repository url 
Updated references to the Ollama repository URL from https://github.com/jmorganca/ollama to https://github.com/ollama/ollama.
 2024-04-01 07:29:56 -07:00
Krrish Dholakia
ea2356fd95 bump: version 1.34.17 → 1.34.18 2024-04-01 07:29:56 -07:00
Krrish Dholakia
5800a5095a refactor(main.py): trigger new build 2024-04-01 07:29:56 -07:00
Krrish Dholakia
a1365f6035 test: cleanup 2024-04-01 07:29:56 -07:00
Krrish Dholakia
d4dd6d0cdc fix(proxy/utils.py): uncomment max parallel request limit check 2024-04-01 07:29:56 -07:00
Krrish Dholakia
aebb0e489c test: fix test 2024-04-01 07:29:56 -07:00
Krrish Dholakia
17cabf013c fix(caching.py): respect redis namespace for all redis get/set requests 2024-04-01 07:29:56 -07:00
Krrish Dholakia
583e334bd2 fix(utils.py): set redis_usage_cache to none by default 2024-04-01 07:29:56 -07:00
Krrish Dholakia
0c77f75ce9 fix(tpm_rpm_limiter.py): enable redis caching for tpm/rpm checks on keys/user/teams 
allows tpm/rpm checks to work across instances

https://github.com/BerriAI/litellm/issues/2730
 2024-04-01 07:29:56 -07:00
Krrish Dholakia
ea76c546ff docs(deploy.md): fix docs for litlelm-database docker run example 2024-04-01 07:29:56 -07:00
Ishaan Jaff
15b5cb1612 (fix) check size of data to predict 2024-04-01 07:29:56 -07:00
Ishaan Jaff
e62e83c42a (ui) dont let prediction block spend view 2024-04-01 07:29:56 -07:00