Krrish Dholakia
c96ca1f85e
fix(router.py): improve debug logsd
2024-04-20 13:12:12 -07:00
Krrish Dholakia
0f69f0b44e
test(test_router_max_parallel_requests.py): more extensive testing for setting max parallel requests
2024-04-20 12:56:54 -07:00
Krrish Dholakia
7aa737cf10
fix(router.py): add if router caching setup on info logs
2024-04-20 12:34:09 -07:00
Krrish Dholakia
e56dc2817b
test(test_router_max_parallel_requests.py): add unit tests for different scenarios
2024-04-20 12:29:38 -07:00
Krrish Dholakia
26579303e0
fix(main.py): ignore max_parallel_requests as a litellm param
2024-04-20 12:15:04 -07:00
Krrish Dholakia
1507b23e30
test(test_openai_endpoints.py): make test stricter
2024-04-20 12:11:54 -07:00
Krrish Dholakia
47e9d5f2ec
fix(router.py): fix init line for self.default_max_parallel_requests
2024-04-20 12:08:21 -07:00
Krrish Dholakia
4c78f8f309
fix(router.py): calculate max_parallel_requests from given tpm limits
...
use the azure formula to calculate rpm -> max_parallel_requests based on a deployment's tpm limits
2024-04-20 10:43:18 -07:00
Krrish Dholakia
0ce2fb83b0
docs(hosted.md): add hosted proxy pricing info to docs
2024-04-20 09:40:47 -07:00
Krrish Dholakia
3ce73fce23
docs(hosted.md): add hosted proxy info to docs
2024-04-20 09:30:28 -07:00
Krrish Dholakia
5d8af892c7
build(interpret_load_test.py): fix update release body text
2024-04-20 08:54:00 -07:00
Krrish Dholakia
8963a507f7
docs(quick_start.md): add disclaimer
2024-04-20 08:49:14 -07:00
Krrish Dholakia
2afdf34a9f
docs(quick_start.md): add example of using proxy with litellm sdk
2024-04-20 08:49:14 -07:00
Ishaan Jaff
200f58c1e7
(fix) missing PIL import
2024-04-20 08:27:00 -07:00
Krrish Dholakia
ad05cce8b7
docs(prod.md): update prod docs with new redis recommendations
2024-04-19 23:57:36 -07:00
Ishaan Jaff
afeb1941ce
bump: version 1.35.16 → 1.35.17
2024-04-19 21:24:28 -07:00
Ishaan Jaff
96200cbb11
Merge pull request #3186 from BerriAI/litellm_fix_gemini_pro_latest_bug
...
[Fix] completion(model="gemini/gemini-pro-1.5-latest" raises Exception
2024-04-19 21:23:11 -07:00
Ishaan Jaff
81e4d59357
test - gemini-1.5-pro-latest
2024-04-19 21:22:19 -07:00
Ishaan Jaff
63805873e7
fix - supports_vision should not raise Exception
2024-04-19 21:19:07 -07:00
Krrish Dholakia
fa14d3c8dc
test: remove duplicate test file
2024-04-19 19:56:36 -07:00
Krrish Dholakia
5811d21094
test(test_amazing_vertex_completion.py): fix gemini tool calling test
2024-04-19 19:39:38 -07:00
Krrish Dholakia
e5b98814ad
test(test_proxy_server.py): fix test to use valid redis host
2024-04-19 19:22:24 -07:00
Krish Dholakia
9f21f87afd
Merge pull request #3173 from BerriAI/litellm_ssl_caching_fix
...
fix(caching.py): fix redis url parsing logic to work with ssl urls
2024-04-19 17:20:32 -07:00
Krish Dholakia
6d9f0f1839
Merge branch 'main' into litellm_ssl_caching_fix
2024-04-19 17:20:27 -07:00
Krrish Dholakia
432e81335b
bump: version 1.35.15 → 1.35.16
2024-04-19 17:03:27 -07:00
Krish Dholakia
cc7f27252b
Merge pull request #3179 from BerriAI/litellm_dual_caching_fix
...
fix(caching.py): dual cache async_batch_get_cache fix + testing
2024-04-19 17:02:47 -07:00
Krrish Dholakia
978c1a1976
test(test_caching.py): add sleep
2024-04-19 17:02:15 -07:00
Krrish Dholakia
a9f3fd4030
test(test_function_calling.py): remove flaky groq test
2024-04-19 16:41:23 -07:00
Krrish Dholakia
62aab91186
test(test_prometheus_service.py): remove duplicate test
2024-04-19 16:23:47 -07:00
Ishaan Jaff
63632c907f
Merge pull request #3183 from BerriAI/langfuse_log_proxy_base_url
...
[Fix] - Langfuse log proxy_base_url to langfuse as a tag (if set by user)
2024-04-19 16:21:29 -07:00
Krrish Dholakia
41c81f6335
fix: fix tests
2024-04-19 16:21:15 -07:00
Ishaan Jaff
788394b1ec
fix - logging proxy base url to langfuse
2024-04-19 16:20:46 -07:00
Krrish Dholakia
0d9c96bebf
test(test_prometheus_services.py): fix testing to handle caching ping in init
2024-04-19 16:15:29 -07:00
Ishaan Jaff
def5ce4888
fix user needs to opt in to langfuse tags
2024-04-19 16:13:14 -07:00
Ishaan Jaff
c59051895b
fix - allow users to opt into langfuse default tags
2024-04-19 16:05:31 -07:00
Ishaan Jaff
2c76448756
fix - allow users to opt into langfuse default tags
2024-04-19 16:01:27 -07:00
Ishaan Jaff
c0befe9bbb
feat - log base_url to langfuse as a tag
2024-04-19 15:48:00 -07:00
Krrish Dholakia
62a8bf134f
fix(http_handler.py): fix linting error
2024-04-19 15:45:24 -07:00
Krish Dholakia
dc932ac518
Merge pull request #3174 from jmandel/fix-claude-streaming
...
fix: Stream completion responses from anthropic. (Fix #3129 )
2024-04-19 15:37:29 -07:00
Ishaan Jaff
48e5de4f0e
Merge pull request #3175 from BerriAI/litellm_log_team_alias_langfuse
...
[FEAT] Log team alias to langfuse
2024-04-19 15:30:59 -07:00
Ishaan Jaff
c7b0d59bdc
Merge pull request #3180 from BerriAI/ui_create_user_flow
...
[UI] Show teams as dropdown in invite user flow
2024-04-19 15:27:27 -07:00
Krrish Dholakia
84685b5f34
fix(_redis.py): fix args passed to redis.from_url argument
2024-04-19 15:27:11 -07:00
Ishaan Jaff
5613f9b30a
UI - invite user flow
2024-04-19 15:26:29 -07:00
Ishaan Jaff
5d9f6282ce
create_user using user_email
2024-04-19 15:17:50 -07:00
Ishaan Jaff
559a312c9c
ui - show teams as dropdown in create user flow
2024-04-19 15:07:13 -07:00
Krrish Dholakia
01a1a8f731
fix(caching.py): dual cache async_batch_get_cache fix + testing
...
this fixes a bug in usage-based-routing-v2 which was caused b/c of how the result was being returned from dual cache async_batch_get_cache. it also adds unit testing for that function (and it's sync equivalent)
2024-04-19 15:03:25 -07:00
Ishaan Jaff
3167c9da9f
fix - use user_api_key_team_alias as the default tag on langfuse
2024-04-19 14:43:41 -07:00
Ishaan Jaff
f220a337bd
Merge pull request #3176 from BerriAI/add_llama3_groq
...
[FEAT] Add `groq/llama3`
2024-04-19 14:40:10 -07:00
Ishaan Jaff
e8de984b38
docs - add groq llama3
2024-04-19 14:34:45 -07:00
Ishaan Jaff
12bf4346ec
feat - add llama3 on groq
2024-04-19 14:34:38 -07:00
