Commit graph

8357 commits

Author SHA1 Message Date
Krish Dholakia
2e66267128 Updated config.yml 2024-03-08 21:47:11 -08:00
Krrish Dholakia
0fb7afe820 feat(proxy_server.py): working /audio/transcription endpoint 2024-03-08 18:20:27 -08:00
Krrish Dholakia
cc0294b2f2 fix(proxy_server.py): fix tagging of endpoints 2024-03-08 14:29:31 -08:00
Krrish Dholakia
8c6d5b7f16 feat(proxy_server.py): supports /audio/transcription endpoint on proxy 2024-03-08 14:28:07 -08:00
Krrish Dholakia
fe125a5131 test(test_whisper.py): add testing for load balancing whisper endpoints on router 2024-03-08 14:19:37 -08:00
Krrish Dholakia
ae54b398d2 feat(router.py): add load balancing for async transcription calls 2024-03-08 13:58:15 -08:00
Krrish Dholakia
6b1049217e feat(azure.py): add support for calling whisper endpoints on azure 2024-03-08 13:48:38 -08:00
Krrish Dholakia
696eb54455 feat(main.py): support openai transcription endpoints
enable user to load balance between openai + azure transcription endpoints
2024-03-08 10:25:19 -08:00
Krrish Dholakia
f8f01e5224 bump: version 1.30.2 → 1.30.3 2024-03-08 08:12:36 -08:00
Krrish Dholakia
2f9a39f30c refactor(main.py): trigger new build 2024-03-08 08:12:22 -08:00
Krrish Dholakia
0e7b30bec9 fix(utils.py): return function name for ollama_chat function calls 2024-03-08 08:01:10 -08:00
ishaan-jaff
b4e12fb8fd (docs) litellm cloud formation stack 2024-03-07 21:01:28 -08:00
ishaan-jaff
4a4d36d923 (feat) bump litellm 2024-03-07 20:45:34 -08:00
Ishaan Jaff
302473eef1
Merge pull request #2391 from BerriAI/litellm_cloudform_stack
(feat) LiteLLM AWS CloudFormation Stack Template
2024-03-07 20:44:46 -08:00
Ishaan Jaff
90d7b61ec2
Merge pull request #2393 from BerriAI/litellm_router_debug_get_dep
[Feat] Load Balancing - View Metrics about selected deployments in server logs
2024-03-07 20:44:18 -08:00
ishaan-jaff
86ac020b12 (fix) show latency per deployment on router debug logs 2024-03-07 18:50:45 -08:00
ishaan-jaff
6f0faca85b (feat) print debug info per deployment 2024-03-07 18:33:09 -08:00
ishaan-jaff
323f15aa2f (fix) litellm cloud formation stack 2024-03-07 18:06:59 -08:00
ishaan-jaff
2f960a9651 (feat) auto-scale 2024-03-07 17:51:12 -08:00
ishaan-jaff
702e46b53d (build) stack with db 2024-03-07 17:50:14 -08:00
ishaan-jaff
da4b150398 (feat) init cloud form stack 2024-03-07 16:49:39 -08:00
Krish Dholakia
dec967f647
Update model_prices_and_context_window.json 2024-03-07 16:31:23 -08:00
Ishaan Jaff
25a24da037
Merge pull request #2390 from BerriAI/litellm_better_debug_prisma_logs
[FIX] Proxy better debug prisma logs
2024-03-07 16:19:26 -08:00
ishaan-jaff
8c3ec15856 (fix) improve improve prisma alerting/debug 2024-03-07 15:44:03 -08:00
Ishaan Jaff
fb791ff0c9
Merge pull request #2387 from DanielChico/feature/issue-2146-fix-discord-publish-workflow
feat: add realease details to discord notification message
2024-03-07 15:34:06 -08:00
ishaan-jaff
5217e800c4 (fix) better prisma debug logs 2024-03-07 14:04:02 -08:00
ishaan-jaff
b64e4c3e6f (feat) better debugging when reading prisma 2024-03-07 13:42:54 -08:00
Ishaan Jaff
1f15c79252
Merge pull request #2388 from BerriAI/litellm_docs_show_how_to_set_lb_config
(docs) setting load balancing config
2024-03-07 12:23:40 -08:00
ishaan-jaff
3baa55210a (docs) setting load balancing config 2024-03-07 12:22:39 -08:00
Daniel Chico
3b86375782 feat: add realease details to discord notification message 2024-03-07 12:26:03 -05:00
Krish Dholakia
bd568d33b0
Merge pull request #2386 from BerriAI/litellm_reintegrate_s3_testing
test: reintegrate s3 testing
2024-03-07 09:16:02 -08:00
Krrish Dholakia
4885bff9e3 test: reintegrate s3 testing 2024-03-07 08:56:59 -08:00
Krrish Dholakia
a89d0db625 test(test_router_caching.py): add more verbose logs 2024-03-07 08:37:00 -08:00
Krrish Dholakia
4508b4ede0 docs(team_based_routing.md): add docs on team based routing 2024-03-07 08:14:46 -08:00
Krrish Dholakia
0d8bed0acf bump: version 1.30.0 → 1.30.1 2024-03-07 07:57:13 -08:00
Krrish Dholakia
dd78a1956a fix(proxy_server.py): fix model alias map + add back testing 2024-03-07 07:56:51 -08:00
Krrish Dholakia
b9854a99d2 test: increase time before checking budget reset - avoid deadlocking 2024-03-06 22:16:59 -08:00
Krrish Dholakia
0273410310 fix(lowest_tpm_rpm.py): handle async scenarios 2024-03-06 21:38:30 -08:00
Krrish Dholakia
ec79482612 fix(utils.py): fix google ai studio timeout error raising 2024-03-06 21:12:04 -08:00
Krrish Dholakia
f79ce63f05 bump: version 1.29.7 → 1.30.0 2024-03-06 21:04:46 -08:00
Krish Dholakia
38612ddd34
Merge pull request #2377 from BerriAI/litellm_team_level_model_groups
feat(proxy_server.py): team based model aliases
2024-03-06 21:03:53 -08:00
Krrish Dholakia
c0c3117dec fix(utils.py): fix get optional param embeddings 2024-03-06 20:47:05 -08:00
ishaan-jaff
2e130fb662 (test) ci/cd run again 2024-03-06 20:40:27 -08:00
ishaan-jaff
0ee02e1ab9 (fix) vertex_ai test_vertex_projects optional params embedding 2024-03-06 20:33:25 -08:00
Krrish Dholakia
be6674f5e0 test(test_completion.py): fix test 2024-03-06 20:13:09 -08:00
Krrish Dholakia
d1d8adfb11 fix(proxy_server.py): fix sql query 2024-03-06 19:41:12 -08:00
Krish Dholakia
06bde2b8c0
Merge pull request #2379 from BerriAI/litellm_s3_bucket_folder_path
fix(caching.py): add s3 path as a top-level param
2024-03-06 19:35:46 -08:00
Krish Dholakia
cb8b30970b
Merge pull request #2347 from BerriAI/litellm_retry_rate_limited_requests
feat(proxy_server.py): retry if virtual key is rate limited
2024-03-06 19:23:11 -08:00
Krrish Dholakia
2163e43b9a test(test_parallel_request_limiter.py): add more verbose logging 2024-03-06 19:21:57 -08:00
Krrish Dholakia
f1aa400d91 test(test_completion.py): temporary patch for wikipedia get image issue 2024-03-06 19:07:38 -08:00