scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-13 23:11:40 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 100
5892 commits 2338 branches 1407 tags 2.6 GiB
Commit graph

5892 commits

This branch
This branch
All branches
Author SHA1 Message Date
Krish Dholakia
749f0b7602
Merge pull request #1531 from BerriAI/litellm_max_parallel_request_invalid_provider_fix 
fix(utils.py): add metadata to logging obj on setup, if exists (fixes max parallel request bug)
 2024-01-19 19:25:34 -08:00
Krrish Dholakia
2c2163e4e5 fix(proxy_server.py): fix key info to handle pydantic v1 2024-01-19 18:52:09 -08:00
Krrish Dholakia
f2a8ceddc2 fix(utils.py): revert exception mapping change 2024-01-19 17:39:35 -08:00
Krrish Dholakia
f05aba1f85 fix(utils.py): add metadata to logging obj on setup, if exists 2024-01-19 17:29:47 -08:00
Krrish Dholakia
1ec5083542 fix(anthropic.py): fix pr for anthropic headers 2024-01-19 17:06:24 -08:00
Krrish Dholakia
1be4f7d2d1 fix(test_key_generate_prisma.py): fix testing 
n
 2024-01-19 16:53:46 -08:00
Ishaan Jaff
6134b655e8
Merge pull request #1513 from costly-ai/main 
Allow overriding headers for anthropic
 2024-01-19 15:21:45 -08:00
ishaan-jaff
6bc7cc46b4 (docs) router debugging 2024-01-19 15:18:00 -08:00
Krrish Dholakia
95d1557785 build(config.yml): fix envrionment variable name 2024-01-19 15:11:18 -08:00
Krrish Dholakia
89391f84eb build(config.yml): add better logs 2024-01-19 15:08:32 -08:00
ishaan-jaff
22daf75a35 bump: version 1.18.5 → 1.18.6 2024-01-19 15:03:30 -08:00
Ishaan Jaff
73684bc93f
Merge pull request #1525 from BerriAI/litellm_router_improvements 
[Feat] Router improvements
 2024-01-19 15:02:05 -08:00
ishaan-jaff
8a4f2c198b (test) test_usage_based_routing 2024-01-19 14:59:56 -08:00
Krrish Dholakia
f5ced089d6 test(tests/): add unit testing for proxy server endpoints 2024-01-19 14:54:29 -08:00
ishaan-jaff
f408162449 (test) debug logs test - router 2024-01-19 14:22:18 -08:00
ishaan-jaff
0196ac6376 (test) router-fallbacks 2024-01-19 14:12:09 -08:00
Ishaan Jaff
b2b41727ce
Merge pull request #1524 from timothyasp/langsmith-project-env-bug-fix 
Langsmith: Add envs for project/run names; fix bug with None metadata
 2024-01-19 14:04:16 -08:00
ishaan-jaff
d0442ae0f2 (feat) router - usage based routing - consider input_tokens 2024-01-19 13:59:49 -08:00
ishaan-jaff
57a20100e4 (test) usage based routing 2024-01-19 13:58:08 -08:00
ishaan-jaff
8c0b7b1015 (feat) - improve router logging/debugging messages 2024-01-19 13:57:33 -08:00
ishaan-jaff
912e2de364 (test) usage based router + fallbacks 2024-01-19 12:34:08 -08:00
ishaan-jaff
7b2c15aa51 (feat) improve litellm.Router logging 2024-01-19 12:28:51 -08:00
Tim Asp
9d6a8b5de3 Cleaner fallback 2024-01-19 11:56:45 -08:00
Ishaan Jaff
650036071f
Merge pull request #1519 from BerriAI/litellm_proxy_make_success_handler_non_blocking 
[Feat] litellm.acompletion() make Langfuse success handler non blocking
 2024-01-19 11:41:00 -08:00
Tim Asp
315fbcd09f update docs 2024-01-19 11:39:39 -08:00
ishaan-jaff
8cf8da1378 (test) langfuse_latency_test_user 2024-01-19 11:38:44 -08:00
ishaan-jaff
cb99cd18e7 (feat) log cache_hit as langfuse tags 2024-01-19 11:38:18 -08:00
Tim Asp
27087e5662 fix error when metadata is none, prevents logging silently 2024-01-19 11:37:45 -08:00
Tim Asp
141d2219e2 Add env for project wide langsmith default project settings 2024-01-19 11:37:15 -08:00
ishaan-jaff
2f429f37b7 (test) test latency added with langfuse call 2024-01-19 11:28:10 -08:00
ishaan-jaff
cb40f58cd3 (fix) return usage in mock_completion 2024-01-19 11:25:47 -08:00
Krrish Dholakia
b03552790f build(config.yml): add aiohttp to circle ci 2024-01-19 10:52:53 -08:00
Krrish Dholakia
7a6b2888c2 build(config.yml): fix path for test folder 2024-01-19 10:49:31 -08:00
Krrish Dholakia
77f8db7050 build(config.yml): fix config.yml 2024-01-19 10:46:24 -08:00
ishaan-jaff
6a695477ba (fix) async langfuse logger 2024-01-19 10:44:51 -08:00
Krrish Dholakia
a0ac815859 build(config.yml): upgrade python version in docker build test 2024-01-19 10:44:39 -08:00
Krrish Dholakia
165bdd2fdf build(config.yml): modify config.yml to use python test script against docker image 2024-01-19 10:39:25 -08:00
Krrish Dholakia
326d7856e2 bump: version 1.18.4 → 1.18.5 2024-01-19 10:23:18 -08:00
Krrish Dholakia
1a29272b47 fix(parallel_request_limiter.py): handle tpm/rpm limits being null 2024-01-19 10:22:27 -08:00
ishaan-jaff
f2cfb76920 (fix) use asyncio run_in_executor 2024-01-19 09:52:51 -08:00
Krrish Dholakia
62e35f6a14 docs(users.md): add tpm rpm rate limits to docs 2024-01-19 08:56:47 -08:00
ishaan-jaff
e6b5152e63 (chore) update load test 2024-01-19 08:52:17 -08:00
ishaan-jaff
cd08a02764 (test) add blocking callback test 2024-01-19 08:51:52 -08:00
ishaan-jaff
a9c5b02303 (v0) fix 2024-01-19 08:51:14 -08:00
Krrish Dholakia
c5e144af23 docs(health.md): add /health/readiness and /health/liveliness to docs 2024-01-19 08:45:23 -08:00
Ishaan Jaff
9aaa2c417d
Merge pull request #1515 from ErikBjare/patch-1 
nit: switch to valid SPDX license identifier `MIT` in pyproject.toml
 2024-01-19 08:03:39 -08:00
Erik Bjäreholt
3eab194014
nit: switch to valid SPDX license identifier MIT in pyproject.toml 
See: https://python-poetry.org/docs/pyproject/#license
 2024-01-19 10:47:29 +01:00
Ishaan Jaff
8fef1a1b69
Merge pull request #1499 from duarteocarmo/patch-2 
Adds s3_path prefix so that we can save objects in predifined location in s3 bucket
 2024-01-18 21:22:15 -08:00
Ishaan Jaff
8338d04d1a
Merge pull request #1506 from HaruHunab1320/main 
add headers to budget manager
 2024-01-18 21:20:45 -08:00
Ishaan Jaff
79e261f533
Merge pull request #1509 from BerriAI/litellm_track_cost_user_id_chat_completions 
[Feat] Proxy - Track Cost Per User (Using `user` passed to requests)
 2024-01-18 20:44:02 -08:00