Commit graph

13198 commits

Author SHA1 Message Date
Krish Dholakia
3ef5d40b73
Merge pull request #4205 from BerriAI/litellm_alerting_metadata
fix(slack_alerting.py): allow new 'alerting_metadata' arg
2024-06-14 19:04:30 -07:00
Krrish Dholakia
4eca63ede6 docs(alerting.md): add alerting metadata to docs 2024-06-14 19:04:16 -07:00
Krish Dholakia
28a52fe5fb
Merge pull request #4207 from BerriAI/litellm_content_policy_fallbacks
feat(router.py): support content policy fallbacks
2024-06-14 18:55:11 -07:00
Ishaan Jaff
4baf72b34e
Merge pull request #4203 from BerriAI/litellm_fix_bug_tem_budget
[Bug fix] Don't cache team, user, customer budget after calling /update, /delete
2024-06-14 18:36:41 -07:00
Krrish Dholakia
6f715b4782 feat(router.py): support content policy fallbacks
Closes https://github.com/BerriAI/litellm/issues/2632
2024-06-14 17:15:44 -07:00
Krrish Dholakia
9e8eacbc77 test(test_alerting.py): fix tests 2024-06-14 16:20:54 -07:00
Krrish Dholakia
e18002023a fix(slack_alerting.py): allow new 'alerting_metadata' arg
Allows user to pass in additional alerting metadata for debugging
2024-06-14 16:06:47 -07:00
Ishaan Jaff
6bd7e24fdd fix - team budget exceeded 2024-06-14 15:54:14 -07:00
Ishaan Jaff
14f7ca899a
Merge pull request #4197 from BerriAI/litellm_fix_router_level_alerting
[Fix + Refactor] - Router Alerting for llm exceptions  + use separate util for sending alert
2024-06-14 15:52:31 -07:00
Ishaan Jaff
f398498d53
Merge pull request #4198 from BerriAI/litellm_ui_fix_team_usage_crashing
ui - fix team based usage crashing
2024-06-14 15:18:28 -07:00
Ishaan Jaff
2d2650a2b6 fix use safe access for router alerting 2024-06-14 15:17:32 -07:00
Krrish Dholakia
0404d30a9c fix(main.py): include traceback in error string 2024-06-14 15:15:53 -07:00
Krrish Dholakia
2732ff5d56 fix(utils.py): return traceback on unmapped exception error
Fixes https://github.com/BerriAI/litellm/issues/4201
2024-06-14 15:08:01 -07:00
Krrish Dholakia
ab3ece37c0 docs(users.md): update user docs to show reset budget 2024-06-14 14:46:23 -07:00
Krrish Dholakia
d8acda9f39 fix(proxy/utils.py): fix reset monthly budget
fix to reset at the same time each month (not at start of month)
2024-06-14 14:41:06 -07:00
Ishaan Jaff
e736e4952e ui - fix team based usage crashing 2024-06-14 10:21:06 -07:00
Ishaan Jaff
bd5d1be1f6 feat - send llm exception alert on acompletion, aembedding etc 2024-06-14 10:11:24 -07:00
Ishaan Jaff
63ddc3d012 test_alerting 2024-06-14 08:45:04 -07:00
Ishaan Jaff
a0ecc6f414 fix - send alert on router level exceptions 2024-06-14 08:41:12 -07:00
Krish Dholakia
056913fd70
Merge pull request #3559 from Intellegam/main
Langfuse integration support for `parent_observation_id` parameter
2024-06-14 06:55:45 -07:00
Krrish Dholakia
57d3b591ba bump: version 1.40.12 → 1.40.13 2024-06-13 22:07:46 -07:00
Krish Dholakia
dfe3b4ed6f
Merge pull request #4150 from BerriAI/litellm_redis_cache_usage
fix(parallel_request_limiter.py): rate limit keys across instances
2024-06-13 22:07:29 -07:00
Krish Dholakia
e61cd2e1e2
Merge branch 'main' into litellm_redis_cache_usage 2024-06-13 22:07:21 -07:00
Krrish Dholakia
c4df6cfe15 test(test_spend_logs.py): fix test 2024-06-13 21:32:26 -07:00
Krish Dholakia
d499477f54
Merge pull request #4178 from BerriAI/litellm_http_handler
Retry on connection disconnect
2024-06-13 21:14:56 -07:00
Krrish Dholakia
64f50c08da docs(team_budgets.md): fix docs 2024-06-13 21:13:29 -07:00
Krrish Dholakia
7117e567b7 bump: version 1.40.11 → 1.40.12 2024-06-13 21:13:29 -07:00
Krrish Dholakia
acdd8f16ea build(ui): new build 2024-06-13 21:13:29 -07:00
Krrish Dholakia
8498600d42 feat(proxy/utils.py): allow budget duration in months
Closes https://github.com/BerriAI/litellm/issues/4042
2024-06-13 21:13:29 -07:00
lucca
17556cf327 llama 3 2024-06-13 21:13:29 -07:00
Ishaan Jaff
80aa492f19 doc fix creating team budgets 2024-06-13 21:13:29 -07:00
Ishaan Jaff
bf04085f3c bump: version 1.40.10 → 1.40.11 2024-06-13 21:13:29 -07:00
Ishaan Jaff
39c0f29163 fix - update team 2024-06-13 21:13:29 -07:00
Ishaan Jaff
17b8a31f0e update swagger for /team endpoints 2024-06-13 21:13:29 -07:00
Ishaan Jaff
ecdb8178f7 doc - setting team budgets 2024-06-13 21:13:29 -07:00
Ishaan Jaff
397a3d8556 doc - team based budgets 2024-06-13 21:13:29 -07:00
Ishaan Jaff
62ff15fe6c fix /team/update 2024-06-13 21:13:29 -07:00
Ishaan Jaff
9598209bd7 doc - setting team budgets 2024-06-13 21:13:29 -07:00
Krrish Dholakia
b37e471018 feat(__init__.py): allow setting drop_params as an env
Closes https://github.com/BerriAI/litellm/issues/4175
2024-06-13 21:13:29 -07:00
Krrish Dholakia
1450a77922 build: allow resetting customer budget weekly + edit customer budget panel 2024-06-13 21:13:29 -07:00
Krrish Dholakia
86d64c3447 build(ui/teams.tsx): allow resetting teams budget 2024-06-13 21:13:29 -07:00
Ishaan Jaff
f6d386509f fix - ui show correct team budget when budget = 0.0 2024-06-13 21:13:29 -07:00
Ishaan Jaff
6d44c56e41 fix bug when updating team 2024-06-13 21:13:29 -07:00
Ishaan Jaff
0f94133285 docs - budget metrics litellm 2024-06-13 21:13:29 -07:00
Ishaan Jaff
8b7b2eec6b feat - add remaining budget for key on prometheus 2024-06-13 21:13:29 -07:00
Ishaan Jaff
330df10907 feat - add remaining team budget gauge 2024-06-13 21:13:29 -07:00
Ishaan Jaff
1a9ab1d66a fix - clean up swagger spend endpoints 2024-06-13 21:13:29 -07:00
David Manouchehri
ddb60edb74 fix(caching.py): Stop throwing constant spam errors on every single S3 cache miss. Fixes #4146. 2024-06-13 21:13:29 -07:00
Krrish Dholakia
4408c7889b docs(alerting.md): add expected response teams alerting image to docs 2024-06-13 21:13:29 -07:00
Krrish Dholakia
ec027b70d7 docs(alerting.md): add microsoft teams alerting to docs 2024-06-13 21:13:29 -07:00