scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-16 23:41:43 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 102
17402 commits 2457 branches 1410 tags 2.9 GiB
Commit graph

17402 commits

This branch
This branch
All branches
Author SHA1 Message Date
Ishaan Jaff
30eb740137 use requirements txt 2024-09-05 18:20:13 -07:00
Ishaan Jaff
2ca91c2156 run ci/cd agaiin 2024-09-05 18:20:13 -07:00
Ishaan Jaff
14d737de14 move folder key gen prisma is in 2024-09-05 18:20:13 -07:00
Ishaan Jaff
c535099fe0 run test again 2024-09-05 18:20:13 -07:00
Ishaan Jaff
34839ae7cc run again 2024-09-05 18:20:13 -07:00
Ishaan Jaff
dac4908c1f add step for ui testing 2024-09-05 18:20:13 -07:00
Ishaan Jaff
96573d93a3 add test for ui usage endpoints 2024-09-05 18:20:13 -07:00
Ishaan Jaff
1a74f50e2c add test for internal vs admin user 2024-09-05 18:20:13 -07:00
Ishaan Jaff
b75581452a fix tests on viewing spend logs 2024-09-05 18:20:13 -07:00
Ishaan Jaff
3e5485ca77 add ui testing folder 2024-09-05 18:20:13 -07:00
Ishaan Jaff
b590d807af fix test_call_with_key_over_budget 2024-09-05 18:20:13 -07:00
Ishaan Jaff
1725260938 ui add a check for isAdminOrAdminViewer 2024-09-05 18:20:13 -07:00
Ishaan Jaff
a1ca3329d2 fix allow internal user to view their own usage 2024-09-05 18:20:13 -07:00
Ishaan Jaff
bbcc26a91e fix /global/spend/provider 2024-09-05 18:20:13 -07:00
Ishaan Jaff
72f9c92a13 add global/spend/provider 2024-09-05 18:20:13 -07:00
Ishaan Jaff
4e5d4c1583 allow internal user to view global/spend/models 2024-09-05 18:20:13 -07:00
Ishaan Jaff
372fcb6e4c allow internal user to view their own spend 2024-09-05 18:20:13 -07:00
Ishaan Jaff
b3ca358c39 add usage endpoints for internal user 2024-09-05 18:20:13 -07:00
Ishaan Jaff
0fc7d81bf4 show /spend/logs for internal users 2024-09-05 18:20:13 -07:00
Ishaan Jaff
191dfc7e11 fix create view - MonthlyGlobalSpendPerUserPerKey 2024-09-05 18:20:13 -07:00
Ishaan Jaff
29c86ebf02 use helper functions per endpoint 2024-09-05 18:20:13 -07:00
Ishaan Jaff
9afa39630c add /spend/tags as allowed route for internal user 2024-09-05 18:20:13 -07:00
Ishaan Jaff
16a9f41682 fix allow internal user and internal viewer to view usage 2024-09-05 18:20:13 -07:00
Ishaan Jaff
795db8672a fix log /audio to langfuse 2024-09-05 16:26:37 -07:00
Ishaan Jaff
53794f773e fix typing error on test 2024-09-05 15:48:41 -07:00
Ishaan Jaff
b27ef1ca5b run ci/cd on main 2024-09-05 15:48:41 -07:00
Ishaan Jaff
0426aa5642 run test again 2024-09-05 15:26:48 -07:00
Krrish Dholakia
c154c5e230 docs(configs.md): update to clarify you can use os.environ/ for any config value 2024-09-05 15:19:12 -07:00
Ishaan Jaff
a30917311e fix import 2024-09-05 14:42:56 -07:00
Krrish Dholakia
8ca7c2c9af test(test_function_call_parsing.py): handle anthropic internal server error 2024-09-05 14:37:53 -07:00
OrangeWolf
542b333c95 Update utils.py (#5530) 
fix KeyError (cause by typo?)
 2024-09-05 14:37:53 -07:00
Ishaan Jaff
936e486c95 fix import 2024-09-05 12:40:45 -07:00
Ishaan Jaff
219fa492dc fix import 2024-09-05 10:41:13 -07:00
Ishaan Jaff
e9cb1e0853 fix import error 2024-09-05 10:27:35 -07:00
Ishaan Jaff
e1c989ad3d fix import error 2024-09-05 10:19:10 -07:00
Ishaan Jaff
25887c1846 fix import error 2024-09-05 10:09:44 -07:00
Ishaan Jaff
ed627bc5d2 fix linting error 2024-09-05 09:56:33 -07:00
Ishaan Jaff
81ee1653af use correct type hints for audio transcriptions 2024-09-05 09:12:27 -07:00
Krrish Dholakia
a9be7dd79b docs(pass_through/bedrock.md): add bedrock agents support 2024-09-04 22:30:14 -07:00
Krrish Dholakia
3709a0565e bump: version 1.44.17 → 1.44.18 2024-09-04 22:22:40 -07:00
Krish Dholakia
ca37bb9de5
fix(pass_through_endpoints): support bedrock agents via pass through (#5527) 2024-09-04 22:22:22 -07:00
Krish Dholakia
1e7e538261
LiteLLM Minor fixes + improvements (08/04/2024) (#5505) 
* Minor IAM AWS OIDC Improvements (#5246)

* AWS IAM: Temporary tokens are valid across all regions after being issued, so it is wasteful to request one for each region.

* AWS IAM: Include an inline policy, to help reduce misuse of overly permissive IAM roles.

* (test_bedrock_completion.py): Ensure we are testing cross AWS region OIDC flow.

* fix(router.py): log rejected requests

Fixes https://github.com/BerriAI/litellm/issues/5498

* refactor: don't use verbose_logger.exception, if exception is raised

User might already have handling for this. But alerting systems in prod will raise this as an unhandled error.

* fix(datadog.py): support setting datadog source as an env var

Fixes https://github.com/BerriAI/litellm/issues/5508

* docs(logging.md): add dd_source to datadog docs

* fix(proxy_server.py): expose `/customer/list` endpoint for showing all customers

* (bedrock): Fix usage with Cloudflare AI Gateway, and proxies in general. (#5509)

* feat(anthropic.py): support 'cache_control' param for content when it is a string

* Revert "(bedrock): Fix usage with Cloudflare AI Gateway, and proxies in gener…" (#5519)

This reverts commit 3fac0349c2.

* refactor: ci/cd run again

---------

Co-authored-by: David Manouchehri <david.manouchehri@ai.moda>
 2024-09-04 22:16:55 -07:00
Ishaan Jaff
cdc312d51d mark test_team_logging as flaky 2024-09-04 20:29:21 -07:00
Ishaan Jaff
20a5bbe6a6 fix allow general guardrails on free tier 2024-09-04 19:59:32 -07:00
Ishaan Jaff
f5de7516cc bump: version 1.44.16 → 1.44.17 2024-09-04 19:46:51 -07:00
Ishaan Jaff
5c1c0134b6
Merge pull request #5521 from BerriAI/litellm_health_checks 
[Fix-Proxy] show more descriptive error messages on /health checks
 2024-09-04 19:42:10 -07:00
Ishaan Jaff
7d0ea3d028
Merge pull request #5518 from BerriAI/litellm_log_request_response 
[Feat] log request / response on pass through endpoints
 2024-09-04 17:57:47 -07:00
Ishaan Jaff
3600b1a229
Merge pull request #5520 from BerriAI/litellm_spend_logs_trace 
[Fix - Proxy] show error from /spend/tags and /spend/logs on client side
 2024-09-04 17:57:33 -07:00
Ishaan Jaff
f725c3a68f fix /health error 2024-09-04 17:43:15 -07:00
Ishaan Jaff
34cb748c69 show more descriptive error messages on /health checks 2024-09-04 17:35:16 -07:00