Commit graph

9933 commits

Author SHA1 Message Date
Mikkel Gravgaard
e2213a1a5e
Use DEBUG level for curl command logging
Currently, the INFO level is used, which can cause excessive logging in production.
2024-04-12 11:27:53 +02:00
Krrish Dholakia
775d28a509 docs(token_auth.md): update docs to show org spend tracking 2024-04-11 23:34:34 -07:00
Krish Dholakia
a1cb9a51b9
Merge pull request #2978 from BerriAI/litellm_org_spend_tracking
fix(proxy_server.py): support tracking org spend
2024-04-11 23:19:33 -07:00
Krrish Dholakia
c480b5a008 bump: version 1.35.1 → 1.35.2 2024-04-11 23:16:39 -07:00
Krrish Dholakia
7a3821e0f6 fix(gemini.py): log system prompt in verbose output 2024-04-11 23:15:58 -07:00
Krrish Dholakia
77d6b882b8 fix(vertex_ai.py): check if 'response_mime_type' in generation config before passing it in 2024-04-11 23:10:59 -07:00
Krrish Dholakia
c377ba0755 fix(utils.py): vertex ai exception mapping
fixes check which caused all vertex errors to be ratelimit errors
2024-04-11 23:04:21 -07:00
Krrish Dholakia
f4c7f4f901 fix(proxy_server.py): support tracking org spend
currently works when org set for jwt auth
2024-04-11 23:01:21 -07:00
Krish Dholakia
d89644d46c
Merge pull request #2970 from BerriAI/litellm_keys
fix(handle_jwt.py): User cost tracking via JWT Auth
2024-04-11 21:44:15 -07:00
Krrish Dholakia
3665b890f8 build(proxy_server_config.yaml): cleanup config 2024-04-11 20:20:09 -07:00
Krrish Dholakia
77097f8e7d test(test_jwt.py): add testing to make sure user api key auth returns the expected values 2024-04-11 20:18:55 -07:00
Krrish Dholakia
67b5634417 fix(auth_checks.py): raise error if user doesn't exist in db 2024-04-11 19:55:04 -07:00
Krrish Dholakia
36ff593c02 feat(proxy_server.py): support cost tracking on user id via JWT-Auth
allows admin to track cost for LiteLLM_UserTable via JWT
2024-04-11 18:47:46 -07:00
Ishaan Jaff
8ba140b09e
Merge pull request #2965 from BerriAI/litellm_fix_key_update
fix - delete key from inMemory Cache after /key/update
2024-04-11 18:18:05 -07:00
Krrish Dholakia
e413191493 fix(handle_jwt.py): support firebase public key format
adds support for when the public keys are a json instead of nested inside a json
2024-04-11 18:07:13 -07:00
Krish Dholakia
cd834e9d52
Merge pull request #2964 from Manouchehri/gemini-json-mode-2962
Add JSON mode to Gemini (Vertex AI)
2024-04-11 17:51:27 -07:00
Krrish Dholakia
3b803b09d9 fix(langfuse.py): remove print statements 2024-04-11 17:23:41 -07:00
Ishaan Jaff
beabec620e fix - delete updated keys from cache 2024-04-11 17:21:44 -07:00
Krrish Dholakia
bdfb74f8a5 test(test_openai_endpoints.py): add local test, for proxy concurrency 2024-04-11 17:16:23 -07:00
David Manouchehri
9c55be3e82
(feat) - Bump version for Vertex AI SDK. 2024-04-12 00:03:32 +00:00
David Manouchehri
05350037be
(feat) - Extreme dirty hack for response_mime_type in Vertex AI. 2024-04-12 00:03:31 +00:00
David Manouchehri
d08674bf2f
(feat) - Dirty hack to get response_mime_type working before it's released in the Python SDK. 2024-04-12 00:03:30 +00:00
David Manouchehri
649c3bb0dd
(feat) - Add support for JSON mode in Vertex AI 2024-04-12 00:03:29 +00:00
Ishaan Jaff
6e934cb842 docs fix team based routing 2024-04-11 15:23:25 -07:00
Ishaan Jaff
68e0c93246 fix - better debugging for adding new models 2024-04-11 14:49:00 -07:00
Ishaan Jaff
79451242c8
Merge pull request #2892 from gregnwosu/patch-1
created defaults for response["eval_count"]
2024-04-11 13:40:32 -07:00
Ishaan Jaff
f103f395b5
Merge pull request #2959 from BerriAI/litellm_fix_issue_adding_models_ui
fix - issue when loading models through ui
2024-04-11 13:07:58 -07:00
Ishaan Jaff
fc832f2196 fix - issue when loading models through ui 2024-04-11 13:06:10 -07:00
Ishaan Jaff
b773133160
Merge pull request #2958 from BerriAI/litellm_ui_add_fallback/_ogin
Litellm UI add fallback-login
2024-04-11 11:49:40 -07:00
Ishaan Jaff
5f95260cf5 ui - show fallback login 2024-04-11 11:48:40 -07:00
Ishaan Jaff
f2467ba4e3 fix - show correct fallback login 2024-04-11 11:48:03 -07:00
Ishaan Jaff
0b964ea7ff fix - point to fallback login 2024-04-11 11:41:44 -07:00
Ishaan Jaff
7cb40d3b35 UI - add /fallback/login route 2024-04-11 11:20:41 -07:00
Ishaan Jaff
64904e2ab1
Merge pull request #2956 from BerriAI/litellm_fix_imghdr
fix - stop using imghdr
2024-04-11 09:55:47 -07:00
Ishaan Jaff
9465288e9e migration script 2024-04-11 09:55:14 -07:00
Ishaan Jaff
fb657423ee fix - stop using imghdr 2024-04-11 09:32:42 -07:00
Krrish Dholakia
c597d610f3 bump: version 1.35.0 → 1.35.1 2024-04-11 09:28:26 -07:00
Krrish Dholakia
84d43484c6 fix(router.py): make sure pre call rpm check runs even when model not in model cost map 2024-04-11 09:27:46 -07:00
Ishaan Jaff
240aaf7af8 fix - show api_base in migration script 2024-04-11 09:26:13 -07:00
Ishaan Jaff
69c095b768
Merge pull request #2953 from BerriAI/litellm_fix_sec_issue
[security fix - Low Severity] - disable demo accounts
2024-04-11 08:07:24 -07:00
Ishaan Jaff
96cd038a73 security fix - disable demo accounts 2024-04-11 07:40:34 -07:00
Ishaan Jaff
1c1b0f929f fix - migration script for /model/new 2024-04-11 07:34:00 -07:00
Krish Dholakia
78571babb3
Merge pull request #2830 from onukura/onukura-patch-1
Update README.md
2024-04-11 06:47:53 -07:00
Krrish Dholakia
d999acd20d docs(routing.md): reorder routing strategies 2024-04-10 22:29:24 -07:00
Krrish Dholakia
83a7a9f0b7 docs(routing.md): add calling via proxy tutorial to router docs 2024-04-10 22:24:29 -07:00
Krish Dholakia
6749306239
Merge pull request #2945 from ushuz/hotfix
Fix image generation pre call hook call type
2024-04-10 21:53:00 -07:00
Krrish Dholakia
9f517b2907 docs(routing.md): add async usage based routing to docs 2024-04-10 21:51:36 -07:00
Krrish Dholakia
b8bd7bde1e bump: version 1.34.42 → 1.35.0 2024-04-10 21:45:44 -07:00
Krrish Dholakia
623613203a refactor(main.py): trigger new build
contains fixes for async batch get
2024-04-10 21:45:06 -07:00
Krrish Dholakia
76bd667b12 fix(caching.py): fix async batch redis get request 2024-04-10 21:37:45 -07:00