scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-19 00:01:29 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 88
8919 commits 2519 branches 1411 tags 3.1 GiB
Commit graph

8919 commits

This branch
This branch
All branches
Author SHA1 Message Date
Roni Gurvich
dcb1e06402
Update pyproject.toml 
fastapi upgrade from 0.104.1 to 0.109.1
 2024-03-21 14:22:29 +02:00
Ishaan Jaff
8363bd4e7e
Merge pull request #2613 from BerriAI/litellm_fix_quick_start_docker 
(docs) Litellm fix quick start docker
 2024-03-20 21:34:19 -07:00
Ishaan Jaff
354d13c7e1 (docs) fix litellm docker quick start 2024-03-20 21:34:01 -07:00
Ishaan Jaff
3612e47d6b (fix) clean up quick start 2024-03-20 21:24:42 -07:00
Ishaan Jaff
28db804917
Merge pull request #2612 from BerriAI/litellm_update_vertex_ai_docs 
(docs) add example using vertex ai on litellm proxy
 2024-03-20 21:20:09 -07:00
Ishaan Jaff
ee1a0a9409 (docs) add example using openai compatib model 2024-03-20 21:15:50 -07:00
Ishaan Jaff
f7945a945b (docs) add example using vertex ai on litellm proxy 2024-03-20 21:07:55 -07:00
Krish Dholakia
007d439017
Merge pull request #2606 from BerriAI/litellm_jwt_auth_updates 
fix(handle_jwt.py): track spend for user using jwt auth
 2024-03-20 19:40:17 -07:00
Krish Dholakia
cb23f2efa4
Merge pull request #2611 from BerriAI/litellm_prompt_injection_heuristics_fix 
Ensure prompt injection attack 'known phrases' are >= 3 words
 2024-03-20 19:39:14 -07:00
Krrish Dholakia
f24d3ffdb6 fix(proxy_server.py): fix import 2024-03-20 19:15:06 -07:00
Krrish Dholakia
3bb0e24cb7 fix(prompt_injection_detection.py): ensure combinations are actual phrases, not just 1-2 words 
reduces misflagging

https://github.com/BerriAI/litellm/issues/2601
 2024-03-20 19:09:38 -07:00
Krrish Dholakia
8bb00c4ae8 fix(caching.py): enable async setting of cache for dual cache 2024-03-20 18:42:34 -07:00
Ishaan Jaff
285084e4be bump: version 1.32.8 → 1.32.9 2024-03-20 17:05:00 -07:00
Ishaan Jaff
7654400a10
Merge pull request #2609 from BerriAI/litellm_docs_using_cache_ping 
[docs] using /cache/ping
 2024-03-20 17:04:38 -07:00
Ishaan Jaff
5842486810 (docs) using /cache/ping 2024-03-20 17:03:26 -07:00
Ishaan Jaff
1d63e05e6c bump: version 1.32.7 → 1.32.8 2024-03-20 16:54:23 -07:00
Ishaan Jaff
8aba161821
Merge pull request #2605 from BerriAI/litellm_fix_num_workers_issue 
(fix) start proxy with default num_workers=1
 2024-03-20 16:44:06 -07:00
Ishaan Jaff
c068a5fb74 (docs) deploying litellm 2024-03-20 11:47:55 -07:00
Krrish Dholakia
90e17b5422 fix(handle_jwt.py): track spend for user using jwt auth 2024-03-20 10:55:52 -07:00
Ishaan Jaff
3ad6e5ffc1 (feat) start proxy with default num_workers=1 2024-03-20 10:46:32 -07:00
Ishaan Jaff
cace0bd6fb (fix) self.redis_version issue 2024-03-20 10:36:08 -07:00
Ishaan Jaff
7b29273b14 (fix) redis 6.2 version incompatibility issue 2024-03-20 09:38:21 -07:00
Krrish Dholakia
ca970a90c4 fix(handle_jwt.py): remove issuer check 2024-03-20 08:35:23 -07:00
Ishaan Jaff
909883ee04
Merge pull request #2602 from BerriAI/litellm_cache_ping 
(feat) litellm proxy /cache/ping
 2024-03-20 08:32:14 -07:00
Ishaan Jaff
4ed551dc52 (feat) better debugging for /cache/ping 2024-03-20 08:30:11 -07:00
Ishaan Jaff
2256ece5a9 (feat) litellm cache ping 2024-03-20 08:24:13 -07:00
Krrish Dholakia
88733fda5d docs(prompt_injection.md): open sourcing prompt injection detection 2024-03-19 22:48:52 -07:00
Krrish Dholakia
524c244dd9 fix(utils.py): support response_format param for ollama 
https://github.com/BerriAI/litellm/issues/2580
 2024-03-19 21:07:20 -07:00
Krrish Dholakia
d6624bf6c3 refactor(main.py): trigger new build 2024-03-19 21:05:53 -07:00
Krish Dholakia
f6bab298a0 Updated config.yml 2024-03-19 21:04:38 -07:00
Ishaan Jaff
8f750b71eb (fix) caching - don't require cache password 2024-03-19 20:50:16 -07:00
Krrish Dholakia
dff4d6363a bump: version 1.32.6 → 1.32.7 2024-03-19 20:42:38 -07:00
Krrish Dholakia
066346b8c8 test: handle flaky tests locally - causing db timeout issues on circle ci 2024-03-19 20:39:53 -07:00
Krrish Dholakia
f25b03326b fix(proxy_server.py): allow user to disable scheduled reset budget task 2024-03-19 20:36:22 -07:00
Krrish Dholakia
2dfdc8dd69 Revert "Merge pull request #2593 from BerriAI/litellm_reset_budget_fix" 
This reverts commit afd363129f, reversing
changes made to c94bc94ad5.
 2024-03-19 20:25:41 -07:00
Krrish Dholakia
3a866dd349 bump: version 1.32.5 → 1.32.6 2024-03-19 20:17:50 -07:00
Krish Dholakia
afd363129f
Merge pull request #2593 from BerriAI/litellm_reset_budget_fix 
fix(proxy/utils.py): fix reset budget logic
 2024-03-19 20:17:03 -07:00
Krrish Dholakia
b9f222f8fb test(test_users.py): skip flaky circle ci test 2024-03-19 20:09:38 -07:00
Krrish Dholakia
37795c0d92 fix(proxy_server.py): add more debug logs 2024-03-19 19:59:43 -07:00
Krrish Dholakia
97e7113b87 test(test_users.py): fix test 2024-03-19 19:48:44 -07:00
Krrish Dholakia
9140453d0c test: make test call more reliable 2024-03-19 19:47:18 -07:00
Krrish Dholakia
0822f6283f test(test_users.py): reposition test 
trying to identify why endpoint isn't being called
 2024-03-19 19:40:41 -07:00
Krrish Dholakia
f6de3a0359 fix: better debug logs 2024-03-19 19:28:26 -07:00
Ishaan Jaff
c94bc94ad5
Merge pull request #2591 from BerriAI/litellm_metrics_endpoint 
[Feat] /metrics endpoint for Prometheus, Grafana
 2024-03-19 18:08:22 -07:00
Krrish Dholakia
e0d3b18835 fix(proxy/utils.py): fix reset budget logic 
uses fewer clients - prevents read timeouts
 2024-03-19 18:02:09 -07:00
Ishaan Jaff
827a8af093 (fix) add prometheus_client to req.txt 2024-03-19 18:01:04 -07:00
Krish Dholakia
5171d7689f
Merge pull request #2592 from BerriAI/litellm_jwt_auth 
feat(handle_jwt.py): support authenticating admins into the proxy via jwt's
 2024-03-19 17:54:54 -07:00
Krrish Dholakia
3ed3d89a06 docs: doc cleanup 2024-03-19 17:50:31 -07:00
Krrish Dholakia
0c1d754e2c docs(cost_tracking.md): cleanup docs 2024-03-19 17:40:52 -07:00
Krrish Dholakia
191c2256f6 docs(deploy.md): fix deploy quick start command 2024-03-19 17:35:08 -07:00