scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-06 08:16:43 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 79
16489 commits 4106 branches 1402 tags 4.2 GiB
Commit graph

16489 commits

This branch
This branch
All branches
Author SHA1 Message Date
Krrish Dholakia
178139f18d feat(litellm_logging.py): support logging model price information to s3 logs 2024-08-16 16:21:34 -07:00
Ishaan Jaff
9c3124c5a7 ui new build 2024-08-16 12:53:23 -07:00
Ishaan Jaff
bd7bf7f6b0 fix endpoint name on router 2024-08-16 12:46:43 -07:00
Ishaan Jaff
f92cabbceb
Merge pull request #5250 from BerriAI/docs_sagemaker_docs 
[Docs] Sagemaker add example on using with LiteLLM Proxy and temperature=0
 2024-08-16 12:43:02 -07:00
Ishaan Jaff
dcd8ff44df docs add example on setting temp=0 for sagemaker 2024-08-16 12:04:35 -07:00
Ishaan Jaff
63b4e11bfd docs sagemaker - add example using with proxy 2024-08-16 11:47:13 -07:00
Ishaan Jaff
7f39f9f97d docs cleanup 2024-08-16 11:38:53 -07:00
Ishaan Jaff
740d1fdb1c add provider_specific_fields to GenericStreamingChunk 2024-08-16 11:38:22 -07:00
Krrish Dholakia
cbdaecb5a8 fix(__init__.py): fix models_by_provider to include cohere_chat models 
Fixes https://github.com/BerriAI/litellm/issues/5201
 2024-08-16 11:33:23 -07:00
Ishaan Jaff
3d7e3d65d0
Merge pull request #5135 from BerriAI/dependabot/pip/aiohttp-3.10.2 
build(deps): bump aiohttp from 3.9.4 to 3.10.2
 2024-08-16 09:07:02 -07:00
Ishaan Jaff
374a46d924
Merge pull request #5173 from gitravin/rn/sagemaker-zero-temp 
Allow zero temperature for Sagemaker models based on config
 2024-08-16 08:45:44 -07:00
Krrish Dholakia
1510daba4f bump: version 1.43.15 → 1.43.16 2024-08-15 23:04:30 -07:00
Krish Dholakia
6c3f37f8b4
Merge pull request #5235 from BerriAI/litellm_fix_s3_logs 
fix(s3.py): fix s3 logging payload to have valid json values
 2024-08-15 23:00:18 -07:00
Krish Dholakia
1dbc9b8a2e
Merge pull request #5215 from BerriAI/litellm_pass_through_endpoints_api 
CRUD Endpoints for Pass-Through endpoints
 2024-08-15 22:39:39 -07:00
Krish Dholakia
b3d15ace89
Merge branch 'main' into litellm_pass_through_endpoints_api 2024-08-15 22:39:19 -07:00
Krrish Dholakia
6fc6df134f feat(ui): for adding pass-through endpoints 2024-08-15 21:58:11 -07:00
Ishaan Jaff
a614c9f525 fix sagemaker old used test 2024-08-15 21:55:27 -07:00
Krrish Dholakia
589da45c24 feat(pass_through_endpoints.py): initial working CRUD endpoints for /pass_through_endoints 2024-08-15 21:23:26 -07:00
Ishaan Jaff
eb9e5af1a3 fix test sagemaker config test 2024-08-15 21:18:18 -07:00
Ishaan Jaff
9546268aa5
Merge pull request #5238 from BerriAI/litellm_fix_use_prompt_caching_proxy 
fix using anthropic prompt caching on proxy
 2024-08-15 20:14:23 -07:00
Ishaan Jaff
6cb3675a06 fix using prompt caching on proxy 2024-08-15 20:12:11 -07:00
Ishaan Jaff
42c2290a77 bump: version 1.43.14 → 1.43.15 2024-08-15 19:53:51 -07:00
Ishaan Jaff
33ccf064eb bump: version 1.43.13 → 1.43.14 2024-08-15 19:53:51 -07:00
Ishaan Jaff
f7dec5be25
Merge pull request #5237 from BerriAI/litellm_make_sagemaker_async_v2 
[Feat] Make Sagemaker Async
 2024-08-15 19:50:45 -07:00
Ishaan Jaff
e1839c8da2 allow index to not exist in sagemaker chunks 2024-08-15 19:45:59 -07:00
Ishaan Jaff
b93152e978 assume index is not always in stream chunk 2024-08-15 19:42:03 -07:00
Ishaan Jaff
fa569aaf6f feat add support for aws_region_name 2024-08-15 19:32:59 -07:00
Ishaan Jaff
b4ba12e22c show bedrock, sagemaker creds in verbose mode 2024-08-15 19:10:11 -07:00
Ishaan Jaff
b96a27b230 add verbose logging on test 2024-08-15 19:05:23 -07:00
Ishaan Jaff
40dc27e72c fix sagemaker tests 2024-08-15 18:34:20 -07:00
Ishaan Jaff
0d374fb7c0 fix sagemaker test 2024-08-15 18:23:41 -07:00
Ishaan Jaff
df4ea8fba6 refactor sagemaker to be async 2024-08-15 18:18:02 -07:00
Krrish Dholakia
28d7de30de fix(litellm_logging.py): wrap function to safely fail 2024-08-15 18:05:06 -07:00
Krrish Dholakia
f6dba82882 feat(litellm_logging.py): cleanup payload + add response cost to logged payload 2024-08-15 17:53:25 -07:00
Krrish Dholakia
3ddeb3297d fix(litellm_logging.py): fix standard payload 2024-08-15 17:33:40 -07:00
Krrish Dholakia
cda50e5d47 fix(s3.py): fix s3 logging payload to have valid json values 
Previously pydantic objects were being stringified, making them unparsable
 2024-08-15 17:09:02 -07:00
Ishaan Jaff
e4638ee4e4
Merge pull request #5233 from BerriAI/litellm_make_sagemaker_async 
[Fix] use BaseAWSLLM for bedrock, sagemaker
 2024-08-15 15:13:29 -07:00
Ishaan Jaff
b1aed699ea test sync sagemaker calls 2024-08-15 15:12:31 -07:00
Ishaan Jaff
2c9e3e9bd7 run mock tests for test_completion_sagemaker 2024-08-15 14:49:21 -07:00
Ishaan Jaff
b58c2bef1c add non-stream mock tests for sagemaker 2024-08-15 14:48:24 -07:00
Ishaan Jaff
c32cb365d0
Merge pull request #5226 from BerriAI/litellm_always_log_cache_key 
[Fix-Proxy + Langfuse] Always log cache_key on hits/misses
 2024-08-15 14:01:15 -07:00
Ishaan Jaff
e217eda303 use BaseAWSLLM for bedrock getcredentials 2024-08-15 13:58:47 -07:00
Ishaan Jaff
5c1c9f7616 fix ImportError 2024-08-15 13:02:44 -07:00
Ishaan Jaff
5f693971f7 fix - don't require boto3 on the cli 2024-08-15 12:36:38 -07:00
Ishaan Jaff
08922041da
Merge pull request #5224 from BerriAI/litellm_use_common_helper_llm_call 
[Feat-Proxy] - user common helper to `route_request` for making llm call
 2024-08-15 11:49:29 -07:00
Ishaan Jaff
a59ed00fd3 litellm always log cache_key on hits/misses 2024-08-15 09:59:58 -07:00
Ishaan Jaff
7a17b2132f fix /moderations endpoint 2024-08-15 08:58:28 -07:00
Ishaan Jaff
c50a60004f fix test proxy exception mapping 2024-08-15 08:52:28 -07:00
Ishaan Jaff
58828403ea refactor use 1 util for llm routing 2024-08-15 08:42:20 -07:00
Ishaan Jaff
d50f26d73d simplify logic for routing llm request 2024-08-15 08:29:28 -07:00