scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-09 03:18:44 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 109
17246 commits 3347 branches 1448 tags 5 GiB
Commit graph

17246 commits

This branch
This branch
All branches
Author SHA1 Message Date
Ishaan Jaff
374a46d924
Merge pull request #5173 from gitravin/rn/sagemaker-zero-temp 
Allow zero temperature for Sagemaker models based on config
 2024-08-16 08:45:44 -07:00
Ishaan Jaff
026c7194f8 add provider_specific_fields to GenericStreamingChunk 2024-08-16 08:44:29 -07:00
Paul Lang
b0d13f42ed Merge remote-tracking branch 'origin/main' into fix_anthropic_tool_streaming_index 2024-08-16 09:26:04 -04:00
Krrish Dholakia
1510daba4f bump: version 1.43.15 → 1.43.16 2024-08-15 23:04:30 -07:00
Krish Dholakia
6c3f37f8b4
Merge pull request #5235 from BerriAI/litellm_fix_s3_logs 
fix(s3.py): fix s3 logging payload to have valid json values
 2024-08-15 23:00:18 -07:00
Krish Dholakia
1dbc9b8a2e
Merge pull request #5215 from BerriAI/litellm_pass_through_endpoints_api 
CRUD Endpoints for Pass-Through endpoints
 2024-08-15 22:39:39 -07:00
Krish Dholakia
b3d15ace89
Merge branch 'main' into litellm_pass_through_endpoints_api 2024-08-15 22:39:19 -07:00
Krrish Dholakia
6fc6df134f feat(ui): for adding pass-through endpoints 2024-08-15 21:58:11 -07:00
Ishaan Jaff
a614c9f525 fix sagemaker old used test 2024-08-15 21:55:27 -07:00
Krrish Dholakia
589da45c24 feat(pass_through_endpoints.py): initial working CRUD endpoints for /pass_through_endoints 2024-08-15 21:23:26 -07:00
Ishaan Jaff
eb9e5af1a3 fix test sagemaker config test 2024-08-15 21:18:18 -07:00
Ishaan Jaff
9546268aa5
Merge pull request #5238 from BerriAI/litellm_fix_use_prompt_caching_proxy 
fix using anthropic prompt caching on proxy
 2024-08-15 20:14:23 -07:00
Ishaan Jaff
6cb3675a06 fix using prompt caching on proxy 2024-08-15 20:12:11 -07:00
Ishaan Jaff
42c2290a77 bump: version 1.43.14 → 1.43.15 2024-08-15 19:53:51 -07:00
Ishaan Jaff
33ccf064eb bump: version 1.43.13 → 1.43.14 2024-08-15 19:53:51 -07:00
Ishaan Jaff
f7dec5be25
Merge pull request #5237 from BerriAI/litellm_make_sagemaker_async_v2 
[Feat] Make Sagemaker Async
 2024-08-15 19:50:45 -07:00
Ishaan Jaff
e1839c8da2 allow index to not exist in sagemaker chunks 2024-08-15 19:45:59 -07:00
Ishaan Jaff
b93152e978 assume index is not always in stream chunk 2024-08-15 19:42:03 -07:00
Ishaan Jaff
fa569aaf6f feat add support for aws_region_name 2024-08-15 19:32:59 -07:00
Ishaan Jaff
b4ba12e22c show bedrock, sagemaker creds in verbose mode 2024-08-15 19:10:11 -07:00
Ishaan Jaff
b96a27b230 add verbose logging on test 2024-08-15 19:05:23 -07:00
Ishaan Jaff
40dc27e72c fix sagemaker tests 2024-08-15 18:34:20 -07:00
Ishaan Jaff
0d374fb7c0 fix sagemaker test 2024-08-15 18:23:41 -07:00
Ishaan Jaff
df4ea8fba6 refactor sagemaker to be async 2024-08-15 18:18:02 -07:00
Krrish Dholakia
28d7de30de fix(litellm_logging.py): wrap function to safely fail 2024-08-15 18:05:06 -07:00
Krrish Dholakia
f6dba82882 feat(litellm_logging.py): cleanup payload + add response cost to logged payload 2024-08-15 17:53:25 -07:00
Krrish Dholakia
3ddeb3297d fix(litellm_logging.py): fix standard payload 2024-08-15 17:33:40 -07:00
Krrish Dholakia
cda50e5d47 fix(s3.py): fix s3 logging payload to have valid json values 
Previously pydantic objects were being stringified, making them unparsable
 2024-08-15 17:09:02 -07:00
Ishaan Jaff
e4638ee4e4
Merge pull request #5233 from BerriAI/litellm_make_sagemaker_async 
[Fix] use BaseAWSLLM for bedrock, sagemaker
 2024-08-15 15:13:29 -07:00
Ishaan Jaff
b1aed699ea test sync sagemaker calls 2024-08-15 15:12:31 -07:00
Ishaan Jaff
2c9e3e9bd7 run mock tests for test_completion_sagemaker 2024-08-15 14:49:21 -07:00
Ishaan Jaff
b58c2bef1c add non-stream mock tests for sagemaker 2024-08-15 14:48:24 -07:00
Ishaan Jaff
c32cb365d0
Merge pull request #5226 from BerriAI/litellm_always_log_cache_key 
[Fix-Proxy + Langfuse] Always log cache_key on hits/misses
 2024-08-15 14:01:15 -07:00
Ishaan Jaff
e217eda303 use BaseAWSLLM for bedrock getcredentials 2024-08-15 13:58:47 -07:00
Ishaan Jaff
5c1c9f7616 fix ImportError 2024-08-15 13:02:44 -07:00
Paul Lang
97fce022e4 Fixes the tool_use chunk mapping 2024-08-15 15:44:09 -04:00
Ishaan Jaff
5f693971f7 fix - don't require boto3 on the cli 2024-08-15 12:36:38 -07:00
Ishaan Jaff
08922041da
Merge pull request #5224 from BerriAI/litellm_use_common_helper_llm_call 
[Feat-Proxy] - user common helper to `route_request` for making llm call
 2024-08-15 11:49:29 -07:00
Ishaan Jaff
a59ed00fd3 litellm always log cache_key on hits/misses 2024-08-15 09:59:58 -07:00
Ishaan Jaff
7a17b2132f fix /moderations endpoint 2024-08-15 08:58:28 -07:00
Ishaan Jaff
c50a60004f fix test proxy exception mapping 2024-08-15 08:52:28 -07:00
Ishaan Jaff
58828403ea refactor use 1 util for llm routing 2024-08-15 08:42:20 -07:00
Ishaan Jaff
d50f26d73d simplify logic for routing llm request 2024-08-15 08:29:28 -07:00
Ishaan Jaff
fdd6664420 use route_request for making llm call 2024-08-15 08:16:44 -07:00
Rasmus Salling
e95efb9579
Make helm chart listen on IPv6 (and IPv4). 
This changes the listen statement from 0.0.0.0 to ::.

On any reasonably modern linux kernel, this will open a dual-stack socket and listen on all IPv4 and IPv6 sockets.
Without this litellm will not run in an IPv6 only environment.
 2024-08-15 16:05:19 +02:00
Kyrylo Yefimenko
e3cd8e169b Use sepecific llama2 and llama3 model names in Ollama 2024-08-15 12:27:51 +01:00
lidongming
e1f53fcc80 Fix incorrect message length check in cost calculator 2024-08-15 16:59:38 +08:00
Krrish Dholakia
eb6a0a32f1 docs(bedrock.md): add guardrails on config.yaml to docs 2024-08-14 22:11:19 -07:00
Krrish Dholakia
c7fd626805 docs(team_logging.md): add key-based logging to docs 2024-08-14 21:49:55 -07:00
Krrish Dholakia
3487d84fcc docs(pass_through.md): add doc on using langfuse client sdk w/ litellm proxy 2024-08-14 21:43:31 -07:00