Paul Lang
|
b0d13f42ed
|
Merge remote-tracking branch 'origin/main' into fix_anthropic_tool_streaming_index
|
2024-08-16 09:26:04 -04:00 |
|
Krrish Dholakia
|
1510daba4f
|
bump: version 1.43.15 → 1.43.16
|
2024-08-15 23:04:30 -07:00 |
|
Krish Dholakia
|
6c3f37f8b4
|
Merge pull request #5235 from BerriAI/litellm_fix_s3_logs
fix(s3.py): fix s3 logging payload to have valid json values
|
2024-08-15 23:00:18 -07:00 |
|
Krish Dholakia
|
1dbc9b8a2e
|
Merge pull request #5215 from BerriAI/litellm_pass_through_endpoints_api
CRUD Endpoints for Pass-Through endpoints
|
2024-08-15 22:39:39 -07:00 |
|
Krish Dholakia
|
b3d15ace89
|
Merge branch 'main' into litellm_pass_through_endpoints_api
|
2024-08-15 22:39:19 -07:00 |
|
Krrish Dholakia
|
6fc6df134f
|
feat(ui): for adding pass-through endpoints
|
2024-08-15 21:58:11 -07:00 |
|
Ishaan Jaff
|
a614c9f525
|
fix sagemaker old used test
|
2024-08-15 21:55:27 -07:00 |
|
Krrish Dholakia
|
589da45c24
|
feat(pass_through_endpoints.py): initial working CRUD endpoints for /pass_through_endoints
|
2024-08-15 21:23:26 -07:00 |
|
Ishaan Jaff
|
eb9e5af1a3
|
fix test sagemaker config test
|
2024-08-15 21:18:18 -07:00 |
|
Ishaan Jaff
|
9546268aa5
|
Merge pull request #5238 from BerriAI/litellm_fix_use_prompt_caching_proxy
fix using anthropic prompt caching on proxy
|
2024-08-15 20:14:23 -07:00 |
|
Ishaan Jaff
|
6cb3675a06
|
fix using prompt caching on proxy
|
2024-08-15 20:12:11 -07:00 |
|
Ishaan Jaff
|
42c2290a77
|
bump: version 1.43.14 → 1.43.15
|
2024-08-15 19:53:51 -07:00 |
|
Ishaan Jaff
|
33ccf064eb
|
bump: version 1.43.13 → 1.43.14
|
2024-08-15 19:53:51 -07:00 |
|
Ishaan Jaff
|
f7dec5be25
|
Merge pull request #5237 from BerriAI/litellm_make_sagemaker_async_v2
[Feat] Make Sagemaker Async
|
2024-08-15 19:50:45 -07:00 |
|
Ishaan Jaff
|
e1839c8da2
|
allow index to not exist in sagemaker chunks
|
2024-08-15 19:45:59 -07:00 |
|
Ishaan Jaff
|
b93152e978
|
assume index is not always in stream chunk
|
2024-08-15 19:42:03 -07:00 |
|
Ishaan Jaff
|
fa569aaf6f
|
feat add support for aws_region_name
|
2024-08-15 19:32:59 -07:00 |
|
Ishaan Jaff
|
b4ba12e22c
|
show bedrock, sagemaker creds in verbose mode
|
2024-08-15 19:10:11 -07:00 |
|
Ishaan Jaff
|
b96a27b230
|
add verbose logging on test
|
2024-08-15 19:05:23 -07:00 |
|
Ishaan Jaff
|
40dc27e72c
|
fix sagemaker tests
|
2024-08-15 18:34:20 -07:00 |
|
Ishaan Jaff
|
0d374fb7c0
|
fix sagemaker test
|
2024-08-15 18:23:41 -07:00 |
|
Ishaan Jaff
|
df4ea8fba6
|
refactor sagemaker to be async
|
2024-08-15 18:18:02 -07:00 |
|
Krrish Dholakia
|
28d7de30de
|
fix(litellm_logging.py): wrap function to safely fail
|
2024-08-15 18:05:06 -07:00 |
|
Krrish Dholakia
|
f6dba82882
|
feat(litellm_logging.py): cleanup payload + add response cost to logged payload
|
2024-08-15 17:53:25 -07:00 |
|
Krrish Dholakia
|
3ddeb3297d
|
fix(litellm_logging.py): fix standard payload
|
2024-08-15 17:33:40 -07:00 |
|
Krrish Dholakia
|
cda50e5d47
|
fix(s3.py): fix s3 logging payload to have valid json values
Previously pydantic objects were being stringified, making them unparsable
|
2024-08-15 17:09:02 -07:00 |
|
Ishaan Jaff
|
e4638ee4e4
|
Merge pull request #5233 from BerriAI/litellm_make_sagemaker_async
[Fix] use BaseAWSLLM for bedrock, sagemaker
|
2024-08-15 15:13:29 -07:00 |
|
Ishaan Jaff
|
b1aed699ea
|
test sync sagemaker calls
|
2024-08-15 15:12:31 -07:00 |
|
Ishaan Jaff
|
2c9e3e9bd7
|
run mock tests for test_completion_sagemaker
|
2024-08-15 14:49:21 -07:00 |
|
Ishaan Jaff
|
b58c2bef1c
|
add non-stream mock tests for sagemaker
|
2024-08-15 14:48:24 -07:00 |
|
Ishaan Jaff
|
c32cb365d0
|
Merge pull request #5226 from BerriAI/litellm_always_log_cache_key
[Fix-Proxy + Langfuse] Always log cache_key on hits/misses
|
2024-08-15 14:01:15 -07:00 |
|
Ishaan Jaff
|
e217eda303
|
use BaseAWSLLM for bedrock getcredentials
|
2024-08-15 13:58:47 -07:00 |
|
Ishaan Jaff
|
5c1c9f7616
|
fix ImportError
|
2024-08-15 13:02:44 -07:00 |
|
Paul Lang
|
97fce022e4
|
Fixes the tool_use chunk mapping
|
2024-08-15 15:44:09 -04:00 |
|
Ishaan Jaff
|
5f693971f7
|
fix - don't require boto3 on the cli
|
2024-08-15 12:36:38 -07:00 |
|
Ishaan Jaff
|
08922041da
|
Merge pull request #5224 from BerriAI/litellm_use_common_helper_llm_call
[Feat-Proxy] - user common helper to `route_request` for making llm call
|
2024-08-15 11:49:29 -07:00 |
|
Ishaan Jaff
|
a59ed00fd3
|
litellm always log cache_key on hits/misses
|
2024-08-15 09:59:58 -07:00 |
|
Ishaan Jaff
|
7a17b2132f
|
fix /moderations endpoint
|
2024-08-15 08:58:28 -07:00 |
|
Ishaan Jaff
|
c50a60004f
|
fix test proxy exception mapping
|
2024-08-15 08:52:28 -07:00 |
|
Ishaan Jaff
|
58828403ea
|
refactor use 1 util for llm routing
|
2024-08-15 08:42:20 -07:00 |
|
Ishaan Jaff
|
d50f26d73d
|
simplify logic for routing llm request
|
2024-08-15 08:29:28 -07:00 |
|
Ishaan Jaff
|
fdd6664420
|
use route_request for making llm call
|
2024-08-15 08:16:44 -07:00 |
|
Krrish Dholakia
|
eb6a0a32f1
|
docs(bedrock.md): add guardrails on config.yaml to docs
|
2024-08-14 22:11:19 -07:00 |
|
Krrish Dholakia
|
c7fd626805
|
docs(team_logging.md): add key-based logging to docs
|
2024-08-14 21:49:55 -07:00 |
|
Krrish Dholakia
|
3487d84fcc
|
docs(pass_through.md): add doc on using langfuse client sdk w/ litellm proxy
|
2024-08-14 21:43:31 -07:00 |
|
Krrish Dholakia
|
28faafadb1
|
feat(pass_through_endpoints.py): initial commit of crud endpoints for pass through endpoints
|
2024-08-14 21:36:07 -07:00 |
|
Krrish Dholakia
|
a020563149
|
feat(proxy_server.py): support returning available fields for pass_through_endpoints via `/config/field/list
|
2024-08-14 19:07:10 -07:00 |
|
Ishaan Jaff
|
d8ef882905
|
fix langfuse log_provider_specific_information_as_span
|
2024-08-14 17:54:18 -07:00 |
|
Krish Dholakia
|
970892fea7
|
Merge pull request #5209 from BerriAI/litellm_azure_ai_openai_support
fix(utils.py): support calling openai models via `azure_ai/`
|
2024-08-14 17:53:33 -07:00 |
|
Krish Dholakia
|
435d39bb24
|
Merge branch 'main' into litellm_azure_ai_openai_support
|
2024-08-14 17:53:27 -07:00 |
|