Ishaan Jaff
b93152e978
assume index is not always in stream chunk
2024-08-15 19:42:03 -07:00
Ishaan Jaff
fa569aaf6f
feat add support for aws_region_name
2024-08-15 19:32:59 -07:00
Ishaan Jaff
b4ba12e22c
show bedrock, sagemaker creds in verbose mode
2024-08-15 19:10:11 -07:00
Ishaan Jaff
b96a27b230
add verbose logging on test
2024-08-15 19:05:23 -07:00
Ishaan Jaff
40dc27e72c
fix sagemaker tests
2024-08-15 18:34:20 -07:00
Ishaan Jaff
0d374fb7c0
fix sagemaker test
2024-08-15 18:23:41 -07:00
Ishaan Jaff
df4ea8fba6
refactor sagemaker to be async
2024-08-15 18:18:02 -07:00
Ishaan Jaff
b1aed699ea
test sync sagemaker calls
2024-08-15 15:12:31 -07:00
Ishaan Jaff
2c9e3e9bd7
run mock tests for test_completion_sagemaker
2024-08-15 14:49:21 -07:00
Ishaan Jaff
b58c2bef1c
add non-stream mock tests for sagemaker
2024-08-15 14:48:24 -07:00
Ishaan Jaff
e217eda303
use BaseAWSLLM for bedrock getcredentials
2024-08-15 13:58:47 -07:00
Ishaan Jaff
08922041da
Merge pull request #5224 from BerriAI/litellm_use_common_helper_llm_call
...
[Feat-Proxy] - user common helper to `route_request` for making llm call
2024-08-15 11:49:29 -07:00
Ishaan Jaff
7a17b2132f
fix /moderations endpoint
2024-08-15 08:58:28 -07:00
Ishaan Jaff
c50a60004f
fix test proxy exception mapping
2024-08-15 08:52:28 -07:00
Ishaan Jaff
58828403ea
refactor use 1 util for llm routing
2024-08-15 08:42:20 -07:00
Ishaan Jaff
d50f26d73d
simplify logic for routing llm request
2024-08-15 08:29:28 -07:00
Ishaan Jaff
fdd6664420
use route_request for making llm call
2024-08-15 08:16:44 -07:00
Krrish Dholakia
eb6a0a32f1
docs(bedrock.md): add guardrails on config.yaml to docs
2024-08-14 22:11:19 -07:00
Krrish Dholakia
c7fd626805
docs(team_logging.md): add key-based logging to docs
2024-08-14 21:49:55 -07:00
Krrish Dholakia
3487d84fcc
docs(pass_through.md): add doc on using langfuse client sdk w/ litellm proxy
2024-08-14 21:43:31 -07:00
Ishaan Jaff
d8ef882905
fix langfuse log_provider_specific_information_as_span
2024-08-14 17:54:18 -07:00
Krish Dholakia
970892fea7
Merge pull request #5209 from BerriAI/litellm_azure_ai_openai_support
...
fix(utils.py): support calling openai models via `azure_ai/`
2024-08-14 17:53:33 -07:00
Krish Dholakia
435d39bb24
Merge branch 'main' into litellm_azure_ai_openai_support
2024-08-14 17:53:27 -07:00
Ishaan Jaff
9c039a9064
bump: version 1.43.12 → 1.43.13
2024-08-14 17:47:20 -07:00
Ishaan Jaff
1f631606a5
Merge pull request #5210 from BerriAI/litellm_add_prompt_caching_support
...
[Feat] Add Anthropic API Prompt Caching Support
2024-08-14 17:43:01 -07:00
Ishaan Jaff
912acb1cae
docs using proxy with context caaching anthropic
2024-08-14 17:42:48 -07:00
Krish Dholakia
c5647ac596
Merge pull request #5211 from msabramo/use-AZURE_API_VERSION-as-default-azure-openai-version
...
Use `AZURE_API_VERSION` env var as default azure openai version
2024-08-14 17:37:55 -07:00
Ishaan Jaff
2267b8a59f
docs add examples with litellm proxy
2024-08-14 17:13:26 -07:00
Ishaan Jaff
fd122aa7a3
docs add examples doing context caching anthropic sdk
2024-08-14 17:07:51 -07:00
Ishaan Jaff
78a2013e51
add test for large context in system message for anthropic
2024-08-14 17:03:10 -07:00
Ishaan Jaff
76a5f5d433
move claude prompt caching to diff file
2024-08-14 16:28:12 -07:00
Ishaan Jaff
e0ff4823d0
add test for caching tool calls
2024-08-14 16:19:14 -07:00
Marc Abramowitz
ac9aa1ab67
Use AZURE_API_VERSION as default azure openai version
...
Without this change, the default version of the Azure OpenAI API is hardcoded in
the code as an old version, `"2024-02-01"`. This change allows the user to set
the default version of the Azure OpenAI API by setting the environment variable
`AZURE_API_VERSION` or by using the command-line parameter `--api_version`.
2024-08-14 15:47:57 -07:00
Krrish Dholakia
6333b04be3
fix(factory.py): handle assistant null content
2024-08-14 15:44:38 -07:00
Ishaan Jaff
fccc6dc928
fix bedrock test
2024-08-14 15:27:20 -07:00
Ishaan Jaff
45e367d4d4
docs Caching - Continuing Multi-Turn Convo
2024-08-14 15:26:25 -07:00
Ishaan Jaff
54102a660d
pass cache_control in tool call
2024-08-14 15:18:11 -07:00
Ishaan Jaff
96f9655a02
test test_anthropic_api_prompt_caching_basic
2024-08-14 15:06:10 -07:00
Krish Dholakia
75ed22d391
Merge pull request #5192 from BerriAI/litellm_fix_pass_through_endpoints
...
feat(user_api_key_auth.py): support calling langfuse with litellm user_api_key_auth
2024-08-14 14:59:46 -07:00
Ishaan Jaff
69a640e9c4
test amnthropic prompt caching
2024-08-14 14:59:46 -07:00
Krish Dholakia
aa2267bddb
Merge branch 'main' into litellm_fix_pass_through_endpoints
2024-08-14 14:59:38 -07:00
Ishaan Jaff
b0651bd481
add anthropic cache controls
2024-08-14 14:56:49 -07:00
Krrish Dholakia
179dd7b893
docs(model_management.md): add section on adding additional model information to proxy config
2024-08-14 14:39:48 -07:00
Krrish Dholakia
9b46ec05b0
fix(factory.py): support assistant messages as a list of dictionaries - cohere messages api
...
Fixes https://github.com/BerriAI/litellm/pull/5121
2024-08-14 14:19:59 -07:00
Krrish Dholakia
10f27bb1b5
test(test_pass_through_endpoints.py): fix langfuse base
2024-08-14 14:13:21 -07:00
Krish Dholakia
eb5f0a8da2
Merge pull request #5148 from fabceolin/main
...
Enable follow redirects in ollama_chat
2024-08-14 14:08:45 -07:00
Krrish Dholakia
1faa931f26
build(model_prices_and_context_window.json): add 'supports_assistant_prefill' to all vertex ai anthropic models
2024-08-14 14:08:12 -07:00
Ishaan Jaff
9791352dc6
add testing for test_anthropic_cache_controls_pt
2024-08-14 14:07:48 -07:00
Krish Dholakia
4c6b14c301
Merge pull request #5203 from paul-gauthier/main
...
vertex_ai/claude-3-5-sonnet@20240620 support prefill
2024-08-14 14:06:20 -07:00
Krrish Dholakia
1e78b3bf54
fix(utils.py): fix is_azure_openai_model helper function
2024-08-14 14:04:39 -07:00
