Commit graph

14130 commits

Author SHA1 Message Date
Marc Abramowitz
379b834480 Document feature 2024-06-27 20:20:29 -07:00
Marc Abramowitz
d14138dbd9 Rename request header 2024-06-27 20:20:29 -07:00
Marc Abramowitz
efae9fa991 Turn on message logging via request header 2024-06-27 20:20:29 -07:00
Krrish Dholakia
7f54c90459 fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions
Fixes https://github.com/BerriAI/litellm/issues/4338
2024-06-27 20:20:29 -07:00
Krrish Dholakia
e20e8c2e74 fix(vertex_httpx.py): flush remaining chunks from stream 2024-06-27 20:20:18 -07:00
Krrish Dholakia
b23181779f fix(vertex_httpx.py): ignore vertex finish reason - wait for stream to end
Fixes https://github.com/BerriAI/litellm/issues/4339
2024-06-27 20:20:18 -07:00
Krrish Dholakia
f479cd549f fix(router.py): check if azure returns 'content_filter' response + fallback available -> fallback
Exception maps azure content filter response exceptions
2024-06-27 20:20:18 -07:00
Ishaan Jaff
7bedb5ca52
Merge pull request #4451 from BerriAI/litellm_azure_fix_pre_post_logging
[Fix] Azure Post-API Call occurs before Pre-API Call in CustomLogger
2024-06-27 20:18:14 -07:00
Krrish Dholakia
94c069e869 fix(cost_calculator.py): infer provider name if not given
Fixes https://github.com/BerriAI/litellm/issues/4452
2024-06-27 18:41:04 -07:00
Krrish Dholakia
2faa6f704a fix(factory.py): get image type from response headers
Fixes https://github.com/BerriAI/litellm/issues/4441
2024-06-27 18:19:16 -07:00
Ishaan Jaff
96d3780a53 fix test secrets 2024-06-27 17:47:10 -07:00
Ishaan Jaff
eaa6441030 test fix secret detection 2024-06-27 17:42:44 -07:00
Ishaan Jaff
57ba0a46b7 azure - log post api call 2024-06-27 17:38:03 -07:00
Ishaan Jaff
a012f231b6 azure - fix custom logger on post call 2024-06-27 17:37:02 -07:00
Krrish Dholakia
c14cc35e52 feat(azure.py): azure tts support
Closes https://github.com/BerriAI/litellm/issues/4002
2024-06-27 16:59:25 -07:00
Ishaan Jaff
0cd25c250d
Merge pull request #4447 from BerriAI/litellm_fix_error_on_v2_model_info
[fix] error message on /v2/model info when no models exist
2024-06-27 16:33:19 -07:00
Ishaan Jaff
ed32fb71e7
Merge pull request #4444 from BerriAI/litellm_better_Secret_redact
[Feat] Improve secret detection call hook - catch more cases
2024-06-27 16:31:48 -07:00
Ishaan Jaff
0c6cd2c894 fix error message on v2/model info 2024-06-27 16:29:11 -07:00
Krrish Dholakia
d421486a45 fix(token_counter.py): New `get_modified_max_tokens' helper func
Fixes https://github.com/BerriAI/litellm/issues/4439
2024-06-27 15:38:09 -07:00
John HU
933101a3f8
Do not resolve project id from creds 2024-06-27 15:26:36 -07:00
Ishaan Jaff
baf55a86c9 fix secret scanner 2024-06-27 15:20:30 -07:00
Ishaan Jaff
84ee37086c add stricter secret detection 2024-06-27 15:12:13 -07:00
Ishaan Jaff
552bac586f feat - improve secret detection 2024-06-27 15:07:38 -07:00
Ishaan Jaff
c9cee3d910 test - test_chat_completion_request_with_redaction 2024-06-27 13:48:25 -07:00
Ishaan Jaff
80960facfa fix secret redaction logic 2024-06-27 13:19:54 -07:00
Ishaan Jaff
80d8bf5d8f fix raise better error message on reaching failed vertex import 2024-06-27 12:02:19 -07:00
Ishaan Jaff
9d50fc1f2a docs - fix model name on claude-3-5-sonnet-20240620 anthropic 2024-06-27 10:40:06 -07:00
Ishaan Jaff
2376b7ac79
Merge pull request #4442 from djliden/main
Updates Databricks provider docs
2024-06-27 09:59:51 -07:00
Daniel Liden
101bd38996
undoes changes to proxy yaml api key/base 2024-06-27 12:51:00 -04:00
Krrish Dholakia
0c5014c323 bump: version 1.40.28 → 1.40.29 2024-06-27 08:58:25 -07:00
Krrish Dholakia
010b55e6db fix(utils.py): handle arguments being None
Fixes https://github.com/BerriAI/litellm/issues/4440
2024-06-27 08:56:52 -07:00
Daniel Liden
86010bc440
Update databricks.md
fixes a couple of examples to use correct endpoints/point to correct models
2024-06-27 09:36:45 -04:00
Daniel Liden
e1d844a9a0
Update databricks.md
updates some references to predibase to refer to Databricks
2024-06-27 09:11:09 -04:00
Krrish Dholakia
23a1f21f86 fix(utils.py): add new special token for cleanup 2024-06-26 22:52:50 -07:00
Krrish Dholakia
31dc3cd84f docs(openai_compatible.md): doc on disabling system messages 2024-06-26 22:45:34 -07:00
Krrish Dholakia
adcd55fca0 fix(initial-commit): decrypts aws keys in entrypoint.sh 2024-06-26 22:33:26 -07:00
Ishaan Jaff
dad09fdc3d ci/cd run again 2024-06-26 19:18:12 -07:00
Ishaan Jaff
e93181310e bump: version 1.40.27 → 1.40.28 2024-06-26 19:03:17 -07:00
Ishaan Jaff
4707c4fccd fix gemini test 2024-06-26 19:00:30 -07:00
Krrish Dholakia
fa68115530 docs(cost_tracking.md): add litellm cost in proxy response headers to docs 2024-06-26 18:14:21 -07:00
Ishaan Jaff
3dc578555c
Merge pull request #4421 from BerriAI/litellm_add_vertex_models
[Feat] Add all Vertex AI Models
2024-06-26 18:10:09 -07:00
Ishaan Jaff
7264113c25 vertex testing 2024-06-26 18:08:54 -07:00
Krrish Dholakia
a6aee18012 docs(token_usage.md): add response cost to usage docs 2024-06-26 18:05:47 -07:00
Krrish Dholakia
f533e1da09 fix(utils.py): return 'response_cost' in completion call
Closes https://github.com/BerriAI/litellm/issues/4335
2024-06-26 17:55:57 -07:00
Ishaan Jaff
afe31d3cb6
Merge pull request #4435 from BerriAI/litellm_Add_codestral_pricing
[Feat] Add Codestral pricing
2024-06-26 17:31:42 -07:00
Ishaan Jaff
caf28c7441 add source for codestral pricing 2024-06-26 17:31:26 -07:00
Ishaan Jaff
d002a804b7 add codestral pricing 2024-06-26 17:28:29 -07:00
Krrish Dholakia
98daedaf60 fix(router.py): fix setting httpx mounts 2024-06-26 17:22:04 -07:00
Ishaan Jaff
8ecf15185b
Merge pull request #4423 from BerriAI/litellm_forward_traceparent_otel
[Fix] Forward OTEL Traceparent Header to provider
2024-06-26 17:16:23 -07:00
Ishaan Jaff
ef91b18a88
Merge pull request #4433 from BerriAI/litellm_add_volcano_ai_enginer
[Feat] New Provider - Add volcano AI Engine
2024-06-26 17:12:08 -07:00