Krrish Dholakia
7f0daafc56
docs(main.py): update acompletion_with_retries docstring
...
Closes https://github.com/BerriAI/litellm/issues/4908
2024-07-29 15:50:12 -07:00
Krrish Dholakia
8e24c3c945
build(model_prices_and_context_window.json): update model info for llama3.1 on bedrock - supports tool calling, not tool choice
2024-07-29 15:43:16 -07:00
Ishaan Jaff
b0da3f12e8
Merge pull request #4950 from BerriAI/dependabot/npm_and_yarn/docs/my-website/fast-xml-parser-4.4.1
...
build(deps): bump fast-xml-parser from 4.3.2 to 4.4.1 in /docs/my-website
2024-07-29 15:10:07 -07:00
Ishaan Jaff
e031359e67
Merge pull request #4946 from BerriAI/litellm_Add_bedrock_guardrail_config
...
[Feat] Bedrock add support for Bedrock Guardrails
2024-07-29 15:09:56 -07:00
Krish Dholakia
6bdb9203b3
Merge pull request #4948 from dleen/response
...
fixes : #4947 Bedrock context exception does not have a response
2024-07-29 15:03:40 -07:00
dependabot[bot]
9cb3235d98
build(deps): bump fast-xml-parser in /docs/my-website
...
Bumps [fast-xml-parser](https://github.com/NaturalIntelligence/fast-xml-parser ) from 4.3.2 to 4.4.1.
- [Release notes](https://github.com/NaturalIntelligence/fast-xml-parser/releases )
- [Changelog](https://github.com/NaturalIntelligence/fast-xml-parser/blob/master/CHANGELOG.md )
- [Commits](https://github.com/NaturalIntelligence/fast-xml-parser/compare/v4.3.2...v4.4.1 )
---
updated-dependencies:
- dependency-name: fast-xml-parser
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-07-29 21:41:45 +00:00
Ishaan Jaff
3ce0cac56d
docs guardrailConfig
2024-07-29 14:26:46 -07:00
pat-cohere
972df1f303
Update cohere_chat.py
2024-07-29 17:26:07 -04:00
David Leen
ebca13b2ca
fixes : #4947 Bedrock context exception does not have a response
2024-07-29 14:23:56 -07:00
pat-cohere
1ee8051c7c
Update cohere_chat.py
...
Add chat history to cohere chat call that was previously being dropped.
2024-07-29 17:23:04 -04:00
Ishaan Jaff
21963e0bbe
proxy server
2024-07-29 14:22:02 -07:00
Ishaan Jaff
7cac1b0dce
docs - Bedrock Guardrails
2024-07-29 14:18:42 -07:00
Ishaan Jaff
46555ab78b
test - bedrock guardrailConfig
2024-07-29 14:13:08 -07:00
Ishaan Jaff
5154ec51a3
feat - support guardrailConfig
2024-07-29 14:10:09 -07:00
Ishaan Jaff
3eaa1fa217
types add GuardrailConfigBlock
2024-07-29 13:14:53 -07:00
Krrish Dholakia
ae4bcd8a41
fix(utils.py): fix trim_messages to handle tool calling
...
Fixes https://github.com/BerriAI/litellm/issues/4931
2024-07-29 13:04:41 -07:00
Krrish Dholakia
dd2d61bfce
build(pre-commit.yaml): update
2024-07-29 12:29:56 -07:00
Krrish Dholakia
59384c84a5
fix(utils.py): correctly re-raise azure api connection error
...
'
2024-07-29 12:28:25 -07:00
Krish Dholakia
63531a9824
Merge pull request #4943 from dleen/logs
...
Fix : #4942 . Remove verbose logging when exception can be handled
2024-07-29 12:12:28 -07:00
David Leen
452441ae03
Fix : #4942 . Remove verbose logging when exception can be handled
2024-07-29 12:05:10 -07:00
Krrish Dholakia
66dbd938e8
fix(exceptions.py): use correct status code for content policy exceptions
...
Fixes https://github.com/BerriAI/litellm/issues/4941#issuecomment-2256578732
2024-07-29 12:01:54 -07:00
Krrish Dholakia
52b1ca292c
fix(utils.py): check if tools is iterable before indexing into it
...
Fixes https://github.com/BerriAI/litellm/issues/4933
2024-07-29 09:01:32 -07:00
Ishaan Jaff
a2939c2f08
Merge pull request #4939 from BerriAI/litellm_log_transcription_resp_langfuse
...
[Feat-Proxy] - Langfuse log /audio/transcription on langfuse
2024-07-29 08:58:40 -07:00
Ishaan Jaff
285925e10a
log output from /audio on langfuse
2024-07-29 08:21:22 -07:00
Krrish Dholakia
31445ab20a
fix(caching.py): support /completion caching by default
...
updates supported call types in redis cache to cover text_completion caching
2024-07-29 08:19:30 -07:00
Ishaan Jaff
ec28e8e630
test - logging litellm-atranscription
2024-07-29 08:17:19 -07:00
Ishaan Jaff
95f063f978
fix default input/output values for /audio/trancription logging
2024-07-29 08:03:08 -07:00
Ishaan Jaff
b2fcf65653
log file_size_in_mb in metadata
2024-07-29 08:00:28 -07:00
Krrish Dholakia
92b539b42a
fix(auth_checks.py): handle writing team object to redis caching correctly
2024-07-29 07:51:44 -07:00
Ravi N
b321f2988b
Allow zero temperature for Sagemaker models based on config
...
Since Sagemaker can host any kind of model, some models allow
zero temperature. However, this is not enabled by default and
only allowed based on config
2024-07-28 21:55:53 -04:00
Krrish Dholakia
21eea28723
docs(vertex.md): add mistral api to docs
2024-07-27 22:44:15 -07:00
Krish Dholakia
442667434a
Merge pull request #4929 from BerriAI/litellm_vertex_mistral_cost_tracking
...
Support vertex mistral cost tracking
2024-07-27 22:38:33 -07:00
Krrish Dholakia
e0f3cd580c
fix(factory.py): support mistral ai prefix:true in messages
...
Fixes https://github.com/BerriAI/litellm/issues/4882
2024-07-27 22:30:40 -07:00
Krrish Dholakia
1ac42d8464
fix: utils.py
...
fix supported openai params
2024-07-27 22:03:40 -07:00
Krish Dholakia
e3a94ac013
Merge pull request #4925 from BerriAI/litellm_vertex_mistral
...
feat(vertex_ai_partner.py): Vertex AI Mistral Support
2024-07-27 21:51:26 -07:00
Krish Dholakia
b854d2100c
Merge branch 'main' into litellm_vertex_migration
2024-07-27 20:25:12 -07:00
Krrish Dholakia
6d5aedc48d
feat(databricks.py): support vertex mistral cost tracking
2024-07-27 20:22:35 -07:00
Ishaan Jaff
0627468455
fix checking mode on health checks
2024-07-27 20:21:39 -07:00
Ishaan Jaff
9b69e500e5
Merge pull request #4927 from BerriAI/litellm_set_max_request_response_size_ui
...
Feat Enterprise - set max request / response size UI
2024-07-27 20:06:09 -07:00
Ishaan Jaff
10e70f842d
Merge pull request #4928 from BerriAI/litellm_check_response_size
...
[Feat Enterprise] - check max response size
2024-07-27 17:03:56 -07:00
Ishaan Jaff
b2f745f0e2
Merge pull request #4926 from BerriAI/litellm_check_max_request_size
...
Proxy Enterprise - security - check max request size
2024-07-27 17:02:12 -07:00
Ishaan Jaff
3511aadf99
allow setting max request / response size on admin UI
2024-07-27 17:00:39 -07:00
Ishaan Jaff
f633f7d92d
set max_response_size_mb
2024-07-27 16:54:31 -07:00
Ishaan Jaff
b2f72338f6
feat check check_response_size_is_safe
2024-07-27 16:53:39 -07:00
Ishaan Jaff
41ca6fd52a
feat - check max response size
2024-07-27 16:53:00 -07:00
Krrish Dholakia
6f9c29d39b
fix(databricks.py): handle DONE chunk from databricks
2024-07-27 16:51:45 -07:00
Krish Dholakia
9efebc490d
Merge pull request #4730 from danielbichuetti/fireworks-fix-cost-map
...
[Feature]: Allow using custom and on-demand models in Fireworks AI + update data to model_prices_and_context_window.json
2024-07-27 16:43:48 -07:00
Krish Dholakia
f9eca63433
Merge pull request #4919 from yujonglee/fix-canary-dev
...
Fix Canary error with `docusaurus start`
2024-07-27 16:42:49 -07:00
Krrish Dholakia
a7785c624b
docs(user_keys.md): improve openai migration docs
2024-07-27 16:29:06 -07:00
Ishaan Jaff
15d488c25c
docs set max_request_size
2024-07-27 16:25:57 -07:00
