Commit graph

15335 commits

Author SHA1 Message Date
Ishaan Jaff
3d88d7f750 ui - allow entering custom model names 2024-07-29 15:51:13 -07:00
Ishaan Jaff
b0da3f12e8
Merge pull request #4950 from BerriAI/dependabot/npm_and_yarn/docs/my-website/fast-xml-parser-4.4.1
build(deps): bump fast-xml-parser from 4.3.2 to 4.4.1 in /docs/my-website
2024-07-29 15:10:07 -07:00
Ishaan Jaff
e031359e67
Merge pull request #4946 from BerriAI/litellm_Add_bedrock_guardrail_config
[Feat] Bedrock add support for Bedrock Guardrails
2024-07-29 15:09:56 -07:00
Krish Dholakia
6bdb9203b3
Merge pull request #4948 from dleen/response
fixes: #4947 Bedrock context exception does not have a response
2024-07-29 15:03:40 -07:00
dependabot[bot]
9cb3235d98
build(deps): bump fast-xml-parser in /docs/my-website
Bumps [fast-xml-parser](https://github.com/NaturalIntelligence/fast-xml-parser) from 4.3.2 to 4.4.1.
- [Release notes](https://github.com/NaturalIntelligence/fast-xml-parser/releases)
- [Changelog](https://github.com/NaturalIntelligence/fast-xml-parser/blob/master/CHANGELOG.md)
- [Commits](https://github.com/NaturalIntelligence/fast-xml-parser/compare/v4.3.2...v4.4.1)

---
updated-dependencies:
- dependency-name: fast-xml-parser
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-07-29 21:41:45 +00:00
Ishaan Jaff
3ce0cac56d docs guardrailConfig 2024-07-29 14:26:46 -07:00
David Leen
ebca13b2ca fixes: #4947 Bedrock context exception does not have a response 2024-07-29 14:23:56 -07:00
Ishaan Jaff
21963e0bbe proxy server 2024-07-29 14:22:02 -07:00
Ishaan Jaff
7cac1b0dce docs - Bedrock Guardrails 2024-07-29 14:18:42 -07:00
Ishaan Jaff
46555ab78b test - bedrock guardrailConfig 2024-07-29 14:13:08 -07:00
Ishaan Jaff
5154ec51a3 feat - support guardrailConfig 2024-07-29 14:10:09 -07:00
Ishaan Jaff
3eaa1fa217 types add GuardrailConfigBlock 2024-07-29 13:14:53 -07:00
Krrish Dholakia
ae4bcd8a41 fix(utils.py): fix trim_messages to handle tool calling
Fixes https://github.com/BerriAI/litellm/issues/4931
2024-07-29 13:04:41 -07:00
Krrish Dholakia
dd2d61bfce build(pre-commit.yaml): update 2024-07-29 12:29:56 -07:00
Krrish Dholakia
59384c84a5 fix(utils.py): correctly re-raise azure api connection error
'
2024-07-29 12:28:25 -07:00
Krish Dholakia
63531a9824
Merge pull request #4943 from dleen/logs
Fix: #4942. Remove verbose logging when exception can be handled
2024-07-29 12:12:28 -07:00
David Leen
452441ae03 Fix: #4942. Remove verbose logging when exception can be handled 2024-07-29 12:05:10 -07:00
Krrish Dholakia
66dbd938e8 fix(exceptions.py): use correct status code for content policy exceptions
Fixes https://github.com/BerriAI/litellm/issues/4941#issuecomment-2256578732
2024-07-29 12:01:54 -07:00
Krrish Dholakia
52b1ca292c fix(utils.py): check if tools is iterable before indexing into it
Fixes https://github.com/BerriAI/litellm/issues/4933
2024-07-29 09:01:32 -07:00
Ishaan Jaff
a2939c2f08
Merge pull request #4939 from BerriAI/litellm_log_transcription_resp_langfuse
[Feat-Proxy] - Langfuse log /audio/transcription on langfuse
2024-07-29 08:58:40 -07:00
Ishaan Jaff
285925e10a log output from /audio on langfuse 2024-07-29 08:21:22 -07:00
Krrish Dholakia
31445ab20a fix(caching.py): support /completion caching by default
updates supported call types in redis cache to cover text_completion caching
2024-07-29 08:19:30 -07:00
Ishaan Jaff
ec28e8e630 test - logging litellm-atranscription 2024-07-29 08:17:19 -07:00
Ishaan Jaff
95f063f978 fix default input/output values for /audio/trancription logging 2024-07-29 08:03:08 -07:00
Ishaan Jaff
b2fcf65653 log file_size_in_mb in metadata 2024-07-29 08:00:28 -07:00
Krrish Dholakia
92b539b42a fix(auth_checks.py): handle writing team object to redis caching correctly 2024-07-29 07:51:44 -07:00
Krrish Dholakia
21eea28723 docs(vertex.md): add mistral api to docs 2024-07-27 22:44:15 -07:00
Krish Dholakia
442667434a
Merge pull request #4929 from BerriAI/litellm_vertex_mistral_cost_tracking
Support vertex mistral cost tracking
2024-07-27 22:38:33 -07:00
Krrish Dholakia
e0f3cd580c fix(factory.py): support mistral ai prefix:true in messages
Fixes https://github.com/BerriAI/litellm/issues/4882
2024-07-27 22:30:40 -07:00
Krish Dholakia
e3a94ac013
Merge pull request #4925 from BerriAI/litellm_vertex_mistral
feat(vertex_ai_partner.py): Vertex AI Mistral Support
2024-07-27 21:51:26 -07:00
Krrish Dholakia
6d5aedc48d feat(databricks.py): support vertex mistral cost tracking 2024-07-27 20:22:35 -07:00
Ishaan Jaff
0627468455 fix checking mode on health checks 2024-07-27 20:21:39 -07:00
Ishaan Jaff
9b69e500e5
Merge pull request #4927 from BerriAI/litellm_set_max_request_response_size_ui
Feat Enterprise -  set max request  / response size UI
2024-07-27 20:06:09 -07:00
Ishaan Jaff
10e70f842d
Merge pull request #4928 from BerriAI/litellm_check_response_size
[Feat Enterprise] - check max response size
2024-07-27 17:03:56 -07:00
Ishaan Jaff
b2f745f0e2
Merge pull request #4926 from BerriAI/litellm_check_max_request_size
Proxy Enterprise - security - check max request size
2024-07-27 17:02:12 -07:00
Ishaan Jaff
3511aadf99 allow setting max request / response size on admin UI 2024-07-27 17:00:39 -07:00
Ishaan Jaff
f633f7d92d set max_response_size_mb 2024-07-27 16:54:31 -07:00
Ishaan Jaff
b2f72338f6 feat check check_response_size_is_safe 2024-07-27 16:53:39 -07:00
Ishaan Jaff
41ca6fd52a feat - check max response size 2024-07-27 16:53:00 -07:00
Krrish Dholakia
6f9c29d39b fix(databricks.py): handle DONE chunk from databricks 2024-07-27 16:51:45 -07:00
Krish Dholakia
9efebc490d
Merge pull request #4730 from danielbichuetti/fireworks-fix-cost-map
[Feature]: Allow using custom and on-demand models in Fireworks AI + update data to model_prices_and_context_window.json
2024-07-27 16:43:48 -07:00
Krish Dholakia
f9eca63433
Merge pull request #4919 from yujonglee/fix-canary-dev
Fix Canary error with `docusaurus start`
2024-07-27 16:42:49 -07:00
Krrish Dholakia
a7785c624b docs(user_keys.md): improve openai migration docs 2024-07-27 16:29:06 -07:00
Ishaan Jaff
15d488c25c docs set max_request_size 2024-07-27 16:25:57 -07:00
Krrish Dholakia
c5ee6fe4b9 build: cookbook on migrating to litellm proxy from openai/azure sdk 2024-07-27 16:09:50 -07:00
Ishaan Jaff
4ab8d2229d security - check max request size 2024-07-27 16:08:41 -07:00
Ishaan Jaff
2e9fb5ca1f
Merge pull request #4924 from BerriAI/litellm_log_writing_spend_to_db_otel
[Feat] - log writing BatchSpendUpdate events on OTEL
2024-07-27 16:07:56 -07:00
Krrish Dholakia
d1989b6063 fix(utils.py): support fireworks ai finetuned models
Fixes https://github.com/BerriAI/litellm/issues/4923
2024-07-27 15:38:27 -07:00
Krrish Dholakia
f76cad210c fix(utils.py): support fireworks ai finetuned models
Fixes https://github.com/BerriAI/litellm/issues/4923
2024-07-27 15:37:28 -07:00
Krrish Dholakia
c85ed01756 feat(utils.py): fix openai-like streaming 2024-07-27 15:32:57 -07:00