Commit graph

17204 commits

Author SHA1 Message Date
Ishaan Jaff
16d595c4ff test cancel cancel_fine_tuning_job 2024-07-29 19:22:41 -07:00
Ishaan Jaff
3802eaa6b5 feat - add cancel_fine_tuning_job 2024-07-29 19:22:23 -07:00
Ishaan Jaff
3e3f9e3f0c add test_create_fine_tune_job 2024-07-29 18:59:55 -07:00
Ishaan Jaff
5123bf4e75 add types for FineTuningJobCreate OpenAI 2024-07-29 18:59:44 -07:00
Ishaan Jaff
1202e1c645 add acreate_fine_tuning_job 2024-07-29 18:59:29 -07:00
Ishaan Jaff
59fc3ba649 add create_fine_tuning 2024-07-29 18:57:29 -07:00
Ishaan Jaff
130815bb93 add litellm.create_fine_tuning_job 2024-07-29 18:42:42 -07:00
Krrish Dholakia
528741a809 fix(factory.py): handle special keys for mistral chat template 2024-07-29 17:47:44 -07:00
Ishaan Jaff
c3ac6b098e fix linting error - cohere_chat 2024-07-29 17:19:28 -07:00
Ishaan Jaff
1a34756159
Merge pull request #4916 from BerriAI/litellm_fix_ui_login
Feat UI - allow using custom header for litellm api key
2024-07-29 17:08:53 -07:00
Ishaan Jaff
0c25aaf9df check litellm header in login on ui 2024-07-29 17:03:04 -07:00
Ishaan Jaff
fc096ee9e0
Merge pull request #4949 from pat-cohere/patch-1
Fix bug in cohere_chat.py
2024-07-29 17:01:40 -07:00
Ishaan Jaff
f25ed92ee2 better debugging for custom headers 2024-07-29 16:59:15 -07:00
Ishaan Jaff
d71dc1acaf ui use setGlobalLitellmHeaderName 2024-07-29 16:58:56 -07:00
Ishaan Jaff
5633c11615
Merge pull request #4951 from BerriAI/ui_allow_custom_model_azure_ai
ui - allow entering custom model names for all all provider (azure ai, openai, etc)
2024-07-29 15:54:33 -07:00
Ishaan Jaff
3d88d7f750 ui - allow entering custom model names 2024-07-29 15:51:13 -07:00
Krrish Dholakia
7f0daafc56 docs(main.py): update acompletion_with_retries docstring
Closes https://github.com/BerriAI/litellm/issues/4908
2024-07-29 15:50:12 -07:00
Krrish Dholakia
8e24c3c945 build(model_prices_and_context_window.json): update model info for llama3.1 on bedrock - supports tool calling, not tool choice 2024-07-29 15:43:16 -07:00
Ishaan Jaff
b0da3f12e8
Merge pull request #4950 from BerriAI/dependabot/npm_and_yarn/docs/my-website/fast-xml-parser-4.4.1
build(deps): bump fast-xml-parser from 4.3.2 to 4.4.1 in /docs/my-website
2024-07-29 15:10:07 -07:00
Ishaan Jaff
e031359e67
Merge pull request #4946 from BerriAI/litellm_Add_bedrock_guardrail_config
[Feat] Bedrock add support for Bedrock Guardrails
2024-07-29 15:09:56 -07:00
Krish Dholakia
6bdb9203b3
Merge pull request #4948 from dleen/response
fixes: #4947 Bedrock context exception does not have a response
2024-07-29 15:03:40 -07:00
dependabot[bot]
9cb3235d98
build(deps): bump fast-xml-parser in /docs/my-website
Bumps [fast-xml-parser](https://github.com/NaturalIntelligence/fast-xml-parser) from 4.3.2 to 4.4.1.
- [Release notes](https://github.com/NaturalIntelligence/fast-xml-parser/releases)
- [Changelog](https://github.com/NaturalIntelligence/fast-xml-parser/blob/master/CHANGELOG.md)
- [Commits](https://github.com/NaturalIntelligence/fast-xml-parser/compare/v4.3.2...v4.4.1)

---
updated-dependencies:
- dependency-name: fast-xml-parser
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-07-29 21:41:45 +00:00
Ishaan Jaff
3ce0cac56d docs guardrailConfig 2024-07-29 14:26:46 -07:00
pat-cohere
972df1f303
Update cohere_chat.py 2024-07-29 17:26:07 -04:00
David Leen
ebca13b2ca fixes: #4947 Bedrock context exception does not have a response 2024-07-29 14:23:56 -07:00
pat-cohere
1ee8051c7c
Update cohere_chat.py
Add chat history to cohere chat call that was previously being dropped.
2024-07-29 17:23:04 -04:00
Ishaan Jaff
21963e0bbe proxy server 2024-07-29 14:22:02 -07:00
Ishaan Jaff
7cac1b0dce docs - Bedrock Guardrails 2024-07-29 14:18:42 -07:00
Ishaan Jaff
46555ab78b test - bedrock guardrailConfig 2024-07-29 14:13:08 -07:00
Ishaan Jaff
5154ec51a3 feat - support guardrailConfig 2024-07-29 14:10:09 -07:00
Ishaan Jaff
3eaa1fa217 types add GuardrailConfigBlock 2024-07-29 13:14:53 -07:00
Krrish Dholakia
ae4bcd8a41 fix(utils.py): fix trim_messages to handle tool calling
Fixes https://github.com/BerriAI/litellm/issues/4931
2024-07-29 13:04:41 -07:00
Krrish Dholakia
dd2d61bfce build(pre-commit.yaml): update 2024-07-29 12:29:56 -07:00
Krrish Dholakia
59384c84a5 fix(utils.py): correctly re-raise azure api connection error
'
2024-07-29 12:28:25 -07:00
Krish Dholakia
63531a9824
Merge pull request #4943 from dleen/logs
Fix: #4942. Remove verbose logging when exception can be handled
2024-07-29 12:12:28 -07:00
David Leen
452441ae03 Fix: #4942. Remove verbose logging when exception can be handled 2024-07-29 12:05:10 -07:00
Krrish Dholakia
66dbd938e8 fix(exceptions.py): use correct status code for content policy exceptions
Fixes https://github.com/BerriAI/litellm/issues/4941#issuecomment-2256578732
2024-07-29 12:01:54 -07:00
Krrish Dholakia
52b1ca292c fix(utils.py): check if tools is iterable before indexing into it
Fixes https://github.com/BerriAI/litellm/issues/4933
2024-07-29 09:01:32 -07:00
Ishaan Jaff
a2939c2f08
Merge pull request #4939 from BerriAI/litellm_log_transcription_resp_langfuse
[Feat-Proxy] - Langfuse log /audio/transcription on langfuse
2024-07-29 08:58:40 -07:00
Ishaan Jaff
285925e10a log output from /audio on langfuse 2024-07-29 08:21:22 -07:00
Krrish Dholakia
31445ab20a fix(caching.py): support /completion caching by default
updates supported call types in redis cache to cover text_completion caching
2024-07-29 08:19:30 -07:00
Ishaan Jaff
ec28e8e630 test - logging litellm-atranscription 2024-07-29 08:17:19 -07:00
Ishaan Jaff
95f063f978 fix default input/output values for /audio/trancription logging 2024-07-29 08:03:08 -07:00
Ishaan Jaff
b2fcf65653 log file_size_in_mb in metadata 2024-07-29 08:00:28 -07:00
Krrish Dholakia
92b539b42a fix(auth_checks.py): handle writing team object to redis caching correctly 2024-07-29 07:51:44 -07:00
Ravi N
b321f2988b Allow zero temperature for Sagemaker models based on config
Since Sagemaker can host any kind of model, some models allow
zero temperature. However, this is not enabled by default and
only allowed based on config
2024-07-28 21:55:53 -04:00
Krrish Dholakia
21eea28723 docs(vertex.md): add mistral api to docs 2024-07-27 22:44:15 -07:00
Krish Dholakia
442667434a
Merge pull request #4929 from BerriAI/litellm_vertex_mistral_cost_tracking
Support vertex mistral cost tracking
2024-07-27 22:38:33 -07:00
Krrish Dholakia
e0f3cd580c fix(factory.py): support mistral ai prefix:true in messages
Fixes https://github.com/BerriAI/litellm/issues/4882
2024-07-27 22:30:40 -07:00
Krrish Dholakia
1ac42d8464 fix: utils.py
fix supported openai params
2024-07-27 22:03:40 -07:00