Idris Mokhtarzada
9b89280a90
Use underscores
...
Datadog does not play nice with special characters (as in "(seconds)"). Also just makes sense to standardize on either underscores or camelCase, but not mix-and-match.
2024-07-26 16:38:54 -04:00
Krrish Dholakia
9943c6d607
fix(proxy_server.py): fix get secret for environment_variables
2024-07-26 13:33:02 -07:00
Krrish Dholakia
b515d4f441
docs(stream.md): add streaming token usage info to docs
...
Closes https://github.com/BerriAI/litellm/issues/4904
2024-07-26 10:51:17 -07:00
Krrish Dholakia
9a6ed8cabb
fix(bedrock_httpx.py): fix streaming error message
...
Fixes https://github.com/BerriAI/litellm/issues/4900
2024-07-26 10:42:47 -07:00
Krish Dholakia
67115a56c0
Merge pull request #4869 from maamalama/anthropic-tools
...
Fixed tool_call for Helicone integration
2024-07-26 10:42:10 -07:00
Krrish Dholakia
7ca29d987d
docs(docusaurus.config.js): add llm model cost map to docs
2024-07-26 10:07:47 -07:00
Krrish Dholakia
84482703b8
docs(config.md): update wildcard docs
2024-07-26 08:59:53 -07:00
Krrish Dholakia
1d6c39a607
feat(proxy_server.py): handle pydantic mockselvar error
...
Fixes https://github.com/BerriAI/litellm/issues/4898#issuecomment-2252105485
2024-07-26 08:38:51 -07:00
Krish Dholakia
35737d04d3
Merge pull request #4893 from yujonglee/canary
...
[Docs] Better search experience with Canary
2024-07-26 08:34:54 -07:00
yujonglee
10ffb5a960
remove ui shift on reload
2024-07-26 22:13:04 +09:00
yujonglee
8a45abb563
fix import and add fallback
2024-07-26 22:00:48 +09:00
yujonglee
c54f23f936
wrap existing search bar
2024-07-26 21:46:36 +09:00
yujonglee
3967007595
update to latest
2024-07-26 21:06:53 +09:00
Krrish Dholakia
afcad9e12c
docs(custom_llm_server.md): cleanup docs
2024-07-25 22:45:03 -07:00
Krrish Dholakia
ce210ddaf6
fix(vertex_ai_llama3.py): Fix llama3 streaming issue
...
Closes https://github.com/BerriAI/litellm/issues/4885
2024-07-25 22:30:55 -07:00
Krrish Dholakia
0ce5a7962e
bump: version 1.42.2 → 1.42.3
2024-07-25 22:18:17 -07:00
Krrish Dholakia
2f773d9cb6
fix(litellm_cost_calc/google.py): support meta llama vertex ai cost tracking
2024-07-25 22:12:07 -07:00
Ishaan Jaff
2626cc6d30
bump: version 1.42.1 → 1.42.2
2024-07-25 20:16:05 -07:00
Ishaan Jaff
24fb6fc28d
Merge pull request #4891 from BerriAI/litellm_proxy_support_all_providers
...
[Feat] Support /* for multiple providers
2024-07-25 20:15:42 -07:00
Ishaan Jaff
079a41fbe1
Merge branch 'main' into litellm_proxy_support_all_providers
2024-07-25 20:15:37 -07:00
Ishaan Jaff
4bf9681df4
Update README.md
2024-07-25 20:12:32 -07:00
Ishaan Jaff
4d513e0b5f
Merge pull request #4897 from BerriAI/docs_add_example_using_anthropic_sdk
...
Docs add example using anthropic sdk with litellm proxy
2024-07-25 20:11:16 -07:00
yujonglee
b6bcb7eb3c
update lock
2024-07-26 12:10:05 +09:00
Ishaan Jaff
50bf488b58
read me link to using litellm
2024-07-25 20:10:02 -07:00
Ishaan Jaff
9247fc3c64
deploy link to using litellm
2024-07-25 20:09:49 -07:00
yujonglee
a540c23730
improvements
2024-07-26 12:08:46 +09:00
Ishaan Jaff
c2e309baf3
docs using litellm proxy
2024-07-25 20:05:28 -07:00
Ishaan Jaff
87cebdefd3
Merge pull request #4896 from BerriAI/docs_add_example_usage_with_mistral_python
...
Docs Proxy - add example usage with mistral SDK with Proxy
2024-07-25 20:02:26 -07:00
Krrish Dholakia
826bb125e8
test(test_router.py): handle azure api instability
2024-07-25 19:54:40 -07:00
Ishaan Jaff
646b2d50f9
docs -quick start
2024-07-25 19:52:53 -07:00
Krrish Dholakia
a2fd8459fc
fix(utils.py): don't raise error on openai content filter during streaming - return as is
...
Fixes issue where we would raise an error vs. openai who return the chunk with finish reason as 'content_filter'
2024-07-25 19:50:52 -07:00
Ishaan Jaff
68e94f0976
example mistral sdk
2024-07-25 19:48:54 -07:00
Ishaan Jaff
bb6f72b315
add mistral sdk usage
2024-07-25 19:47:54 -07:00
David Manouchehri
533426e876
Add mistral.mistral-large-2407-v1:0 on Amazon Bedrock.
2024-07-25 19:36:18 -07:00
fracapuano
c86f8e1eb4
fix: now supports single tokens prediction
2024-07-25 19:35:52 -07:00
Krrish Dholakia
a190bc750f
fix(custom_llm.py): pass input params to custom llm
2024-07-25 19:35:52 -07:00
Krrish Dholakia
f5fd9bd3ce
feat(proxy_server.py): support custom llm handler on proxy
2024-07-25 19:35:52 -07:00
Krrish Dholakia
acda75b96f
docs(custom_llm_server.md): add calling custom llm server to docs
2024-07-25 19:35:48 -07:00
Krrish Dholakia
3b8f357af4
feat(utils.py): support async streaming for custom llm provider
2024-07-25 19:35:48 -07:00
Krrish Dholakia
8c12f7f820
feat(utils.py): support sync streaming for custom llm provider
2024-07-25 19:35:48 -07:00
Krrish Dholakia
7a5c1e7599
fix(custom_llm.py): support async completion calls
2024-07-25 19:35:48 -07:00
Krrish Dholakia
b9b0612c79
feat(custom_llm.py): initial working commit for writing your own custom LLM handler
...
Fixes https://github.com/BerriAI/litellm/issues/4675
Also Addresses https://github.com/BerriAI/litellm/discussions/4677
2024-07-25 19:35:48 -07:00
Ishaan Jaff
7d68536763
docs - add info about routing strategy on load balancing docs
2024-07-25 19:35:48 -07:00
Ishaan Jaff
fe3c57e1c1
feat support audio health checks for azure
2024-07-25 19:35:48 -07:00
Ishaan Jaff
5ff0e47f22
docs add example on using text to speech models
2024-07-25 19:35:48 -07:00
Ishaan Jaff
1a89f9e86d
feat - support health check audio_speech
2024-07-25 19:35:48 -07:00
Ishaan Jaff
734d0c3643
fix whisper health check with litellm
2024-07-25 19:35:48 -07:00
Krrish Dholakia
c23cf1ecc5
fix(router.py): add support for diskcache to router
2024-07-25 19:35:48 -07:00
Krrish Dholakia
a5ecf6b1c1
fix(proxy_server.py): check if input list > 0 before indexing into it
...
resolves 'list index out of range' error
2024-07-25 19:35:48 -07:00
David Manouchehri
fb1a805959
Check for converse support first.
2024-07-25 19:35:40 -07:00
