Commit graph

15981 commits

Author SHA1 Message Date
Krish Dholakia
2e434d56e3
Merge pull request #5079 from BerriAI/litellm_add_pydantic_model_support
feat(utils.py): support passing response_format as pydantic model
2024-08-07 14:43:05 -07:00
Krish Dholakia
1bf1185506
Merge pull request #5095 from Mogith-P-N/main
Clarifai : Removed model name casing issue
2024-08-07 14:42:26 -07:00
Krish Dholakia
4640e925a1
Merge pull request #5091 from BerriAI/litellm_anthropic_streaming_tool_call_fix
fix(anthropic.py): handle anthropic returning empty argument string (invalid json str) for tool call while streaming
2024-08-07 14:33:42 -07:00
Krish Dholakia
93d048b1dc
Merge branch 'main' into litellm_anthropic_streaming_tool_call_fix 2024-08-07 14:33:30 -07:00
Krrish Dholakia
55ad5bb7c6 fix(config.yml): fix build and test 2024-08-07 13:23:04 -07:00
Krrish Dholakia
c0ef2e9dd0 fix(main.py): fix linting error for python3.8 2024-08-07 13:21:35 -07:00
Krrish Dholakia
37dc359efb fix(utils.py): fix linting error for python3.8 2024-08-07 13:14:29 -07:00
Ishaan Jaff
0b98959e6d gemini test skip internal server error 2024-08-07 13:12:45 -07:00
Krrish Dholakia
a2e792d32e test: update build requirements 2024-08-07 13:09:49 -07:00
Krish Dholakia
3605e873a1
Merge branch 'main' into litellm_add_pydantic_model_support 2024-08-07 13:07:46 -07:00
Krrish Dholakia
f0f900d69e fix(router.py): add reason for fallback failure to client-side exception string
make it easier to debug why a fallback failed to occur
2024-08-07 13:02:47 -07:00
Ishaan Jaff
1bf36cd7a4 docs prom metrics 2024-08-07 12:50:03 -07:00
Ishaan Jaff
61ccd5354b docs prometheus 2024-08-07 12:47:06 -07:00
Ishaan Jaff
958e0fdfab show warning about prometheus moving to enterprise 2024-08-07 12:46:26 -07:00
Ishaan Jaff
80acc7ecfe
Merge pull request #5088 from BerriAI/litellm_init_prom_svc_logger
[Fix] Init Prometheus Service Logger when it's None
2024-08-07 12:40:08 -07:00
Ishaan Jaff
3f9d37c596
Merge pull request #5092 from BerriAI/litellm_prom_metrics_llms
[Feat] - Prometheus Metrics to monitor a model health
2024-08-07 12:39:38 -07:00
Ishaan Jaff
72aebe5e59 docs link to enteprise pricing 2024-08-07 12:10:47 -07:00
Ishaan Jaff
8d1f051d8c docs prometheus 2024-08-07 11:37:05 -07:00
Ishaan Jaff
579f09b334 fix logging cool down deployment 2024-08-07 11:27:05 -07:00
Krrish Dholakia
ff386f6b60 fix(utils.py): support deepseek tool calling
Fixes https://github.com/BerriAI/litellm/issues/5081
2024-08-07 11:14:05 -07:00
Krrish Dholakia
2f402b1cdd fix(vertex_ai_partner.py): default vertex ai llama3.1 api to use all openai params
Poor vertex docs - not clear what can/can't work

Fixes https://github.com/BerriAI/litellm/issues/5090
2024-08-07 11:08:54 -07:00
Ishaan Jaff
d1e519afd1 use router_cooldown_handler 2024-08-07 10:40:55 -07:00
Ishaan Jaff
99ecde7744 allow setting outage metrics 2024-08-07 10:36:18 -07:00
Krrish Dholakia
3646e3e3a4 test(test_completion.py): handle internal server error in test 2024-08-07 10:21:37 -07:00
Krrish Dholakia
3cf9148a4a test: add vertex claude to streaming valid json str test 2024-08-07 10:18:17 -07:00
Mogith P N
e66aa1487d Clarifai : Fixed model name 2024-08-07 16:59:33 +00:00
Ishaan Jaff
9a8fa9f047 emit deployment_partial_outage on prometheus 2024-08-07 09:56:01 -07:00
Krrish Dholakia
2ccb5a48b7 fix(bedrock_httpx.py): handle empty arguments returned during tool calling streaming 2024-08-07 09:54:50 -07:00
Ishaan Jaff
0304513b67 rename to set_llm_deployment_success_metrics 2024-08-07 09:46:08 -07:00
Ishaan Jaff
13d1caf94a add set_remaining_tokens_requests_metric 2024-08-07 09:43:35 -07:00
Krrish Dholakia
4919cc4d25 fix(anthropic.py): handle scenario where anthropic returns invalid json string for tool call while streaming
Fixes https://github.com/BerriAI/litellm/issues/5063
2024-08-07 09:24:11 -07:00
Ishaan Jaff
315bba34e6 prom svc logger init if it's None 2024-08-07 09:02:03 -07:00
Ishaan Jaff
7e0cd39de7
Merge pull request #5086 from BerriAI/litellm_or_headers
[Fix-Bug]: Using extra_headers removes the OpenRouter HTTP-Referer/X-Title headers
2024-08-07 08:27:07 -07:00
Ishaan Jaff
dc3cdf3ed8 fix use extra headers for open router 2024-08-07 08:15:05 -07:00
Krrish Dholakia
1008f24b16 build(requirements.txt): bump openai version 2024-08-07 08:08:37 -07:00
Ishaan Jaff
975eec8777
Merge pull request #5084 from BerriAI/litellm_add_gpt4o
add ft:gpt-4o-mini-2024-07-18 to model prices
2024-08-07 08:05:14 -07:00
Ishaan Jaff
2e6ba1c27c
Merge pull request #5085 from BerriAI/revert-4640-main
Revert "Fix: Add prisma binary_cache_dir specification to pyproject.toml"
2024-08-07 07:54:15 -07:00
Ishaan Jaff
64df195fe8
Revert "Fix: Add prisma binary_cache_dir specification to pyproject.toml" 2024-08-07 07:50:05 -07:00
Ishaan Jaff
5743640250 feat add ft:gpt-4o-mini-2024-07-18 2024-08-07 07:46:23 -07:00
Krrish Dholakia
a0bb89a372 docs(ui.md): add restrict email subdomains w/ sso 2024-08-06 22:54:33 -07:00
Krrish Dholakia
bc8857ca23 build(model_prices_and_context_window.json): remove duplicate entries 2024-08-06 22:50:41 -07:00
Krish Dholakia
405f496962
Merge pull request #5076 from BerriAI/litellm_support_lakera_config_thresholds
LLM Guardrails - Support lakera config thresholds + custom api base
2024-08-06 22:47:22 -07:00
Krish Dholakia
c82fc0cac2
Merge branch 'main' into litellm_support_lakera_config_thresholds 2024-08-06 22:47:13 -07:00
Ishaan Jaff
3e84014a69 run ci / cd again 2024-08-06 21:35:46 -07:00
Ishaan Jaff
f579aef740 ci/cd run again 2024-08-06 21:28:22 -07:00
Ishaan Jaff
0d76f49ea6 docs run ui on custom server root path 2024-08-06 21:27:47 -07:00
Ishaan Jaff
56f110cd04 test test_basic_passthrough 2024-08-06 21:17:07 -07:00
Ishaan Jaff
ab920ab461 fix pass through endpoint tests 2024-08-06 21:16:07 -07:00
Ishaan Jaff
d6db6f3ee6
Merge pull request #5078 from BerriAI/litellm_fwd_server_root_path
UI - fwd UI requests from server root path
2024-08-06 20:59:21 -07:00
Ishaan Jaff
7173cef822 clean up unused func 2024-08-06 20:58:51 -07:00