Commit graph

10042 commits

Author SHA1 Message Date
Krrish Dholakia
e4bcc51e44 build(ui): add vertex ai models via ui 2024-04-15 15:59:36 -07:00
Krish Dholakia
0d2a75d301
Merge pull request #2981 from grav/grav/default_model_name_to_none
Default model_name to None in _aembedding
2024-04-15 14:45:01 -07:00
Krish Dholakia
a4a21aff41
Merge pull request #3034 from BerriAI/litellm_team_table_fix
fix(proxy_server.py): fix /team/update endpoint
2024-04-15 14:40:12 -07:00
Krish Dholakia
45d0873e04
Merge pull request #3043 from BerriAI/litellm_dynamic_vertex_credentials
fix(vertex_ai_anthropic.py): Add vertex ai models via `/model/new`
2024-04-15 14:38:29 -07:00
Krrish Dholakia
40d9167cae test(test_amazing_vertex_completion.py): fix vertex anthropic streaming text 2024-04-15 14:37:22 -07:00
Ishaan Jaff
753fff42b7
Merge pull request #3042 from BerriAI/litellm_fix_using_wildcard_openai_models_proxy
[fix] using wildcard openai models proxy
2024-04-15 14:35:12 -07:00
Ishaan Jaff
adae555fb1
Merge branch 'main' into litellm_fix_using_wildcard_openai_models_proxy 2024-04-15 14:35:06 -07:00
Krrish Dholakia
1ec7118e1f fix(vertex_ai_anthropic.py): set vertex_credentials for vertex ai anthropic calls
allows setting vertex credentials as a json string for vertex ai anthropic calls
2024-04-15 14:16:28 -07:00
Ishaan Jaff
6df5337e65 test - wildcard openai models on proxy 2024-04-15 14:05:26 -07:00
Ishaan Jaff
020fb54ea7 fix using wildcard models on proxy 2024-04-15 14:04:37 -07:00
Ishaan Jaff
33cf173405
Merge pull request #3039 from BerriAI/litellm_team_based_logging
[Fix + Test] - Team Based logging to Langfuse
2024-04-15 14:01:18 -07:00
Ishaan Jaff
4c5bf508fc
Merge pull request #3041 from BerriAI/docs_add_team_based_langfuse
Docs -  add team based logging langfuse on langfuse proxy docs
2024-04-15 14:01:09 -07:00
Ishaan Jaff
c19d0f2e7d fix - langfuse team based logging 2024-04-15 13:38:09 -07:00
Ishaan Jaff
a5bacfa2f3 docs - team based logging on langfuse proxy docs 2024-04-15 13:35:10 -07:00
Krrish Dholakia
50081479f9 fix(main.py): accept vertex service account credentials as json string
allows us to dynamically set vertex ai credentials
2024-04-15 13:28:59 -07:00
Ishaan Jaff
ecc6aa060f test - team based logging on proxy 2024-04-15 13:26:55 -07:00
Ishaan Jaff
464d812fa9 test - team based logging 2024-04-15 13:13:51 -07:00
Krrish Dholakia
c769c3f39b bump: version 1.35.5 → 1.35.6 2024-04-15 10:51:10 -07:00
Krrish Dholakia
0683589029 fix(utils.py): fix timeout error - don't pass in httpx.request 2024-04-15 10:50:23 -07:00
Krrish Dholakia
8a32d8825c fix(proxy_server.py): fix /team/update endpoint
this also removes the functionality for modifying membership via `/team/update`. This is not considered a breaking change, as we've been pointing to usage of `/team/member_add` and `/team/member_delete` for this. Previous behaviour for this endpoint was causing it to be non-functional. If you're impacted, please let us know.
2024-04-15 10:29:21 -07:00
Ishaan Jaff
931fe035d6
Merge pull request #3033 from BerriAI/litellm_ui_show_users
[Fix] show users tab on user + fix pagination
2024-04-15 09:28:07 -07:00
Krish Dholakia
72b54eaad7
Merge pull request #3028 from BerriAI/litellm_anthropic_text_completion_fix
fix(anthropic_text.py): add support for async text completion calls
2024-04-15 09:26:28 -07:00
Ishaan Jaff
522f119c83 show users tab on user 2024-04-15 09:25:37 -07:00
Krrish Dholakia
43c37c31ea fix(proxy_server.py): return none if no model list set in router
https://github.com/BerriAI/litellm/issues/2979
2024-04-15 09:02:18 -07:00
Krrish Dholakia
dce1f5466f fix(anthropic_text.py): return process_response value 2024-04-15 08:51:26 -07:00
Ishaan Jaff
e28120a7cc
Merge pull request #3030 from BerriAI/docs_groq_tool_calling_example
Docs - add groq tool calling example
2024-04-15 08:50:04 -07:00
Ishaan Jaff
a15f61cc05
Merge pull request #3029 from BerriAI/litellm_add_groq_tool_calling
Feat - add groq tool calling + testing
2024-04-15 08:49:52 -07:00
Krrish Dholakia
ab1e26ad89 build(model_prices_and_context_window.json): add vertex ai claude 3 opus 2024-04-15 08:45:33 -07:00
Ishaan Jaff
210274e6f5 docs - groq tool calling 2024-04-15 08:42:44 -07:00
Ishaan Jaff
c8832489d6 test groq tool calling 2024-04-15 08:41:53 -07:00
Ishaan Jaff
ea575ef62d fix test groq function call 2024-04-15 08:40:39 -07:00
Ishaan Jaff
5606971bbb add "supports_function_calling": true for grow 2024-04-15 08:18:56 -07:00
Krrish Dholakia
26286a54b8 fix(anthropic_text.py): add support for async text completion calls 2024-04-15 08:15:00 -07:00
Ishaan Jaff
017127a704 test - groq tool calling 2024-04-15 08:13:05 -07:00
Ishaan Jaff
8eeae10bf2 groq - add tool calling support 2024-04-15 08:09:27 -07:00
Krrish Dholakia
bdf7f6d13c docs(text_completion_openai.md): add a separate doc on text completion openai 2024-04-15 07:19:37 -07:00
Krrish Dholakia
816c925bdd docs(grafana_metrics.md): update for monitoring system health 2024-04-13 22:25:26 -07:00
Krrish Dholakia
f351e03772 docs(grafana_metrics.md): add redis metrics to prometheus 2024-04-13 22:15:07 -07:00
Krrish Dholakia
c08d6a961a refactor(main.py): trigger new build 2024-04-13 19:35:39 -07:00
Krish Dholakia
b0b4c07e89
Merge pull request #3017 from BerriAI/litellm_prometheus_service_metrics
Litellm prometheus service metrics
2024-04-13 19:34:22 -07:00
Krrish Dholakia
67d0d5e356 fix(prometheus_services.py): add better import error statement 2024-04-13 19:03:32 -07:00
Krrish Dholakia
71580c1245 ci(config.yml): add prometheus client to circle ci for testing 2024-04-13 19:02:11 -07:00
Krrish Dholakia
bef24cd4ab fix(caching.py): don't decode a string 2024-04-13 18:48:03 -07:00
Krrish Dholakia
9f42d15713 feat(prometheus_services.py): track when redis calls fail 2024-04-13 18:31:35 -07:00
Krrish Dholakia
4e81acf2c6 feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.) 2024-04-13 18:15:02 -07:00
Ishaan Jaff
885a1eb7a3 bump: version 1.35.4 → 1.35.5 2024-04-13 18:08:57 -07:00
Ishaan Jaff
5d873e1541 ui - new build 2024-04-13 18:08:46 -07:00
Ishaan Jaff
eafd23a442
Merge pull request #3014 from BerriAI/litellm_run_health_models
Admin UI -run /health check through admin ui
2024-04-13 18:07:01 -07:00
Ishaan Jaff
db4faca3a3 v0 -run /health check through admin ui 2024-04-13 18:05:26 -07:00
Ishaan Jaff
53eb45b8f3
Merge pull request #3011 from BerriAI/litellm_edit_slack_alerting_ui
[UI] Add / Test Slack Alerting
2024-04-13 17:48:37 -07:00