frob
5fb5bce780
Merge branch 'BerriAI:main' into ollama-special-symbol
2024-04-20 00:49:57 +02:00
Krrish Dholakia
62a8bf134f
fix(http_handler.py): fix linting error
2024-04-19 15:45:24 -07:00
Krish Dholakia
dc932ac518
Merge pull request #3174 from jmandel/fix-claude-streaming
...
fix: Stream completion responses from anthropic. (Fix #3129 )
2024-04-19 15:37:29 -07:00
Ishaan Jaff
48e5de4f0e
Merge pull request #3175 from BerriAI/litellm_log_team_alias_langfuse
...
[FEAT] Log team alias to langfuse
2024-04-19 15:30:59 -07:00
Ishaan Jaff
c7b0d59bdc
Merge pull request #3180 from BerriAI/ui_create_user_flow
...
[UI] Show teams as dropdown in invite user flow
2024-04-19 15:27:27 -07:00
Ishaan Jaff
5613f9b30a
UI - invite user flow
2024-04-19 15:26:29 -07:00
Ishaan Jaff
5d9f6282ce
create_user using user_email
2024-04-19 15:17:50 -07:00
Ishaan Jaff
559a312c9c
ui - show teams as dropdown in create user flow
2024-04-19 15:07:13 -07:00
Ishaan Jaff
3167c9da9f
fix - use user_api_key_team_alias as the default tag on langfuse
2024-04-19 14:43:41 -07:00
Ishaan Jaff
f220a337bd
Merge pull request #3176 from BerriAI/add_llama3_groq
...
[FEAT] Add `groq/llama3`
2024-04-19 14:40:10 -07:00
Ishaan Jaff
e8de984b38
docs - add groq llama3
2024-04-19 14:34:45 -07:00
Ishaan Jaff
12bf4346ec
feat - add llama3 on groq
2024-04-19 14:34:38 -07:00
Ishaan Jaff
410d1f2d2c
langfuse - log team alias
2024-04-19 14:26:58 -07:00
Josh Mandel
f411443e58
fix: Stream completion responses from anthropic. (Fix 3129)
2024-04-19 16:13:19 -05:00
Krrish Dholakia
3c6b6355c7
fix(ollama_chat.py): accept api key as a param for ollama calls
...
allows user to call hosted ollama endpoint using bearer token for auth
2024-04-19 13:02:13 -07:00
frob
3df7231fa5
Disable special tokens in ollama completion when counting tokens
...
Some(?) models (eg, codegemma) don't return a prompt_eval_count field, so ollama.py tries to compute the value based on encoding of the prompt. Unfortunately FIM symbols used in the prompt (eg, "<|fim_prefix|>") cause the encoder to throw an exception, so we disable special processing.
2024-04-19 21:38:42 +02:00
Ishaan Jaff
423121ff7d
feat - track team_alias is metadata for /chat, /embeddings
2024-04-19 10:52:54 -07:00
Ishaan Jaff
6d92b13c22
feat - log team_alias to langfuse
2024-04-19 10:29:42 -07:00
Ishaan Jaff
b2bdc99474
Merge pull request #2961 from Manouchehri/langfuse-add-region-2937
...
(feat) Langfuse - Add location logging, and add cache_hit to metadata.
2024-04-19 10:06:34 -07:00
Krrish Dholakia
717abfef98
build(interpret_load_test.py): add hosted proxy info on release notes
2024-04-18 22:40:10 -07:00
Krrish Dholakia
d10743a609
bump: version 1.35.14 → 1.35.15
2024-04-18 22:17:33 -07:00
Krrish Dholakia
9e91541b8a
refactor(main.py): trigger new build
2024-04-18 22:17:19 -07:00
Krish Dholakia
f1340b52dc
Merge pull request #3153 from BerriAI/litellm_usage_based_routing_v2_improvements
...
usage based routing v2 improvements - unit testing + *NEW* async + sync 'pre_call_checks'
2024-04-18 22:16:16 -07:00
Krrish Dholakia
9c42c847a5
fix(router.py): instrument pre-call-checks for all openai endpoints
2024-04-18 21:54:25 -07:00
Krrish Dholakia
3b9e2a58e2
fix(lowest_tpm_rpm_v2.py): ensure backwards compatibility for python 3.8
2024-04-18 21:42:35 -07:00
Krrish Dholakia
81573b2dd9
fix(test_lowest_tpm_rpm_routing_v2.py): unit testing for usage-based-routing-v2
2024-04-18 21:38:00 -07:00
Ishaan Jaff
c903b44849
(ci/cd) vertexai - skip 429 errors
2024-04-18 21:27:22 -07:00
Ishaan Jaff
cb053398eb
(ci/cd) run again
2024-04-18 21:04:07 -07:00
Ishaan Jaff
c720c8ffe9
Merge pull request #3152 from BerriAI/litellm_show_api_base_hanging_req
...
[Fix] show api base hanging request alerts
2024-04-18 21:02:30 -07:00
Ishaan Jaff
6f948cd559
fix - show api_base in hanging requests
2024-04-18 21:01:26 -07:00
Ishaan Jaff
67d356b933
fix - show api base on hanging requests
2024-04-18 20:58:02 -07:00
Ishaan Jaff
f04604910b
fix - show api base on hanging requests
2024-04-18 20:57:22 -07:00
Ishaan Jaff
8c830e031d
(ci/cd) run again
2024-04-18 20:35:21 -07:00
Ishaan Jaff
7d2fb6da04
bump: version 1.35.13 → 1.35.14
2024-04-18 20:23:58 -07:00
Ishaan Jaff
5b55900d8e
fix - view spend per user
2024-04-18 20:23:04 -07:00
Ishaan Jaff
e95e7fde65
ui - new build
2024-04-18 20:18:50 -07:00
Ishaan Jaff
0ed5cfc9de
Merge pull request #3151 from BerriAI/litellm_allow_set_get_alerts
...
[UI] View all alert types
2024-04-18 20:12:54 -07:00
Ishaan Jaff
9073960c00
Merge pull request #3148 from BerriAI/ui_show_keys_in_users_page
...
ui - show key_aliases on `Users` Tab
2024-04-18 20:11:47 -07:00
Ishaan Jaff
01b1136631
fix - GetLLMProvider excepton error raise
2024-04-18 20:10:37 -07:00
Ishaan Jaff
554c83fdaf
ui - show all alert types when getting all callbacks
2024-04-18 20:08:13 -07:00
Ishaan Jaff
48e53984c0
ui - show all alert types
2024-04-18 20:04:34 -07:00
Krrish Dholakia
a05f148c17
fix(tpm_rpm_routing_v2.py): fix tpm rpm routing
2024-04-18 20:01:22 -07:00
Ishaan Jaff
825622d120
Merge pull request #3149 from BerriAI/ui_clean_up_models
...
[UI] - Models Page - Place litellm params in an accordion
2024-04-18 19:49:00 -07:00
Ishaan Jaff
dd92c94788
ui - place litellm params in an accordion
2024-04-18 19:22:34 -07:00
Krish Dholakia
77a353d484
Merge pull request #3144 from BerriAI/litellm_prometheus_latency_tracking
...
feat(prometheus_services.py): emit proxy latency for successful llm api requests
2024-04-18 19:10:58 -07:00
Ishaan Jaff
b5e8557fa4
ui - show keys user owns on ui
2024-04-18 18:27:41 -07:00
Ishaan Jaff
0569974a3a
Merge pull request #3146 from BerriAI/litellm_improve_users_pg
...
[UI]- show user_emails in Users Tab
2024-04-18 17:34:48 -07:00
Ishaan Jaff
d9091dcf97
fix order by spend
2024-04-18 17:33:38 -07:00
Krrish Dholakia
f65005f273
fix(caching.py): fix error logging
2024-04-18 17:21:10 -07:00
Ishaan Jaff
b669e2987b
fix return key aliases on /user/info
2024-04-18 17:16:52 -07:00
