Commit graph

15949 commits

Author SHA1 Message Date
Ishaan Jaff
99ecde7744 allow setting outage metrics 2024-08-07 10:36:18 -07:00
Ishaan Jaff
9a8fa9f047 emit deployment_partial_outage on prometheus 2024-08-07 09:56:01 -07:00
Ishaan Jaff
0304513b67 rename to set_llm_deployment_success_metrics 2024-08-07 09:46:08 -07:00
Ishaan Jaff
13d1caf94a add set_remaining_tokens_requests_metric 2024-08-07 09:43:35 -07:00
Ishaan Jaff
7e0cd39de7
Merge pull request #5086 from BerriAI/litellm_or_headers
[Fix-Bug]: Using extra_headers removes the OpenRouter HTTP-Referer/X-Title headers
2024-08-07 08:27:07 -07:00
Ishaan Jaff
dc3cdf3ed8 fix use extra headers for open router 2024-08-07 08:15:05 -07:00
Krrish Dholakia
1008f24b16 build(requirements.txt): bump openai version 2024-08-07 08:08:37 -07:00
Ishaan Jaff
975eec8777
Merge pull request #5084 from BerriAI/litellm_add_gpt4o
add ft:gpt-4o-mini-2024-07-18 to model prices
2024-08-07 08:05:14 -07:00
Ishaan Jaff
2e6ba1c27c
Merge pull request #5085 from BerriAI/revert-4640-main
Revert "Fix: Add prisma binary_cache_dir specification to pyproject.toml"
2024-08-07 07:54:15 -07:00
Ishaan Jaff
64df195fe8
Revert "Fix: Add prisma binary_cache_dir specification to pyproject.toml" 2024-08-07 07:50:05 -07:00
Ishaan Jaff
5743640250 feat add ft:gpt-4o-mini-2024-07-18 2024-08-07 07:46:23 -07:00
Krrish Dholakia
a0bb89a372 docs(ui.md): add restrict email subdomains w/ sso 2024-08-06 22:54:33 -07:00
Krrish Dholakia
bc8857ca23 build(model_prices_and_context_window.json): remove duplicate entries 2024-08-06 22:50:41 -07:00
Krish Dholakia
405f496962
Merge pull request #5076 from BerriAI/litellm_support_lakera_config_thresholds
LLM Guardrails - Support lakera config thresholds + custom api base
2024-08-06 22:47:22 -07:00
Krish Dholakia
c82fc0cac2
Merge branch 'main' into litellm_support_lakera_config_thresholds 2024-08-06 22:47:13 -07:00
Ishaan Jaff
3e84014a69 run ci / cd again 2024-08-06 21:35:46 -07:00
Ishaan Jaff
f579aef740 ci/cd run again 2024-08-06 21:28:22 -07:00
Ishaan Jaff
0d76f49ea6 docs run ui on custom server root path 2024-08-06 21:27:47 -07:00
Ishaan Jaff
56f110cd04 test test_basic_passthrough 2024-08-06 21:17:07 -07:00
Ishaan Jaff
ab920ab461 fix pass through endpoint tests 2024-08-06 21:16:07 -07:00
Ishaan Jaff
d6db6f3ee6
Merge pull request #5078 from BerriAI/litellm_fwd_server_root_path
UI - fwd UI requests from server root path
2024-08-06 20:59:21 -07:00
Ishaan Jaff
7173cef822 clean up unused func 2024-08-06 20:58:51 -07:00
Ishaan Jaff
671d8ac496 explain ui base path 2024-08-06 18:42:08 -07:00
Krrish Dholakia
cf44d1e069 docs(sidebars.js): cleanup sidebar title 2024-08-06 18:24:54 -07:00
Ishaan Jaff
a1c1ad60d2 fix forward ui requests when base url set 2024-08-06 18:10:34 -07:00
Ishaan Jaff
d08f59ae09 add redirect_ui_middleware 2024-08-06 18:01:23 -07:00
Ishaan Jaff
98758fb59f build custom ui path docker 2024-08-06 17:50:07 -07:00
Krrish Dholakia
f3a0eb8eb9 docs(json_mode.md): update json mode docs to show structured output responses
Relevant issue - https://github.com/BerriAI/litellm/issues/5074
2024-08-06 17:01:41 -07:00
Ishaan Jaff
c11f575029
Merge pull request #5075 from BerriAI/litelm_use_file_checksum
[Feat] /audio/transcription use file checksum for cache key
2024-08-06 16:48:31 -07:00
Ishaan Jaff
237c3a0244
Merge pull request #5077 from BerriAI/litellm_fix_ui_emails
[Fix] Fix testing emails through Admin UI
2024-08-06 16:41:01 -07:00
Krrish Dholakia
907d83e5d9 fix(lakera_ai.py): fix hardcoded prompt_injection string in lakera integration 2024-08-06 16:12:54 -07:00
Ishaan Jaff
e5e5628fc8 update alerting settings on ui 2024-08-06 16:05:33 -07:00
Ishaan Jaff
1e90329c4b add error when trying to send emails 2024-08-06 16:03:20 -07:00
Ishaan Jaff
206acaae9e fix email health checks 2024-08-06 15:59:26 -07:00
Ishaan Jaff
7024fcacec add debug statements on docker 2024-08-06 15:29:49 -07:00
Krrish Dholakia
0e222cf76b feat(lakera_ai.py): support lakera custom thresholds + custom api base
Allows user to configure thresholds to trigger prompt injection rejections
2024-08-06 15:21:45 -07:00
Ishaan Jaff
aa06df4101 use file size _ name to get file check sum 2024-08-06 15:18:50 -07:00
Krrish Dholakia
2a95484a83 docs(deploy.md): add iam-based auth to rds 2024-08-06 14:29:39 -07:00
Krrish Dholakia
47346112e1 bump: version 1.43.0 → 1.43.1 2024-08-06 14:19:10 -07:00
Krish Dholakia
a17593dafb
Merge pull request #5071 from BerriAI/litellm_auth_restricted_domains
feat(proxy_server.py): allow restricting allowed email domains for UI
2024-08-06 14:18:57 -07:00
Ishaan Jaff
c19066e78e use file_checksum 2024-08-06 13:55:22 -07:00
Ishaan Jaff
467c506e33 caching use file_checksum 2024-08-06 13:03:14 -07:00
Krrish Dholakia
2abd4d5363 feat(proxy_server.py): allow restricting allowed email domains for the UI 2024-08-06 12:53:03 -07:00
Ishaan Jaff
089a4f279a readme - clarify helm is community maintained 2024-08-06 12:37:13 -07:00
Ishaan Jaff
645d3ae09d
Merge pull request #5062 from BerriAI/litellm_forward_headers
[Fix-Proxy] allow forwarding headers from request
2024-08-06 12:34:25 -07:00
Krrish Dholakia
834b437eb4 fix(utils.py): fix types 2024-08-06 12:23:22 -07:00
Ishaan Jaff
404360b28d test pass through endpoint 2024-08-06 12:16:00 -07:00
Ishaan Jaff
0cd2435aff doc forward_headers 2024-08-06 12:07:21 -07:00
Ishaan Jaff
c277a71c1e init pass through endpoints 2024-08-06 12:04:04 -07:00
Ishaan Jaff
621b5d5fba docs on gpt-4o-2024-08-06 2024-08-06 11:40:44 -07:00