Commit graph

12019 commits

Author SHA1 Message Date
Krrish Dholakia
e8df9c4041 fix(factory.py): fix linting error 2024-05-24 19:12:09 -07:00
Krrish Dholakia
8dec87425e feat(slack_alerting.py): refactor region outage alerting to do model based alerting instead
Unable to extract azure region from api base, makes sense to start with model alerting and then move to region
2024-05-24 19:10:33 -07:00
Krrish Dholakia
2cdb0584d1 fix(slack_alerting.py): fixes for outage alerting 2024-05-24 17:17:17 -07:00
Krrish Dholakia
f8350b9461 fix(slack_alerting.py): support region based outage alerting 2024-05-24 16:59:16 -07:00
Ishaan Jaff
18f8287e29 ci/cd run again 2024-05-23 21:23:13 -07:00
Ishaan Jaff
7d2c76f640 fix test_filter_invalid_params_pre_call_check 2024-05-23 21:16:32 -07:00
Krrish Dholakia
bc399029d8 build(ui): updating admin ui with changes 2024-05-23 20:34:48 -07:00
Krrish Dholakia
731af212cc bump: version 1.38.1 → 1.38.2 2024-05-23 20:31:22 -07:00
Krrish Dholakia
f04e4b921b feat(ui/model_dashboard.tsx): add databricks models via admin ui 2024-05-23 20:28:54 -07:00
Krish Dholakia
c14584722e
Merge pull request #3808 from BerriAI/litellm_databricks_api
feat(databricks.py): adds databricks support - completion, async, streaming
2024-05-23 19:23:19 -07:00
Krrish Dholakia
65c4d6be39 docs(databricks.md): add databricks api support to docs 2024-05-23 19:22:09 -07:00
Krish Dholakia
a4f3a1446f
Merge pull request #3792 from miesgre/ollama_vision_fix
fix(factory.py): Ollama vision fix.
2024-05-23 18:22:53 -07:00
Krrish Dholakia
43353c28b3 feat(databricks.py): add embedding model support 2024-05-23 18:22:03 -07:00
Ishaan Jaff
e51ba6dca7
Merge pull request #3807 from danielbichuetti/anyscale-model-updates
build(model_prices_and_context_window.json): update Anyscale model list
2024-05-23 17:45:55 -07:00
Krrish Dholakia
3ec4d1b1fc build(model_prices_and_context_window.json): add databricks models to model cost map 2024-05-23 17:08:56 -07:00
Daniel Bichuetti
7fdb5aeb24
Add source + support_function_calling tag 2024-05-23 20:43:20 -03:00
Ishaan Jaff
e6b9945ad9
Merge pull request #3630 from paneru-rajan/Issue-2407-auto-update-pricing
Added script for auto updating the pricing with the pricings of openrouter.ai
2024-05-23 16:43:09 -07:00
Ishaan Jaff
c041e2c2d6
Merge pull request #3806 from BerriAI/litellm_enforce_enterprise_checks
[Feat] LiteLLM Proxy - Require Enterprise License Key for Premium Guardrail Features
2024-05-23 16:40:57 -07:00
Ishaan Jaff
8febdadef4
Merge pull request #3809 from BerriAI/litellm_add_pricing_forvertex_imagen
[Feat] Add Cost Tracking for `vertex_ai/imagegeneration@006`
2024-05-23 16:40:25 -07:00
Ishaan Jaff
39d6821cd9 feat - add vertex imagegeneration to model price json 2024-05-23 16:34:27 -07:00
Krrish Dholakia
d2229dcd21 feat(databricks.py): adds databricks support - completion, async, streaming
Closes https://github.com/BerriAI/litellm/issues/2160
2024-05-23 16:29:46 -07:00
Ishaan Jaff
e0af091b5e feat - add prixing for vertex_ai image gen 2024-05-23 16:27:08 -07:00
Daniel Bichuetti
a086088dc7
Remove extra char 2024-05-23 20:24:39 -03:00
Daniel Bichuetti
3bd9a1b7a8
Update model_prices_and_context_window.json
This adds some new models from Anyscale
2024-05-23 20:19:46 -03:00
Ishaan Jaff
30ac77532b feat - enfore enterprise checks 2024-05-23 16:11:30 -07:00
Ishaan Jaff
580a342fdf
Merge pull request #3803 from BerriAI/litellm_add_lakera_ai
[Feat] Add Lakera AI Prompt Injection Detection
2024-05-23 16:01:24 -07:00
Ishaan Jaff
75ce4f1acb docs - lakera ai prompt inj detection 2024-05-23 15:59:42 -07:00
Ishaan Jaff
13c56abe59 docs - Prompt Injection Detection 2024-05-23 15:55:43 -07:00
Ishaan Jaff
4a3dcbbf45 docs - update enterprise tier docs 2024-05-23 15:47:20 -07:00
Ishaan Jaff
769070b3fe
Merge pull request #3797 from BerriAI/litellm_fix_post_call_streaming_hooks
[Fix]  async_post_call_streaming_hook not triggered on proxy server
2024-05-23 15:35:47 -07:00
Ishaan Jaff
966e62adf6
Merge pull request #3071 from vivek-athina/main
Athina callback now handles streaming mode
2024-05-23 15:31:12 -07:00
Ishaan Jaff
82cc144e11 test_lakera_prompt_injection_detection 2024-05-23 15:26:01 -07:00
Ishaan Jaff
03ec8219a4 fix - lakera ai integration 2024-05-23 15:25:26 -07:00
Ishaan Jaff
ec41226ee8 feat - add lakera ai prompt injection detection 2024-05-23 15:16:46 -07:00
Ishaan Jaff
35146d8628 docs - content mod 2024-05-23 14:33:52 -07:00
Ishaan Jaff
ea76432844
Merge pull request #3802 from BerriAI/litellm_add_moderations_safety_check_proxy
[Feat]- Proxy Add OpenAI Content Moderation Pre call hook
2024-05-23 14:30:49 -07:00
Ishaan Jaff
6d267fc7ad test - openai moderation response 2024-05-23 13:24:46 -07:00
Ishaan Jaff
6aad4e38d3 feat - add debugging for moderation response 2024-05-23 13:24:09 -07:00
Ishaan Jaff
1fe035c6dd feat - add open ai moderations check 2024-05-23 13:08:06 -07:00
Krrish Dholakia
54591e3920 test(test_key_generate_prisma.py): fix tests with unique team id 2024-05-23 12:55:26 -07:00
Ishaan Jaff
908b481f0f docs - fix litellm call hooks docs 2024-05-23 09:34:38 -07:00
Ishaan Jaff
5291f380c9 feat - async_post_call_streaming_hook 2024-05-23 09:30:53 -07:00
Krrish Dholakia
84f3690453 test(test_key_generate_prisma.py): fix tests with unique team id 2024-05-23 08:46:44 -07:00
Miguel Escriva
43dc97a331 fix(factory.py): Ollama vision fix.
Add convert_to_ollama_image function to handle image conversion.
2024-05-23 11:11:20 +02:00
Krrish Dholakia
5b1f928341 docs(users.md): add ui infographic to users.md 2024-05-22 21:11:00 -07:00
Krrish Dholakia
bcbd4feef4 bump: version 1.38.0 → 1.38.1 2024-05-22 20:56:47 -07:00
Krrish Dholakia
a33b9221da fix(proxy_server.py): fix admin allowed routes 2024-05-22 20:55:21 -07:00
Ishaan Jaff
595a2a5b1b fix test_key_model_list 2024-05-22 20:49:19 -07:00
Ishaan Jaff
405d5aa726
Merge pull request #3791 from BerriAI/litellm_fix_dont_allow_creating_existing_team_ids
[Fix] raise exception when creating team_id for existing team_id on `/team/new`
2024-05-22 20:35:34 -07:00
Ishaan Jaff
9ba7d26597 feat - raise exception when creating team_id for exiting team_id 2024-05-22 20:26:56 -07:00