Ishaan Jaff
97e1ac8e63
add semantic-router as optional for litellm
2025-07-24 15:43:03 -07:00
Ishaan Jaff
aae390d56e
test auto router
2025-07-24 15:40:03 -07:00
Ishaan Jaff
bacbcaf4e6
test_router_auto_router
2025-07-24 15:33:23 -07:00
Ishaan Jaff
1904e36e13
working auto router
2025-07-24 15:30:35 -07:00
Ishaan Jaff
334b90aad8
working embedding encoder
2025-07-24 15:25:37 -07:00
Ishaan Jaff
432f89e29a
working router init
2025-07-24 15:17:58 -07:00
Ishaan Jaff
37b1da88a6
fix router.json
2025-07-24 15:00:33 -07:00
Ishaan Jaff
36587c55a0
fix auto router
2025-07-24 14:46:10 -07:00
Ishaan Jaff
361ab642e0
update async_pre_routing_hook
2025-07-24 14:43:05 -07:00
Ishaan Jaff
1e0b70141b
fix async_pre_routing_hook
2025-07-24 14:37:56 -07:00
Ishaan Jaff
d5c7afd834
add AutoRouter
2025-07-24 14:27:07 -07:00
Ishaan Jaff
48faad3bdd
add auto_router_embedding_model
2025-07-24 14:15:49 -07:00
Ishaan Jaff
3091d73936
update test auto_router_embedding_model
2025-07-24 14:15:32 -07:00
Ishaan Jaff
328ab65888
add LiteLLMRouterEncoder
2025-07-24 14:14:51 -07:00
Ishaan Jaff
33e1b3b651
add async_pre_routing_hook
2025-07-24 13:40:48 -07:00
Ishaan Jaff
e3e38bdcc8
fixes for auto router
2025-07-24 13:25:28 -07:00
Ishaan Jaff
d66c7fb8b0
async_pre_routing_hook
2025-07-24 13:15:28 -07:00
Ishaan Jaff
4fb885148d
test_router_auto_router
2025-07-24 12:52:28 -07:00
Ishaan Jaff
e455a077d0
add router.json
2025-07-24 12:46:18 -07:00
Ishaan Jaff
0a07698d9d
docs update
2025-07-24 11:26:30 -07:00
Cole McIntosh
8c99c71f38
Merge pull request #12939 from superpoussin22/correct_doc
...
Update control_plane_and_data_plane.md
2025-07-24 09:17:01 -06:00
superpoussin22
ca9712c587
Update control_plane_and_data_plane.md
2025-07-24 16:15:55 +02:00
Ishaan Jaff
3e529fae7f
[UI] Allow setting up CloudZero Usage through LiteLLM UI ( #12923 )
...
* refactor cz settings
* allow viewing/setting CZ settings
* working button
* fixes for export button
* nicer button
* fix className
2025-07-23 21:17:12 -07:00
Apoorv Sharma
29475ab4b0
Add GA version of gemini 2.5 flash lite for both vertex and gemini ( #12920 )
...
This PR adds the config for gemini 2.5 flash lite which is out of preview now
2025-07-23 18:47:46 -07:00
Ishaan Jaff
e3b752d3dc
[Feat] LiteLLM CloudZero Integration updates - using LiteLLM_SpendLogs Table ( #12922 )
...
* use spend logs in transform.py
* fixes for using spend logs
* get_usage_data
* update get_usage_data_for_hour
* fix CloudZeroLogger
* fixes for cloudzero_dry_run_export
* working DB read
* fix _aggregate_to_hourly
* update cloudzero endpoints
* fix cloudzero_export
* fixes for CBF transformer
* use init_background_job on saving cz settings
* add is_cloudzero_setup_in_db
* init cz on startup
* fixes for CZ transform
* fix ruff check
* fix LOC violation
2025-07-23 18:46:50 -07:00
Ishaan Jaff
99031bf8b6
ci/cd new release
2025-07-23 13:50:36 -07:00
Ishaan Jaff
461cd0c30a
test_completion_cost_deepseek
2025-07-23 13:16:12 -07:00
Ishaan Jaff
2d0187824c
test_proxy_model_resolution_with_custom_names_documentation
2025-07-23 13:13:46 -07:00
Ishaan Jaff
79a0841719
test_router_content_policy_fallbacks
2025-07-23 13:04:28 -07:00
Ishaan Jaff
99ad24c683
[Feat] LiteLLM x Cloudzero integration - Allow exporting spend to cloudzero ( #12908 )
...
* add cz init
* add DataAnalyzer
* add CZRNGenerator -> LiteLLM resource generator
* add CloudZeroStreamer
* add CBFTransformer
* add cloudzero DB connection
* add config
* add cli.py
* cleanup
* add CloudZeroLogger
* add CloudZeroLogger
* update CloudZeroLogger
* add cloudzero_router to litellm proxy
* add CloudZeroInitRequest
* add cloudzero spend endpoints
* simple dry run endpoint
* refactor dir structure
* add well types CBFRecord
* TestCBFTransformer
* TestCloudZeroStreamer
* ruff fix
* add polars pip + docker requirements.txt
* _group_by_date
* update code qa check
* docs for CZ params
2025-07-23 13:00:58 -07:00
Krish Dholakia
c5c2a68510
Swagger - bump DOMPurify version + add back Support local swagger bundle (good for airgapped environments) + support local swagger on custom root paths ( #12911 )
...
* fix(proxy_server.py): update swagger-ui-bundle.js + bring back swagger in airgapped environments
* fix(proxy_server.py): support local swagger on custom root path
enables on prem usage of litellm
2025-07-23 11:22:56 -07:00
Ishaan Jaff
0d2e280e78
ci/cd new release
2025-07-23 09:04:26 -07:00
Ishaan Jaff
00fd020291
fix test
2025-07-23 09:04:09 -07:00
Krrish Dholakia
4277becdc2
docs(credentials.tsx): cleanup reference to dead link
2025-07-23 09:02:39 -07:00
Ishaan Jaff
60ed272ae0
ci/cd litellm
2025-07-23 07:15:33 -07:00
Ishaan Jaff
5616aaee6d
docs pillar guard
2025-07-23 07:15:02 -07:00
Ishaan Jaff
477ca5c0f6
test_proxy_all_models
2025-07-23 07:11:35 -07:00
Krrish Dholakia
663dea37a8
docs: fix docs
2025-07-22 23:30:50 -07:00
Igal Boxerman
d118cc7098
feat: Add Pillar Security guardrail integration ( #12791 )
...
* feat: Add Pillar Security guardrail integration
Implements comprehensive LLM security guardrails using Pillar Security API with support for prompt injection detection, PII/secret detection, content moderation, and multi-mode execution (pre_call, during_call, post_call). Includes complete documentation, testing, and configurable actions on flagged content.
* fix: Resolve MyPy type error in Pillar guardrail config
Restructure PillarGuardrailConfigModel to properly inherit from GuardrailConfigModel[T]
and resolve return type compatibility issue in get_config_model method.
* fix: Resolve MyPy type error in Pillar guardrail config
Restructure PillarGuardrailConfigModel to properly inherit from GuardrailConfigModel[T]
and resolve return type compatibility issue in get_config_model method.
* fix docs
* fix docs
* improved docs
* fix examples, READY
2025-07-22 23:17:33 -07:00
Murad Khafizov
a6ddf5c744
feat: extended /v1/models endpoint, now it returns with fallbacks on demand ( #12811 )
...
* Extended `/v1/model` endpoint to support fallbacks
* unit tests reworked
* linting fixes
* fix lining error
* fix linting
2025-07-22 23:16:46 -07:00
Stuart Geiger
37c626a9a0
rm retired anthropic models from model_prices_and_context_window.json ( #12864 )
...
rm claude-2, claude-2.1, claude-3-sonnet-20240229
2025-07-22 23:14:37 -07:00
Jugal D. Bhatt
03d5102044
[Add health check] add architecture diagram ( #12879 )
...
* add architecture diagram
* add image path
* add new image
2025-07-22 23:12:19 -07:00
Jugal D. Bhatt
405eb7f243
[Docs ]Litellm mcp access group doc ( #12883 )
...
* add example for config
* fix typo
2025-07-22 23:11:53 -07:00
Krish Dholakia
d26f74ade5
Request Headers - support x-litellm-num-retries + Usage - support usage by model group ( #12890 )
...
* feat(litellm_pre_call_utils.py): add num_retries to litellm data for backend call
allow user to pass in num retries via request headers
* test(test_litellm_pre_call_utils.py): add unit test
* docs(request_headers.md): document new request header
* fix(common_daily_activity.py): show spend breakdown by model group
Partial fix for https://github.com/BerriAI/litellm/issues/12887
* feat(new_usage.tsx): new tab switcher for viewing usage by model group vs. received model
Closes https://github.com/BerriAI/litellm/issues/12887
2025-07-22 23:09:36 -07:00
Ishaan Jaff
a0846c3f31
ci/cd new release
2025-07-22 21:08:02 -07:00
Ishaan Jaff
642cfa26b0
remove deprecated
2025-07-22 20:59:34 -07:00
Ishaan Jaff
3a76b2762f
ci/cd new release
2025-07-22 20:41:49 -07:00
Ishaan Jaff
5741cdae0f
fix openrouter/qwen/qwen-vl-plus
2025-07-22 20:37:57 -07:00
Krish Dholakia
8cd6c25e1e
Fix async retryer on .acompletion() + forward clientside headers - filter out content-type from clientside request (causes llm api call to hang) ( #12886 )
...
* fix(main.py): fix async retryer
Fixes https://github.com/BerriAI/litellm/issues/12830
* fix(forward_clientside_headers_by_model_group.py): filter out 'content-type' from forwardable headers
clientside content-type != proxy content type, can cause requests to hang
2025-07-22 19:50:05 -07:00
Ishaan Jaff
b41ce5c92f
[Feat] - Track cost + add tags for health checks done by LiteLLM Proxy ( #12880 )
...
* refactor to use add_user_api_key_auth_to_request_metadata
* add get_litellm_internal_health_check_user_api_key_auth
* add get_litellm_internal_health_check_user_api_key_auth
* add _update_model_params_with_health_check_tracking_information
* add HealthCheckHelpers
* refactor to use clean helpers
* test_update_model_params_with_health_check_tracking_information
* test_get_litellm_internal_health_check_user_api_key_auth
* test_add_user_api_key_auth_to_request_metadata
* fix _update_model_params_with_health_check_tracking_information
2025-07-22 18:45:57 -07:00
