Ishaan Jaff
c249a16368
semantic_router
2025-07-24 16:22:19 -07:00
Ishaan Jaff
b8386ec01e
test_router_auto_router
2025-07-24 16:20:00 -07:00
Ishaan Jaff
cff82cce6a
test auto router
2025-07-24 16:16:14 -07:00
Ishaan Jaff
0aaee5e1ec
python-dotenv==1.0.1
2025-07-24 16:09:21 -07:00
Ishaan Jaff
fd58207939
use aiohttp==3.10.11
2025-07-24 16:05:56 -07:00
Ishaan Jaff
87d7bb5f9d
ruff fix
2025-07-24 16:04:02 -07:00
Ishaan Jaff
2012b526a1
semantic_router==0.1.10
2025-07-24 16:03:38 -07:00
Ishaan Jaff
2abe9dca4c
add extras
2025-07-24 16:02:54 -07:00
Ishaan Jaff
97e1ac8e63
add semantic-router as optional for litellm
2025-07-24 15:43:03 -07:00
Ishaan Jaff
aae390d56e
test auto router
2025-07-24 15:40:03 -07:00
Ishaan Jaff
bacbcaf4e6
test_router_auto_router
2025-07-24 15:33:23 -07:00
Ishaan Jaff
1904e36e13
working auto router
2025-07-24 15:30:35 -07:00
Ishaan Jaff
334b90aad8
working embedding encoder
2025-07-24 15:25:37 -07:00
Ishaan Jaff
432f89e29a
working router init
2025-07-24 15:17:58 -07:00
Ishaan Jaff
37b1da88a6
fix router.json
2025-07-24 15:00:33 -07:00
Ishaan Jaff
36587c55a0
fix auto router
2025-07-24 14:46:10 -07:00
Ishaan Jaff
361ab642e0
update async_pre_routing_hook
2025-07-24 14:43:05 -07:00
Ishaan Jaff
1e0b70141b
fix async_pre_routing_hook
2025-07-24 14:37:56 -07:00
Ishaan Jaff
d5c7afd834
add AutoRouter
2025-07-24 14:27:07 -07:00
Ishaan Jaff
48faad3bdd
add auto_router_embedding_model
2025-07-24 14:15:49 -07:00
Ishaan Jaff
3091d73936
update test auto_router_embedding_model
2025-07-24 14:15:32 -07:00
Ishaan Jaff
328ab65888
add LiteLLMRouterEncoder
2025-07-24 14:14:51 -07:00
Ishaan Jaff
33e1b3b651
add async_pre_routing_hook
2025-07-24 13:40:48 -07:00
Ishaan Jaff
e3e38bdcc8
fixes for auto router
2025-07-24 13:25:28 -07:00
Ishaan Jaff
d66c7fb8b0
async_pre_routing_hook
2025-07-24 13:15:28 -07:00
Ishaan Jaff
4fb885148d
test_router_auto_router
2025-07-24 12:52:28 -07:00
Ishaan Jaff
e455a077d0
add router.json
2025-07-24 12:46:18 -07:00
Ishaan Jaff
0a07698d9d
docs update
2025-07-24 11:26:30 -07:00
Cole McIntosh
8c99c71f38
Merge pull request #12939 from superpoussin22/correct_doc
...
Update control_plane_and_data_plane.md
2025-07-24 09:17:01 -06:00
superpoussin22
ca9712c587
Update control_plane_and_data_plane.md
2025-07-24 16:15:55 +02:00
Ishaan Jaff
3e529fae7f
[UI] Allow setting up CloudZero Usage through LiteLLM UI ( #12923 )
...
* refactor cz settings
* allow viewing/setting CZ settings
* working button
* fixes for export button
* nicer button
* fix className
2025-07-23 21:17:12 -07:00
Apoorv Sharma
29475ab4b0
Add GA version of gemini 2.5 flash lite for both vertex and gemini ( #12920 )
...
This PR adds the config for gemini 2.5 flash lite which is out of preview now
2025-07-23 18:47:46 -07:00
Ishaan Jaff
e3b752d3dc
[Feat] LiteLLM CloudZero Integration updates - using LiteLLM_SpendLogs Table ( #12922 )
...
* use spend logs in transform.py
* fixes for using spend logs
* get_usage_data
* update get_usage_data_for_hour
* fix CloudZeroLogger
* fixes for cloudzero_dry_run_export
* working DB read
* fix _aggregate_to_hourly
* update cloudzero endpoints
* fix cloudzero_export
* fixes for CBF transformer
* use init_background_job on saving cz settings
* add is_cloudzero_setup_in_db
* init cz on startup
* fixes for CZ transform
* fix ruff check
* fix LOC violation
2025-07-23 18:46:50 -07:00
Ishaan Jaff
99031bf8b6
ci/cd new release
2025-07-23 13:50:36 -07:00
Ishaan Jaff
461cd0c30a
test_completion_cost_deepseek
2025-07-23 13:16:12 -07:00
Ishaan Jaff
2d0187824c
test_proxy_model_resolution_with_custom_names_documentation
2025-07-23 13:13:46 -07:00
Ishaan Jaff
79a0841719
test_router_content_policy_fallbacks
2025-07-23 13:04:28 -07:00
Ishaan Jaff
99ad24c683
[Feat] LiteLLM x Cloudzero integration - Allow exporting spend to cloudzero ( #12908 )
...
* add cz init
* add DataAnalyzer
* add CZRNGenerator -> LiteLLM resource generator
* add CloudZeroStreamer
* add CBFTransformer
* add cloudzero DB connection
* add config
* add cli.py
* cleanup
* add CloudZeroLogger
* add CloudZeroLogger
* update CloudZeroLogger
* add cloudzero_router to litellm proxy
* add CloudZeroInitRequest
* add cloudzero spend endpoints
* simple dry run endpoint
* refactor dir structure
* add well types CBFRecord
* TestCBFTransformer
* TestCloudZeroStreamer
* ruff fix
* add polars pip + docker requirements.txt
* _group_by_date
* update code qa check
* docs for CZ params
2025-07-23 13:00:58 -07:00
Krish Dholakia
c5c2a68510
Swagger - bump DOMPurify version + add back Support local swagger bundle (good for airgapped environments) + support local swagger on custom root paths ( #12911 )
...
* fix(proxy_server.py): update swagger-ui-bundle.js + bring back swagger in airgapped environments
* fix(proxy_server.py): support local swagger on custom root path
enables on prem usage of litellm
2025-07-23 11:22:56 -07:00
Ishaan Jaff
0d2e280e78
ci/cd new release
2025-07-23 09:04:26 -07:00
Ishaan Jaff
00fd020291
fix test
2025-07-23 09:04:09 -07:00
Krrish Dholakia
4277becdc2
docs(credentials.tsx): cleanup reference to dead link
2025-07-23 09:02:39 -07:00
Ishaan Jaff
60ed272ae0
ci/cd litellm
2025-07-23 07:15:33 -07:00
Ishaan Jaff
5616aaee6d
docs pillar guard
2025-07-23 07:15:02 -07:00
Ishaan Jaff
477ca5c0f6
test_proxy_all_models
2025-07-23 07:11:35 -07:00
Krrish Dholakia
663dea37a8
docs: fix docs
2025-07-22 23:30:50 -07:00
Igal Boxerman
d118cc7098
feat: Add Pillar Security guardrail integration ( #12791 )
...
* feat: Add Pillar Security guardrail integration
Implements comprehensive LLM security guardrails using Pillar Security API with support for prompt injection detection, PII/secret detection, content moderation, and multi-mode execution (pre_call, during_call, post_call). Includes complete documentation, testing, and configurable actions on flagged content.
* fix: Resolve MyPy type error in Pillar guardrail config
Restructure PillarGuardrailConfigModel to properly inherit from GuardrailConfigModel[T]
and resolve return type compatibility issue in get_config_model method.
* fix: Resolve MyPy type error in Pillar guardrail config
Restructure PillarGuardrailConfigModel to properly inherit from GuardrailConfigModel[T]
and resolve return type compatibility issue in get_config_model method.
* fix docs
* fix docs
* improved docs
* fix examples, READY
2025-07-22 23:17:33 -07:00
Murad Khafizov
a6ddf5c744
feat: extended /v1/models endpoint, now it returns with fallbacks on demand ( #12811 )
...
* Extended `/v1/model` endpoint to support fallbacks
* unit tests reworked
* linting fixes
* fix lining error
* fix linting
2025-07-22 23:16:46 -07:00
Stuart Geiger
37c626a9a0
rm retired anthropic models from model_prices_and_context_window.json ( #12864 )
...
rm claude-2, claude-2.1, claude-3-sonnet-20240229
2025-07-22 23:14:37 -07:00
Jugal D. Bhatt
03d5102044
[Add health check] add architecture diagram ( #12879 )
...
* add architecture diagram
* add image path
* add new image
2025-07-22 23:12:19 -07:00
