Alexsander Hamir
eba2b6ce91
Add observability print statements to GCS bucket logger
...
- Add print statement on logger initialization with config details
- Add print statements when success/failure events are queued with queue size
- Add print statements for batch processing start/completion with metrics
- Add print statements for individual log sends to GCS bucket
- Add print statements for error handling during queueing and sending
- Use print() instead of verbose_logger for direct visibility
2026-01-19 08:46:10 -08:00
Alexsander Hamir
185495dbdb
Merge branch 'main' into litellm_specific_oom_issue
2026-01-19 08:39:37 -08:00
Ishaan Jaffer
7eecf81cdc
docs fix
2026-01-17 17:29:49 -08:00
Alexsander Hamir
797f561de4
fix(gcs_bucket): use asyncio.Queue and batch_size limit to prevent unbounded queue growth
...
- Replace List with asyncio.Queue for thread-safe concurrent access
- Remove unnecessary flush_lock (asyncio.Queue handles concurrency atomically)
- Add batch_size limit to prevent processing all queued items at once
- Extract queue draining logic into _drain_queue_batch() helper function
- Remove debug print statements and unnecessary try/finally blocks
This fixes the issue where the queue grew unbounded (2000+ logs) because
async_send_batch() attempted to process all queued items in a single flush,
taking longer than the flush interval and causing continuous accumulation.
2026-01-17 17:28:00 -08:00
Ishaan Jaffer
534fa9f4c0
docs fix
2026-01-17 17:26:58 -08:00
Ishaan Jaffer
26497b415b
docs fix
2026-01-17 17:21:31 -08:00
Ishaan Jaffer
c6998823c0
docs fix
2026-01-17 17:17:34 -08:00
Ishaan Jaffer
c158f83cff
docs fix
2026-01-17 17:17:13 -08:00
Ishaan Jaffer
4610d1d43c
docs fix
2026-01-17 17:16:22 -08:00
Ishaan Jaffer
7d24bbed42
qa fixes
2026-01-17 17:14:51 -08:00
Ishaan Jaffer
e15526a60e
fix
2026-01-17 17:13:22 -08:00
Ishaan Jaffer
60dd04ac95
test_aiohttp_openai
2026-01-17 17:05:00 -08:00
Ishaan Jaffer
c30b17aa9b
docs fix
2026-01-17 17:03:48 -08:00
Ishaan Jaffer
0a84120be5
v1.81.0
2026-01-17 16:43:00 -08:00
Ishaan Jaffer
db7de13818
test_deepseek_mock_completion
2026-01-17 16:36:42 -08:00
Ishaan Jaffer
5812654bdd
test_router_fallbacks_with_custom_model_costs
2026-01-17 16:34:46 -08:00
Ishaan Jaff
1417b002a3
[Feat] Claude Code x LiteLLM WebSearch - QA Fixes to work with Claude Code ( #19294 )
...
* fix websearch_interception_converted_stream
* test_websearch_interception_no_tool_call_streaming
* FakeAnthropicMessagesStreamIterator
* LITELLM_WEB_SEARCH_TOOL_NAME
* fixes tools def for litellm web search
* fixes FakeAnthropicMessagesStreamIterator
* test_litellm_standard_websearch_tool
* use new hook for modfying before any transfroms from litellm
* init WebSearchInterceptionLogger + ARCHITECTURE
* fix config.yaml
* init doc for claude code web search
* docs fix
* doc fix
* fix mypy linting
2026-01-17 16:30:31 -08:00
yuneng-jiang
42c0136bf4
Merge pull request #19293 from BerriAI/litellm_ui_build_fix_22
...
[Infra] Fix UI Build
2026-01-17 15:58:24 -08:00
yuneng-jiang
91eb047761
testing adding entire out
2026-01-17 15:49:20 -08:00
yuneng-jiang
c1f194cde9
fix build attempt
2026-01-17 15:36:53 -08:00
YutaSaito
d28bf983eb
Merge pull request #19272 from Harshit28j/feature/panw-custom-violation-msg
...
feat(panw_prisma_airs): add custom violation message support
2026-01-18 06:55:39 +09:00
yuneng-jiang
953e2736d4
Merge pull request #19291 from BerriAI/deleted_keys_docs_2
...
[Docs] Deleted Keys and Teams Docs
2026-01-17 13:20:48 -08:00
yuneng-jiang
19a69a89f0
deleted keys and teams docs
2026-01-17 13:19:48 -08:00
Ishaan Jaffer
e238cb2ca0
docs clean up
2026-01-17 12:30:26 -08:00
Ishaan Jaffer
58570e5b13
fix doc
2026-01-17 12:28:04 -08:00
Ishaan Jaffer
1115e6b8c7
docs fix
2026-01-17 12:20:09 -08:00
Ishaan Jaffer
eb26ebc926
docs ui usage
2026-01-17 12:15:37 -08:00
yuneng-jiang
052aa4f7ed
Merge pull request #19287 from BerriAI/ui_build_jan17_1
...
[Infra] Fixing UI Build
2026-01-17 12:09:41 -08:00
yuneng-jiang
715fa8fa5f
fixing ui build
2026-01-17 12:08:20 -08:00
yuneng-jiang
ff73d8f640
Merge pull request #19286 from BerriAI/8015_docs_1
...
[Docs] Updating Docs for v1.80.15-stable.1
2026-01-17 11:55:10 -08:00
yuneng-jiang
b964e2a1a0
updating docker pull cmd
2026-01-17 11:54:04 -08:00
yuneng-jiang
32626954c3
Merge pull request #19283 from BerriAI/ui_build_jan17
...
[Infra] Re-Building UI
2026-01-17 11:13:29 -08:00
yuneng-jiang
d160ac0319
rebuilding ui
2026-01-17 11:11:25 -08:00
yuneng-jiang
3619fdce31
Merge pull request #19282 from BerriAI/yj_ui_test_branch
...
[Fix] UI - Deleted Teams Endpoint Fix
2026-01-17 11:07:31 -08:00
yuneng-jiang
374662c60f
deleted teams endpoint fix
2026-01-17 11:00:32 -08:00
Ishaan Jaffer
e9e323bf32
png fixes
2026-01-17 10:28:41 -08:00
Ishaan Jaffer
f0569bc102
docs fix
2026-01-17 09:40:08 -08:00
yuneng-jiang
0d3a9b1c87
Merge pull request #19279 from BerriAI/ui_build_branch
...
[Infra] Building UI
2026-01-17 09:20:28 -08:00
yuneng-jiang
581ba2def3
building ui
2026-01-17 09:19:05 -08:00
yuneng-jiang
23a06a04a3
Merge pull request #19278 from BerriAI/litellm_ui_update_new_badges
...
[Refactor] UI - Adjusting New Badges
2026-01-17 09:17:15 -08:00
yuneng-jiang
1301896e03
Adjusting new badges
2026-01-17 09:08:41 -08:00
Harshit Jain
0683f29671
feat(panw_prisma_airs): add custom violation message support
2026-01-17 17:52:25 +05:30
yuneng-jiang
362081c2b9
Merge pull request #19258 from BerriAI/litellm_ui_model_hub_health_1
...
[Feature] UI - Public Model Hub: Health Checks
2026-01-16 22:28:45 -08:00
yuneng-jiang
480d9356af
Merge pull request #19268 from BerriAI/litellm_ui_deleted_keys_teams_table
...
[Feature] UI - Logs: Deleted Keys and Teams Table
2026-01-16 22:28:24 -08:00
yuneng-jiang
d48e41bd94
fixing tests
2026-01-16 22:20:10 -08:00
yuneng-jiang
883f83a9cb
Adding tests
2026-01-16 22:14:24 -08:00
yuneng-jiang
c2452e179d
Deleted Teams
2026-01-16 22:02:58 -08:00
Ishaan Jaff
104283ae8f
[Feat] Claude Code - Add Websearch support using LiteLLM /search (using web search interception hook) ( #19263 )
...
* init WebSearchInterceptionLogger
* test_websearch_interception_real_call
* init async_should_run_agentic_completion
* async_should_run_agentic_loop
* async_run_agentic_loop
* refactor folder
* fix organization
* WebSearchTransformation
* WebSearchInterceptionLogger
* _call_agentic_completion_hooks
* WebSearch Interception Architecture
* test_websearch_interception_real_call
* add streaming
* add transform_request for streaming
* get_llm_provider
* test fix
* fix info
* init from config.yaml
* fixes
* test handler
* fix _is_streaming_response
* async_run_agentic_loop
* mypy fix
2026-01-16 21:10:05 -08:00
yuneng-jiang
9e2a8ddda7
Merge remote-tracking branch 'origin' into litellm_ui_deleted_keys_teams_table
2026-01-16 20:29:55 -08:00
yuneng-jiang
7dc8b4fd30
Merge pull request #19260 from BerriAI/litellm_deleted_keys_endpoint
...
[Feature] Status Query for Keys and Teams List
2026-01-16 20:29:36 -08:00
