## Problem
test_retrieve_container_basic tests were failing because mocks weren't
being applied correctly. The tests used string-based patching:
patch('litellm.containers.main.base_llm_http_handler')
But base_llm_http_handler is imported at module level, so the mock wasn't
intercepting the actual handler calls, resulting in real HTTP requests
to OpenAI API.
## Solution
Use patch.object() to directly mock methods on the imported handler
instance. Import base_llm_http_handler in the test file and patch like:
patch.object(base_llm_http_handler, 'container_retrieve_handler', ...)
This ensures the mock is applied to the actual object being used,
regardless of import order or caching.
## Problem
Four tests in litellm_mapped_tests_core were failing:
1. test_register_model_with_scientific_notation - KeyError due to test isolation issues
2. test_search_uses_registry_credentials - Mock not being called due to incorrect patch path
3. test_send_email_missing_api_key - Real API calls despite mocking
4. test_stream_transformation_error_sync - Mock not effective, real API called
## Solution
### test_register_model_with_scientific_notation
- Use unique model name to avoid conflicts with other tests
- Clear LRU caches before test to prevent stale data
- Clean up model_cost entry after test
### test_search_uses_registry_credentials
- Use patch.object() on the actual base_llm_http_handler instance
- String-based patching for instance methods can fail; direct object patching is more reliable
### test_send_email_missing_api_key
- Directly inject mock HTTP client into logger instance
- This bypasses any caching issues that could cause the fixture mock to be ineffective
### test_stream_transformation_error_sync
- Patch litellm.completion directly instead of the handler module's litellm reference
- This ensures the mock is effective regardless of import order
## Regression
These tests were affected by LRU caching added in #19606 and HTTP client caching.
## Problem
Tests using mocked HTTP clients were hitting real APIs because:
1. HTTP client cache was returning previously cached real clients
2. isinstance checks failed due to module identity issues from sys.path
### Tests affected:
- test_send_email_missing_api_key
- test_send_email_multiple_recipients (resend & sendgrid)
- test_search_uses_registry_credentials
- test_vector_store_create_with_simple_provider_name
- test_vector_store_create_with_provider_api_type
- test_vector_store_create_with_ragflow_provider
- test_image_edit_merges_headers_and_extra_headers
- test_retrieve_container_basic (container API tests)
## Solution
1. Add clear_client_cache fixture (autouse=True) to clear
litellm.in_memory_llm_clients_cache before each test
2. Fix isinstance checks to use type name comparison
(avoids module identity issues from sys.path.insert)
## Why not disable_aiohttp_transport
The default transport is aiohttp, so tests should work with it.
Clearing the cache ensures mocks are used instead of cached real clients.
## Regression
PR #19829 (commit f95572e3ed) added @respx.mock but cached clients
from earlier tests were being reused, bypassing the mocks.
Co-authored-by: shin-bot-litellm <shin-bot-litellm@users.noreply.github.com>
* docs: add card-based blog index page for mobile navigation
Fixes#20100 - the blog landing page showed post content directly
instead of an index, with no way to navigate between posts on mobile.
- Swizzle BlogListPage with card-based grid layout
- Featured latest post spans full width with badge
- Responsive 2-column grid with orphan handling
- Pagination, SEO metadata, accessibility (aria-label, dateTime, heading hierarchy)
- Add description frontmatter to existing blog posts
* docs: add deterministic fallback colors for unknown blog tags
* docs: rename blog heading to The LiteLLM Blog
- Add /v1/vector_store/list route for OpenAI API compatibility (fixes test_routes_on_litellm_proxy)
- Fix Bedrock Converse API model format (bedrock_converse/ → bedrock/converse/)
- Fix Nova Premier inference profile prefix (amazon. → us.amazon.)
- Add STABILIZATION_TODO.md to .gitignore
Tested locally - all affected tests now pass
Co-authored-by: Cursor <cursoragent@cursor.com>
The test had prompt_tokens=1000 but the sum of token details was 1150
(text=700 + audio=100 + cached=200 + cache_creation=150).
This triggered the double-counting detection logic which recalculated
text_tokens to 550, causing the assertion to fail.
Fixed by setting prompt_tokens=1150 to match the sum of details.
The test uses an invalid API key to verify that batch_completion returns
exceptions rather than raising them. However, depending on network conditions,
the error may be:
- AuthenticationError: API properly rejected the invalid key
- InternalServerError: Connection error occurred before API could respond
Both are valid outcomes for this test case.
Co-authored-by: shin-bot-litellm <shin-bot-litellm@users.noreply.github.com>
The budget enforcement was failing in tests because cache updates were
fire-and-forget (asyncio.create_task), causing race conditions where
subsequent requests would read stale spend data.
Changes:
1. proxy_track_cost_callback.py: await update_cache() instead of create_task
2. proxy_server.py: await async_set_cache_pipeline() instead of create_task
3. auth_checks.py: prefer valid_token.team_member_spend (from fresh cache)
over team_membership.spend (which may be stale)
This ensures budget checks see the most recent spend values and properly
enforce budget limits when requests come in quick succession.
Fixes: test_users_in_team_budget, test_chat_completion_low_budget
- batch_endpoints.py: Pop batch_id from data before creating CancelBatchRequest
to avoid duplicate batch_id when data already contains it from earlier cast
- files_endpoints.py: Pop file_id from data before calling afile_retrieve
to avoid duplicate file_id when data was initialized with {"file_id": file_id}
- test_claude_agent_sdk.py: Disable bedrock-nova-premier test as it requires
an inference profile for on-demand throughput (AWS limitation)
Fixes: e2e_openai_endpoints tests (test_batches_operations, test_file_operations)
Fixes: proxy_e2e_anthropic_messages_tests (nova-premier model skip)
The proxy now adds metadata to the request body during processing.
Updated test to compare fields individually and strip metadata from
body comparison.
Fixes litellm_proxy_unit_testing_part2 CI failure.
Move ToolNameValidationResult class definition outside the fallback function
and use consistent return type annotation to satisfy mypy.
Files fixed:
- proxy/_experimental/mcp_server/mcp_server_manager.py
- proxy/management_endpoints/mcp_management_endpoints.py
- Add test_router_acancel_batch.py with mock test for router.acancel_batch()
- Add _acancel_batch to ignored list (internal helper tested via public API)
Fixes CI failure in check_code_and_doc_quality job
- Fixed model parameter being overwritten to None in acancel_batch function
- Added dedicated acancel_batch/\_acancel_batch methods in Router
- Properly extracts custom_llm_provider from deployment like acreate_batch
This fixes test_ensure_initialize_azure_sdk_client_always_used[acancel_batch]
which expected azure_batches_instance.initialize_azure_sdk_client to be called.
Co-authored-by: shin-bot-litellm <shin-bot-litellm@users.noreply.github.com>
Fixes ruff F401 errors in check_code_and_doc_quality CI job.
**Regression introduced in:** 41ec820 (fix files) - added files with unused imports
## Problem
ToolNameValidationResult is imported but never used in:
- litellm/proxy/_experimental/mcp_server/mcp_server_manager.py
- litellm/proxy/management_endpoints/mcp_management_endpoints.py
## Fix
```diff
- ToolNameValidationResult,
```
Removed from both import statements.
## Changes
- mcp_server_manager.py: -1 line (removed unused import)
- mcp_management_endpoints.py: -1 line (removed unused import)
