litellm/litellm/proxy/response_api_endpoints
Xianzong Xie 0b8c10c488 Add native_background_mode to override polling_via_cache for specific models
This follow-up to PR #16862 allows users to specify models that should use
the native provider's background mode instead of polling via cache.

Config example:
  litellm_settings:
    responses:
      background_mode:
        polling_via_cache: ["openai"]
        native_background_mode: ["o4-mini-deep-research"]
        ttl: 3600

When a model is in native_background_mode list, should_use_polling_for_request
returns False, allowing the request to fall through to native provider handling.

Committed-By-Agent: cursor
2026-01-27 15:54:46 -08:00
..
endpoints.py Add native_background_mode to override polling_via_cache for specific models 2026-01-27 15:54:46 -08:00