scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-13 23:11:40 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 101
litellm/litellm
History
Exact
Tin Chi Lo 3926ac2b3b fix(complexity_router): stop promising the classifier prior turns it will not receive 
The classifier's system role closes on a line chosen by the window, so a
deployment at classifier_context_window_size: 0 is told to classify only
the current message. The trust boundary paragraph above it was not
conditional, and it names prior turns as quoted material, so the same
system role still promised sections the payload never carries.

That is the defect #35504 fixed for the closing line, one paragraph
earlier. The boundary now tracks the window the same way.

The half that defends against a caller's own system prompt stays
unconditional, because that block is quoted at every window setting and
dropping it would let a key scoped to the router pin itself to the top
tier through its own system prompt.

At a window above 0 the system role is byte-identical to before.
2026-08-03 16:22:07 -07:00
..
a2a_protocol refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
anthropic_interface refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
assistants refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
batch_completion refactor(logging): drop redundant !s conversion flags from f-strings 2026-08-01 16:59:05 -07:00
batches refactor(logging): drop redundant !s conversion flags from f-strings 2026-08-01 16:59:05 -07:00
caching fix(caching): close evicted LLM clients so their connections are reclaimed (#35492) 2026-08-03 13:28:38 -07:00
completion_extras refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
compression refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
containers refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
endpoints/speech/speech_to_completion_bridge refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
evals refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
experimental_mcp_client refactor(logging): drop redundant !s conversion flags from f-strings 2026-08-01 16:59:05 -07:00
files refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
fine_tuning refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
google_genai refactor(logging): drop redundant !s conversion flags from f-strings 2026-08-01 16:59:05 -07:00
images refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
integrations refactor(logging): drop redundant !s conversion flags from f-strings 2026-08-01 16:59:05 -07:00
interactions refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
litellm_core_utils fix(datadog): read team callback dd_* params from kwargs instead of blocked dynamic params (#35115) (#35687) 2026-08-03 16:19:56 -07:00
llms fix(openai): restore httpx client union type on owns_wrapped_http_client (#35706) 2026-08-03 21:10:35 +00:00
models refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
ocr refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
passthrough refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
proxy fix(datadog): read team callback dd_* params from kwargs instead of blocked dynamic params (#35115) (#35687) 2026-08-03 16:19:56 -07:00
proxy_auth refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
rag refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
realtime_api refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
repositories fix(proxy): backfill null user_email on existing users during JWT auth (#34588) 2026-08-03 12:55:10 -07:00
rerank_api refactor(logging): drop redundant !s conversion flags from f-strings 2026-08-01 16:59:05 -07:00
responses refactor(logging): drop redundant !s conversion flags from f-strings 2026-08-01 16:59:05 -07:00
router_strategy fix(complexity_router): stop promising the classifier prior turns it will not receive 2026-08-03 16:22:07 -07:00
router_utils fix(proxy): apply key/team router_settings.model_group_alias (#35486) 2026-08-03 22:09:47 +00:00
rust_bridge refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
sandbox refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
search refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
secret_managers refactor(logging): drop redundant !s conversion flags from f-strings 2026-08-01 16:59:05 -07:00
skills refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
types fix(datadog): read team callback dd_* params from kwargs instead of blocked dynamic params (#35115) (#35687) 2026-08-03 16:19:56 -07:00
vector_store_files refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
vector_stores refactor(logging): drop redundant !s conversion flags from f-strings 2026-08-01 16:59:05 -07:00
videos refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
__init__.py feat(prometheus): add global exclude_metrics and exclude_labels options (#34201) 2026-08-01 11:52:27 -07:00
_internal_context.py fix(proxy): harden request parameter handling 2026-04-16 01:38:12 +00:00
_lazy_imports.py fix(lint): restore group-header comments the import sort displaced in _lazy_imports.py 2026-08-01 16:49:25 -07:00
_lazy_imports_registry.py feat(tencent): add Tencent TokenHub as a provider (#31903) 2026-07-02 18:31:59 -07:00
_logging.py refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
_redis.py refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
_redis_credential_provider.py refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
_service_logger.py refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
_uuid.py build(deps-dev): bump black to 26.3.1 and apply formatting (#28525) 2026-05-21 17:24:18 -07:00
_version.py
anthropic_beta_headers_config.json fix(bedrock-invoke): retain clear_tool_uses_20250919 context_management edits and emit context-management-2025-06-27 beta (LIT-3393) (#32658) 2026-07-09 14:31:27 -07:00
anthropic_beta_headers_manager.py refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
blog_posts.json docs(blog): add WebRTC blog post link 2026-03-13 17:54:33 +05:30
budget_manager.py refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
constants.py fix(caching): close evicted LLM clients so their connections are reclaimed (#35492) 2026-08-03 13:28:38 -07:00
cost.json
cost_calculator.py refactor(logging): drop redundant !s conversion flags from f-strings 2026-08-01 16:59:05 -07:00
exceptions.py refactor(logging): drop redundant !s conversion flags from f-strings 2026-08-01 16:59:05 -07:00
main.py refactor(logging): drop redundant !s conversion flags from f-strings 2026-08-01 16:59:05 -07:00
model_prices_and_context_window_backup.json Merge pull request #35270 from BerriAI/litellm_gpt_pricing_change 2026-07-30 21:46:46 -07:00
policy_templates_backup.json feat(add-new-block_code_execution-guardrail): prevent agent from executing code (#22154) 2026-02-25 22:02:14 -08:00
provider_endpoints_support_backup.json chore: litellm oss staging (#30968) 2026-06-23 07:31:44 -07:00
py.typed
router.py fix(proxy): apply key/team router_settings.model_group_alias (#35486) 2026-08-03 22:09:47 +00:00
scheduler.py refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
setup_wizard.py refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
timeout.py style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
utils.py refactor(logging): drop redundant !s conversion flags from f-strings 2026-08-01 16:59:05 -07:00