Alon Sokolovski dd243bdccb feat(context_management)!: honor clear_at_least, exclude_tools and clear_tool_inputs in the clear_tool_uses polyfill (#47123) ... * feat(context_management): honor clear_at_least, exclude_tools and clear_tool_inputs in the clear_tool_uses polyfill The clear_tool_uses_20250919 polyfill honored only trigger and keep and ignored the other three fields with a warning. It now follows the Anthropic API, as measured against it: - keep counts clearable tool uses only; uses of exclude_tools are never cleared and count toward neither keep nor clear_at_least. - clear_at_least clears oldest first in batches of at least that many tokens and leaves an incomplete last batch, so the cleared prefix only grows between requests and each batch costs one prompt-cache miss. - clear_tool_inputs (true or a list of tool names) also empties the input of the cleared tool uses. Invalid values are ignored with a <field>_invalid warning on the applied edit. * refactor(context_management): build the clear_tool_uses selection without mutable state * test(context_management): cover a history made only of excluded tools * fix(context_management): leave tiny tool results out of clear_tool_uses like the API The API neither counts nor clears a tool use whose result is 1 to 46 bytes of text, whatever the tool or error flag; empty results still count. Probed against the API with crafted histories. Test data under 46 bytes is lengthened so those tests keep exercising clearing * fix(context_management): count tiny tool results when clear_tool_inputs covers their tool The API leaves a use whose result is 1 to 46 bytes out of clear_tool_uses only while its input is kept. When clear_tool_inputs is true or names the use's tool, the API counts it toward keep and clears it like any other use. * fix(context_management): count cleared inputs and images toward clear_at_least, answer malformed fields with a 400 * fix(context_management): validate clear_tool_uses edits before any editor runs, drop only the malformed edit under drop_params * fix(context_management): drop only the malformed clear_tool_uses fields under drop_params A malformed clear_at_least, exclude_tools or clear_tool_inputs no longer drops the whole edit under drop_params. The edit still runs with its well-formed fields, so the clearing that worked before is kept. Also types the new tests and swaps the hand-rolled spy router for an AsyncMock * test(context_management): pin the 46 byte cutoff in UTF-8 bytes and a batch closing at exactly clear_at_least * fix(context_management): leave a non-string tool_use id for the provider, size lone surrogates, and read drop_params strings * fix(context_management): read a drop_params string the same way on count_tokens and both /v1/messages paths count_tokens still checked drop_params with is True, so a body drop_params of "true" answered 400 there while /v1/messages dropped the malformed field. Both routes and the sync path now use drops_unsupported_params. --------- Co-authored-by: AlonSoko <25619863+AlonSoko@users.noreply.github.com> Co-authored-by: mateo-berri <277851410+mateo-berri@users.noreply.github.com>		2026-10-20 07:11:59 +00:00
..
a2a	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
aiml	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
aiohttp_openai	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
anthropic	feat(context_management)!: honor clear_at_least, exclude_tools and clear_tool_inputs in the clear_tool_uses polyfill (#47123)	2026-10-20 07:11:59 +00:00
apiserpent	test(unit): add package markers to migrated unit test directories	2026-09-20 11:53:14 +00:00
aws_polly	refactor(sdk): separate core AWS and tokenizer dependencies (#44447)	2026-10-08 19:07:57 -07:00
azure	fix(azure): cache the remaining per-request Entra credentials and keep token refresh off the event loop (#47348)	2026-10-19 20:35:27 +00:00
azure_ai	fix(openai): drop unsupported reasoning effort for gpt-6.1-sol (#43935)	2026-10-19 11:40:56 -07:00
base_llm	feat: add Nace Drex decisions provider (#46523)	2026-10-16 18:07:50 -07:00
baseten	fix(baseten): list current Model APIs instead of retired 2023 deployment IDs (#46945)	2026-10-19 16:40:13 +00:00
bedrock	fix(bedrock): resolve profile pricing before applying custom rates (#47419)	2026-10-20 00:10:49 -07:00
bedrock_mantle	fix(router)!: stop a chat-mode Mantle deployment from rewriting the shared Responses routing row (#46263)	2026-10-17 21:39:14 +00:00
black_forest_labs	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
brave	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
bytez	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
cerebras	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
chat	fix(router): read the first stream chunk before returning so a failure before any token runs through the retry and fallback budget (#46493)	2026-10-14 14:19:25 -07:00
chatgpt	fix(responses): keep the provider code and message on top-level stream error events (#46438)	2026-10-14 16:16:46 -07:00
clarifai	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
claude_code	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
cloudflare	test: move offline logging, secret manager and provider tests from legacy dirs into tests/unit (#45554)	2026-10-09 09:48:10 -07:00
codex	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
cohere	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
cometapi	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
compactifai	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
crusoe	fix(crusoe): update base URL to current endpoint (#33121)	2026-10-15 19:10:58 -07:00
custom_httpx	fix(batches): apply the Vertex regional endpoint uplift to batch cost (#47466)	2026-10-20 01:51:51 +00:00
dashscope	feat(dashscope): add separate explicit and implicit cache pricing (#45567)	2026-10-20 04:54:35 +00:00
databricks	fix(databricks): stream Claude json_schema answers as text on every streaming path (#47424)	2026-10-20 02:41:55 +00:00
dataforseo	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
datarobot	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
deepagents	feat: add litellm.agent() to run claude code, codex, opencode and deep agents through the ai gateway (#43885)	2026-10-01 22:27:49 +00:00
deepgram	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
deepinfra	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
deepseek	feat(search): add DeepSeek as a /v1/search provider (#47401)	2026-10-19 20:35:04 +00:00
docker_model_runner	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
duckduckgo	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
e2b	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
edenai	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
elevenlabs	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
exa_ai	fix(exa): return highlights, highlight scores, score and the response envelope from Exa search (#47423)	2026-10-19 15:45:56 -07:00
fal_ai	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
fastcrw	fix(llms): sanitize trailing slashes in provider get_complete_url (#42887)	2026-10-15 02:59:46 -07:00
featherless_ai	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
firecrawl	fix(llms): sanitize trailing slashes in provider get_complete_url (#42887)	2026-10-15 02:59:46 -07:00
fireworks_ai	fix(responses bridge): round-trip tool_search_call and tool_search_output items between turns (#46444)	2026-10-14 21:40:14 -07:00
friendliai	fix(friendliai): drop litellm-internal message fields before sending (#45092)	2026-10-20 01:22:07 +00:00
gdc	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
gemini	test: catch regressions in the validation lines #44798 added (#47420)	2026-10-20 01:06:37 +00:00
gigachat	fix(llms): sanitize trailing slashes in provider get_complete_url (#42887)	2026-10-15 02:59:46 -07:00
github_copilot	fix(anthropic): add the dangerous-tool-use beta when a /v1/messages request carries safeguards (#43955)	2026-10-17 16:46:25 +00:00
google_pse	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
gradient_ai	fix(llms): sanitize trailing slashes in provider get_complete_url (#42887)	2026-10-15 02:59:46 -07:00
groq	fix(responses bridge): round-trip tool_search_call and tool_search_output items between turns (#46444)	2026-10-14 21:40:14 -07:00
heroku	fix(llms): sanitize trailing slashes in provider get_complete_url (#42887)	2026-10-15 02:59:46 -07:00
hosted_vllm	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759)	2026-10-11 07:58:53 +00:00
huggingface	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759)	2026-10-11 07:58:53 +00:00
hyperbolic	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
inception	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
infinity	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
jina_ai	fix(llms): sanitize trailing slashes in provider get_complete_url (#42887)	2026-10-15 02:59:46 -07:00
lambda_ai	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
langflow	fix(ci): stop stale CI reds, keep unit tests off the host env, retry CyberArk policy conflicts (#43294)	2026-09-26 09:25:13 -07:00
langgraph	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
laya	feat: add Bespoke Nimble gateway and OSS classifier support (#44246)	2026-10-02 19:37:08 -07:00
lemonade	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
linkup	fix(llms): sanitize trailing slashes in provider get_complete_url (#42887)	2026-10-15 02:59:46 -07:00
litellm_proxy	fix(openai): send chat completions through client.post so the SDK's per-message param transform stops holding the event loop (#46967)	2026-10-16 18:06:01 -07:00
llamafile	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
lm_studio	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
manus	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
meta	fix(realtime)!: keep turn_detection.type when a transcript guardrail disables auto-response (#44939)	2026-10-16 15:24:40 +00:00
meta_llama	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
microsoft_365_copilot	fix(router)!: bound fake-streamed calls by the request timeout, not stream_timeout (#47162)	2026-10-17 22:08:02 +00:00
milvus	test: migrate legacy unit dirs and unrun folders into tests/unit, tests/integration and tests/e2e (#45940)	2026-10-11 06:24:57 -07:00
minimax	feat(minimax): add MiniMax-H3 and H3-Max video generation via /v1/videos (#43705)	2026-10-15 05:48:36 -07:00
mistral	fix(anthropic)!: answer 400 for a malformed tool_result text on /v1/messages and count_tokens (#47347)	2026-10-19 21:13:46 +00:00
modelscope	fix(llms): sanitize trailing slashes in provider get_complete_url (#42887)	2026-10-15 02:59:46 -07:00
mongodb	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
moonshot	fix(llms): sanitize trailing slashes in provider get_complete_url (#42887)	2026-10-15 02:59:46 -07:00
nadir	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
nebius	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
neosantara	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
nimble	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
nlp_cloud	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
novita	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
nscale	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
nvidia_nim	fix(openai): send chat completions through client.post so the SDK's per-message param transform stops holding the event loop (#46967)	2026-10-16 18:06:01 -07:00
nvidia_riva	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
oci	fix(oci): drop non-function tools under drop_params and gate reasoning_effort on declared levels (#40732)	2026-10-15 22:20:02 +00:00
ocr	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
ollama	fix(llms): sanitize trailing slashes in provider get_complete_url (#42887)	2026-10-15 02:59:46 -07:00
oobabooga	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
openai	fix(anthropic)!: answer 400 for a malformed tool_result text on /v1/messages and count_tokens (#47347)	2026-10-19 21:13:46 +00:00
openai_like	feat(openinfer): add OpenInfer as an OpenAI-compatible provider (#41034)	2026-10-17 23:22:19 +00:00
opencode	feat: add litellm.agent() to run claude code, codex, opencode and deep agents through the ai gateway (#43885)	2026-10-01 22:27:49 +00:00
openrouter	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
opensandbox	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
ovhcloud	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
parallel_ai	test: add __init__.py to phase 12 unit test directories	2026-09-20 12:36:15 +00:00
parasail	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
pass_through	fix(bedrock)!: scan Claude invoke-with-response-stream passthrough output with post_call guardrails (#46524)	2026-10-17 01:17:19 -07:00
perplexity	fix(openai): send chat completions through client.post so the SDK's per-message param transform stops holding the event loop (#46967)	2026-10-16 18:06:01 -07:00
pg_vector	fix(security): remove the publicly known master key from the repo (#44718)	2026-10-06 10:55:24 -07:00
publicai	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759)	2026-10-11 07:58:53 +00:00
ragflow	test: migrate legacy unit dirs and unrun folders into tests/unit, tests/integration and tests/e2e (#45940)	2026-10-11 06:24:57 -07:00
recraft	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
reducto	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
replicate	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
runwayml	test: add __init__.py to phase 12 unit test directories	2026-09-20 12:36:15 +00:00
s3_vectors	test: add __init__.py to intermediate phase 12 unit test directories	2026-09-20 12:37:21 +00:00
sagemaker	feat(sagemaker)!: inference components and OpenAI-compatible embeddings (#44985)	2026-10-12 22:25:52 +00:00
sail	test(e2e): align completion, SAIL, and spend-log fixtures with supported contracts (#43902)	2026-09-30 14:21:22 -07:00
sambanova	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
sap	fix(sap): correctly handle cache_control (#39122)	2026-10-06 08:54:06 -07:00
scaledown	feat(scaledown): add native text provider support (#44168)	2026-10-10 14:01:17 -07:00
scaleway	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759)	2026-10-11 07:58:53 +00:00
searchapi	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
searxng	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
serper	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
snowflake	fix(bedrock)!: keep reasoning, thinking blocks and the json_mode finish_reason on fake streams (#46863)	2026-10-16 17:27:57 +00:00
soniox	feat(soniox): decode proxy form fields for context, translation and flags (#40605)	2026-10-16 06:37:34 +00:00
stability	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
strands_decider	feat(strands_decider): call a Strands Decider on an AgentCore runtime ARN (#45678)	2026-10-09 22:51:19 -07:00
tavily	fix(llms): sanitize trailing slashes in provider get_complete_url (#42887)	2026-10-15 02:59:46 -07:00
tencent	refactor(anthropic): rename experimental_pass_through to pass_through (#43329)	2026-09-26 13:00:50 -07:00
tinyfish	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
together_ai	fix(responses bridge): round-trip tool_search_call and tool_search_output items between turns (#46444)	2026-10-14 21:40:14 -07:00
tool_loop	feat(harness): add Harness.TOOL_LOOP, a minimal in-process tool-calling loop (#44391)	2026-10-03 17:33:01 +00:00
topaz	fix(llms): sanitize trailing slashes in provider get_complete_url (#42887)	2026-10-15 02:59:46 -07:00
triton	test: move offline logging, secret manager and provider tests from legacy dirs into tests/unit (#45554)	2026-10-09 09:48:10 -07:00
v0	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
valkey	test: migrate legacy provider tests to tests/unit (wave 2, phase 13)	2026-09-20 14:18:49 +00:00
vercel_ai_gateway	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
vertex_ai	fix(vertex_ai): bill per-character text embeddings on Google's billableCharacterCount (#47460)	2026-10-19 18:17:29 -07:00
vllm	fix(vllm): write spend log rows for /vllm passthrough calls to router models (#45733)	2026-10-14 12:40:48 -07:00
volcengine	fix(openai): send chat completions through client.post so the SDK's per-message param transform stops holding the event loop (#46967)	2026-10-16 18:06:01 -07:00
voyage	fix(llms): sanitize trailing slashes in provider get_complete_url (#42887)	2026-10-15 02:59:46 -07:00
wandb	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
watsonx	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
xai	fix: preserve explicit provider for async image, audio, and realtime routes (#36346)	2026-10-15 05:21:43 -07:00
xinference	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
you_com	test: migrate phase 14 wave 2 provider tests to tests/unit	2026-09-20 11:01:40 +00:00
zai	test: add __init__.py to every tests/unit directory this migration touches	2026-09-20 11:52:09 +00:00
__init__.py	test(unit): add package markers to migrated unit test directories	2026-09-20 11:53:14 +00:00
test_cache_control_and_reasoning.py	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
test_custom_llm.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_file_content_block.py	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
test_file_search_responses.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_lifecycle_fix.py	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
test_oss_decision.py	feat(decisions): add Laya and Bespoke providers to the Add Model form (#45260)	2026-10-14 08:11:11 -07:00
test_polling_url_origin_match.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_predibase_transformation.py	fix(prompt-templates): treat initial_prompt_value and final_prompt_value as optional (#39762)	2026-10-16 10:30:59 +00:00