simonp9 f7b2cd0000 fix(anthropic): answer 400 naming a non-string role or tool call id instead of 500 (#49237) ... * fix(anthropic): answer 400 naming a non-string role or tool call id instead of 500 A list role or an object or list tool_call_id crashed the chat conversion with "unhashable type". Depending on the step that hit it, callers got a 500 or a 400 that never named the field. A failed conversion now answers 400 naming the first non-string role or tool call id, and the prompt caching hook reads a non-string answer id as matching no tool call. * fix(anthropic): name the field the conversion failed on, and answer 400 for a non-string Responses call_id The chat field check now runs only when the conversion raised a type error, and scans roles first, then assistant tool call ids, then tool answer ids, so an orphan tool answer that modify_params drops is no longer blamed. A tool output call_id that is not a string on /v1/responses answers 400 naming input[N].call_id, and the clear_tool_uses polyfill leaves a non-string tool_use_id for the provider * fix(anthropic): name a non-string role whatever error the conversion raised An int or bool role fails the conversion with an invalid message error, not a type error, so it lost the named 400. Roles are now named for any conversion failure, while tool call ids stay limited to type errors * fix(responses): name a non-string message item role by its input index * fix(responses): name a malformed input field only where litellm reads it, by the caller's index A tool output call_id is named only when it is an object or a list and the conversion fails, so an orphan numeric id still converts and another field's failure is never blamed on it. On the bridge to Claude a non-string role or function_call call_id is named by its input item, counting items before a compaction item. A numeric assistant tool call id on chat is named too. * fix(anthropic): name a tool id only for the error it causes and count Codex tool items in input indexes A numeric tool answer id that modify_params drops was blamed for any later type or attribute error, so the 400 hid the real cause. Tool ids are now named only for the error their value raises, and a hashable answer id never. The /v1/responses bridge and its input token count now read the input the caller sent, with only additional_tools hoisted into tools, so input[N] counts those items too. * fix(anthropic): name a tool id only for the error its own value causes and keep Codex tool item text out of the request * fix(responses): name a tool output call_id only when the items before it convert * fix(responses): name a non-string input field only on inference so token counting and batch records keep their answer * fix(responses): let a client field named caller_input or names_non_string_fields reach the bridge * test(anthropic): build the non-string id histories without editing them in place * fix(anthropic): never name an empty role for another field's failure * fix(anthropic): name an empty list or object role when the conversion fails on it * fix(anthropic): name a list role under the drop_params cache cap and keep the Bedrock batch line prefix --------- Co-authored-by: mateo-berri <277851410+mateo-berri@users.noreply.github.com>		2026-10-31 21:13:24 +00:00
..
arize	refactor(types): replace Any with proven types in 21 files (#48921)	2026-10-29 18:43:24 -07:00
azure_storage	feat(azure_storage): upload audit logs to Azure Storage via audit_log_callbacks (#43838)	2026-10-10 14:48:56 -07:00
bitbucket	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
clickhouse	fix(proxy): honor disable_end_user_cost_tracking in spend logs and end-user tables (#40945)	2026-10-15 21:48:20 +00:00
cloudzero	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
code_interpreter_interception	fix(websearch_interception): drop stream_options when forcing stream=False and replay it on the final stream (#45433)	2026-10-09 22:16:02 -07:00
compression_interception	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
datadog	fix(logging): mark mirrored silent_model calls with is_silent_experiment in spend logs (#48888)	2026-10-29 05:12:50 -07:00
dotprompt	refactor(typing): clear 1181 basedpyright Any errors across 431 files (#47789)	2026-10-24 11:31:09 -07:00
focus	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
gcs_bucket	fix(security)!: build proxy-only failure logs from an allowlist and drop caller guardrail info (#48599)	2026-10-27 12:40:59 -07:00
gcs_pubsub	fix(proxy): attribute retry attempt spend rows to their deployment and keep them out of daily request counts (#47658)	2026-10-20 23:33:01 +00:00
generic_api	fix: cap cold MCP schema workers at usable CPUs and deflake wall-clock unit tests (#45791)	2026-10-15 00:47:59 -07:00
gitlab	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
helicone	test: add __init__.py to migrated tests/unit packages	2026-09-20 11:53:49 +00:00
langfuse	fix: cap cold MCP schema workers at usable CPUs and deflake wall-clock unit tests (#45791)	2026-10-15 00:47:59 -07:00
levo	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
litellm_agent	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
mavvrik_focus	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
newrelic	refactor(typing): clear 1181 basedpyright Any errors across 431 files (#47789)	2026-10-24 11:31:09 -07:00
open_telemetry	fix(proxy): trace model list requests with the caller's traceparent (#49141)	2026-10-31 01:22:45 -07:00
opik	test(unit): wait on the work itself instead of fixed sleeps (#46261)	2026-10-13 12:41:06 -07:00
otel	fix(router): budget classifier input by provider limits (#49306)	2026-10-30 14:38:14 -07:00
pointfive	chore(lint): remove the LIT002 mutable-construction rule (#43971)	2026-10-01 12:24:02 -07:00
SlackAlerting	refactor(router): move router callers onto the entry points and invert the proxy imports (#48847)	2026-10-29 17:26:33 +00:00
ternary	feat(focus): add ternary destination for FOCUS export (#46106)	2026-10-12 22:52:40 -07:00
vantage	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
vector_store_integrations	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
websearch_interception	fix(websearch-interception)!: stream native server-tool blocks to clients (#40967)	2026-10-30 00:06:57 -07:00
zerobus	test(zerobus): move tests into active CI selection (#43235)	2026-09-25 23:35:15 +00:00
__init__.py	test: add __init__.py to migrated tests/unit packages	2026-09-20 11:53:49 +00:00
conftest.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
rubrik_test_helpers.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_adaptive_concurrency.py	fix(s3_v2): upload fresh events first, drop terminal failures and hour-old retries by default, opt-in adaptive concurrency (#43022)	2026-09-26 14:58:28 -07:00
test_agentops.py	fix(caching): key cached async clients by a per-loop token instead of id(loop) (#48877)	2026-10-29 13:14:48 -07:00
test_anthropic_cache_control_hook.py	fix(anthropic): answer 400 naming a non-string role or tool call id instead of 500 (#49237)	2026-10-31 21:13:24 +00:00
test_argilla.py	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
test_athina.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_azure_sentinel.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_braintrust_logging.py	test: move routing, caching and callback tests out of local_testing (#45761)	2026-10-10 09:33:09 -07:00
test_braintrust_span_name.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_custom_callback_input.py	test: move routing, caching and callback tests out of local_testing (#45761)	2026-10-10 09:33:09 -07:00
test_custom_guardrail.py	fix(responses): run the guardrails a Responses WebSocket frame selects (#48725)	2026-10-30 14:12:51 -07:00
test_custom_guardrail_recursion.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_custom_logger.py	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
test_custom_prompt_management.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_deepeval.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_galileo.py	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
test_guardrail_logging_sync.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_helicone.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_humanloop.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_langfuse.py	fix(logging): mark mirrored silent_model calls with is_silent_experiment in spend logs (#48888)	2026-10-29 05:12:50 -07:00
test_langfuse_otel.py	fix(otel)!: give key/team Langfuse destinations user, tags and session on OTel v2 without global Langfuse keys (#48718)	2026-10-29 12:19:08 -07:00
test_langsmith.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_langsmith_init.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_lunary.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_mlflow.py	test(unit): wait on the work itself instead of fixed sleeps (#46261)	2026-10-13 12:41:06 -07:00
test_openmeter.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_opentelemetry.py	fix(router): budget classifier input by provider limits (#49306)	2026-10-30 14:38:14 -07:00
test_opentelemetry_dynamic_imports.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_opentelemetry_request_spans.py	test: replace 61 live logging and otel tests with offline unit and integration coverage (#45362)	2026-10-08 15:55:57 -07:00
test_opik_utils.py	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
test_otel_guardrail_violation_spans.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_otel_team_attributes_matrix.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_posthog.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_prometheus_api_promql_escape.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_budget_metric_guard.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_budget_metrics_db_lookups.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_budget_metrics_timeout.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_cache_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_caller_identity.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_carried_budget_state.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_client_ip_user_agent.py	feat(prometheus): expose per-project per-model rate limit allowed and used gauges (#43561)	2026-10-08 12:03:29 -05:00
test_prometheus_custom_metadata_label_counts.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_deployment_state_proxy_rejects.py	fix(proxy)!: answer 400 for malformed tools on count_tokens instead of crashing (#46583)	2026-10-16 14:57:53 -07:00
test_prometheus_end_user_cardinality.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_input_sequence_length_label.py	feat(ui): add auto-router usage and savings table (#45152)	2026-10-07 15:04:07 -07:00
test_prometheus_invalid_key_filtering.py	fix(prometheus): count provider-side 401s in LLM failure and deployment metrics (#46668)	2026-10-26 17:57:06 -07:00
test_prometheus_labels.py	fix(passthrough): log the URL model and declared provider on Gemini and Vertex failures (#49075)	2026-10-30 09:40:58 -07:00
test_prometheus_mcp_tool_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_media_generation_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_metric_name_consistency.py	fix(proxy): cooldown errors carry 429, Sentry starts at boot without request bodies, tracing failures log at ERROR, exporter counters exported (#46344)	2026-10-16 00:53:52 +00:00
test_prometheus_metrics_endpoint.py	test(unit): wait on the work itself instead of fixed sleeps (#46261)	2026-10-13 12:41:06 -07:00
test_prometheus_missing_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_none_metadata.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_overhead_with_guardrails.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_queue_guardrail_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_rate_limit_labels.py	fix(prometheus): skip custom metadata labels a metric already carries (#46267)	2026-10-13 18:20:52 -07:00
test_prometheus_remaining_tokens_router_fallback.py	refactor(router): move router callers onto the entry points and invert the proxy imports (#48847)	2026-10-29 17:26:33 +00:00
test_prometheus_requested_model_cardinality.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_series_cardinality.py	feat(prometheus): cap series per metric for every labeled metric (#44420)	2026-10-06 01:28:44 +00:00
test_prometheus_service_tier_label.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_services.py	test: move routing, caching and callback tests out of local_testing (#45761)	2026-10-10 09:33:09 -07:00
test_prometheus_spend_capture_rate.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_spend_logs_metadata.py	fix(logging): mark mirrored silent_model calls with is_silent_experiment in spend logs (#48888)	2026-10-29 05:12:50 -07:00
test_prometheus_stream_label.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_token_detail_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_user_team_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_zero_cost_metric.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prompt_manager_ssti.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_responses_background_cost.py	fix(responses): send the billed background response cost to the creating key's and team's loggers (#47506)	2026-10-20 23:22:21 +00:00
test_rubrik.py	feat(guardrails): honor litellm_params.timeout in every HTTP guardrail (#43134)	2026-09-30 21:18:47 -07:00
test_s3.py	feat(s3_v2): add s3_partition_granularity option for hourly S3 folders (#43748)	2026-10-01 11:00:21 -07:00
test_s3_v2.py	fix(s3): bound object key filenames (#40825)	2026-10-15 12:59:35 -07:00
test_shadow_eval_logger.py	refactor(router): move router callers onto the entry points and invert the proxy imports (#48847)	2026-10-29 17:26:33 +00:00
test_sqs.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_wandb.py	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
test_weave_otel.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00