litellm/tests/pass_through_tests
Mateo Wang 4ccc32312d
test(pass_through): harden vertex spendlog poll against transient empty reads (#30683)
test_basic_vertex_ai_pass_through_with_spendlog failed intermittently on
litellm_internal_staging (pipelines 82155, 82196, 82209, 82230) with "Spend
should be greater than before after 120s". Spend logging is async and batched,
so the pass-through call's cost sometimes had not landed within the 120s poll
window; one run ended on spend_after 0.0 because the final /global/spend/logs
read returned nothing and "or 0.0" recorded that as zero spend.

Widen the poll window to 240s and skip a transient empty read instead of
treating it as 0.0, so a momentary endpoint hiccup on the last poll no longer
fails an otherwise-billed call. The spend_after > spend_before assertion is
unchanged, so a genuinely unbilled call still fails the test
2026-06-17 15:11:44 -07:00
..
ruby_passthrough_tests test: harden remaining pass-through CI flakes (image-gen spend poll, ruby assistants timeout) (#30685) 2026-06-17 14:35:47 -07:00
base_anthropic_messages_test.py [Test] Anthropic Passthrough: Bump Thinking Tests Off Legacy Sonnet 4 Alias 2026-05-01 19:33:08 -07:00
package-lock.json chore(deps): bump deps (#28528) 2026-05-22 00:42:21 +00:00
package.json chore(deps): refresh dependency locks 2026-05-04 11:36:18 -07:00
test_anthropic_passthrough.py [Test] Anthropic Passthrough: Bump Streaming Cost-Injection Test To Haiku 4.5 2026-05-01 19:22:39 -07:00
test_anthropic_passthrough_basic.py test_anthropic_messages_to_wildcard_model 2026-01-07 15:03:06 +05:30
test_anthropic_passthrough_python_sdkpy fix test claude-sonnet-4-5-20250929 2025-10-31 18:13:29 -07:00
test_assembly_ai.py use mock tests for assembly AI 2026-03-30 19:59:32 -07:00
test_gemini.js (feat) use @google-cloud/vertexai js sdk with litellm (#6873) 2024-11-22 16:50:10 -08:00
test_gemini_with_spend.test.js test(pass-through): move Gemini pass-through tests to gemini-3.1-flash-lite (#29595) 2026-06-03 10:17:38 -07:00
test_hosted_vllm_passthrough.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_local_gemini.js test(pass-through): move Gemini pass-through tests to gemini-3.1-flash-lite (#29595) 2026-06-03 10:17:38 -07:00
test_local_vertex.js test(pass-through): move Gemini pass-through tests to gemini-3.1-flash-lite (#29595) 2026-06-03 10:17:38 -07:00
test_mcp_routes.py add litellm mcp endpoints 2025-03-20 21:12:56 -07:00
test_openai_assistants_passthrough.py fix: always retain config models 2025-10-11 16:09:33 -07:00
test_vertex.test.js test(vcr): close out the remaining VCR live-call leaks (#29603) 2026-06-03 13:46:43 -07:00
test_vertex_ai.py test(pass_through): harden vertex spendlog poll against transient empty reads (#30683) 2026-06-17 15:11:44 -07:00
test_vertex_with_spend.test.js test(vcr): close out the remaining VCR live-call leaks (#29603) 2026-06-03 13:46:43 -07:00
vertex_key.json test: update to new vertex ai keys 2026-03-28 20:19:05 -07:00
vertex_test_helpers.js test(vcr): close out the remaining VCR live-call leaks (#29603) 2026-06-03 13:46:43 -07:00