litellm/tests/pass_through_tests
Yuneng Jiang feffb62266
test: refresh the suites that drifted from langfuse and OpenAI's retired Assistants API
Two unrelated causes, both leaving staging red with tests that no longer describe
anything true.

#38264 gave LangFuseLogger a langfuse_environment argument and started carrying it
in the credentials dict. The handler test's fake logger did not accept the new
keyword, so constructing it raised TypeError, and four cases in
test_langfuse_unit_tests rebuilt the cache key by hand from three fields and missed
on the four-field key production now writes. Caching itself was never broken: the
handler sets and gets with the same dict. The fake now takes the argument and
asserts it is forwarded, and the cache assertion issues a second identical request
and expects the same logger back, which is the behaviour that matters and cannot
rot the next time a credential field is added.

OpenAI has retired the Assistants API. /v1/assistants and /v1/threads both answer
404 with a valid key, where every live route answers 401, so nothing calling them
can pass again. test_custom_logger_passthrough covered generic passthrough logging
and only used assistants because it is a route with no provider-specific handler;
it moves to /v1/moderations, which is still unclaimed by
_is_supported_openai_endpoint, so the same generic branch is exercised. The two
tests there asserted the same thing against different dead routes, so they collapse
into one. The Ruby suite existed solely to drive assistants, threads, messages and
runs, so it goes along with the RVM and bundler steps that were installed only to
run it, and the two dead OpenAI assistants cases leave
test_openai_assistants_passthrough.

The Azure assistants case in that file stays. Azure runs its own lifecycle and I
could not reach the CI deployment to check whether that API is still there.
2026-08-27 23:24:36 -07:00
..
base_anthropic_messages_test.py [Test] Anthropic Passthrough: Bump Thinking Tests Off Legacy Sonnet 4 Alias 2026-05-01 19:33:08 -07:00
package-lock.json chore(deps): bump deps (#28528) 2026-05-22 00:42:21 +00:00
package.json chore(deps): refresh dependency locks 2026-05-04 11:36:18 -07:00
test_anthropic_passthrough.py [Test] Anthropic Passthrough: Bump Streaming Cost-Injection Test To Haiku 4.5 2026-05-01 19:22:39 -07:00
test_anthropic_passthrough_basic.py test_anthropic_messages_to_wildcard_model 2026-01-07 15:03:06 +05:30
test_anthropic_passthrough_python_sdkpy fix test claude-sonnet-4-5-20250929 2025-10-31 18:13:29 -07:00
test_assembly_ai.py use mock tests for assembly AI 2026-03-30 19:59:32 -07:00
test_gemini.js (feat) use @google-cloud/vertexai js sdk with litellm (#6873) 2024-11-22 16:50:10 -08:00
test_gemini_with_spend.test.js test(pass-through): move Gemini pass-through tests to gemini-3.1-flash-lite (#29595) 2026-06-03 10:17:38 -07:00
test_hosted_vllm_passthrough.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_local_gemini.js test(pass-through): move Gemini pass-through tests to gemini-3.1-flash-lite (#29595) 2026-06-03 10:17:38 -07:00
test_local_vertex.js test(pass-through): move Gemini pass-through tests to gemini-3.1-flash-lite (#29595) 2026-06-03 10:17:38 -07:00
test_mcp_routes.py add litellm mcp endpoints 2025-03-20 21:12:56 -07:00
test_openai_assistants_passthrough.py test: refresh the suites that drifted from langfuse and OpenAI's retired Assistants API 2026-08-27 23:24:36 -07:00
test_vertex.test.js test(vcr): close out the remaining VCR live-call leaks (#29603) 2026-06-03 13:46:43 -07:00
test_vertex_ai.py test(pass-through): de-flake vertex spend-log test by routing through the proxy (#31689) 2026-06-30 15:27:48 -07:00
test_vertex_with_spend.test.js test(vcr): close out the remaining VCR live-call leaks (#29603) 2026-06-03 13:46:43 -07:00
vertex_key.json test: update to new vertex ai keys 2026-03-28 20:19:05 -07:00
vertex_test_helpers.js test(vcr): close out the remaining VCR live-call leaks (#29603) 2026-06-03 13:46:43 -07:00