scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-08-28 05:25:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 8
litellm/tests/pass_through_unit_tests
History
yucheng-berri 8449ecee6a
fix(streaming): stamp completion_start_time on first chunk for /v1/messages and /v1/responses (#32284) 
Streaming pass-through for native Anthropic /v1/messages and the /v1/responses
streaming iterator never set logging_obj.completion_start_time, so
_success_handler_helper_fn fell back to completion_start_time = end_time.
Downstream TTFT consumers (Prometheus, OTEL, Langfuse, Admin UI, spend logs
completionStartTime) then reported time-to-first-token equal to total request
duration.

Stamp completion_start_time on the first chunk in PassThroughStreamingHandler.
chunk_processor and BaseResponsesAPIStreamingIterator._process_chunk, mirroring
CustomStreamWrapper for /chat/completions.

Resolves LIT-4185

Co-authored-by: yucheng <yucheng@yuchengs-MBP.localdomain>
2026-07-06 19:30:31 -07:00
..
messages_api_structured_output style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
base_anthropic_messages_prompt_caching_test.py test(vcr): close out the remaining VCR live-call leaks (#29603) 2026-06-03 13:46:43 -07:00
base_anthropic_messages_tool_search_test.py chore(ci): modernize model references in tests and configs (#27856) 2026-05-15 15:44:28 -07:00
base_anthropic_unified_messages_test.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
conftest.py test(vcr): close out the remaining VCR live-call leaks (#29603) 2026-06-03 13:46:43 -07:00
test_anthropic_messages_passthrough.py chore(ci): modernize model references in tests and configs (#27856) 2026-05-15 15:44:28 -07:00
test_anthropic_messages_prompt_caching.py fix(tests): use Sonnet 4.5 for Bedrock invoke prompt-caching tests 2026-04-28 14:51:47 -07:00
test_anthropic_messages_tool_search.py chore(ci): modernize model references in tests and configs (#27856) 2026-05-15 15:44:28 -07:00
test_assemblyai_unit_tests_passthrough.py fix: block path traversal SSRF in BitBucket, Arize Phoenix, and AssemblyAI clients (#26943) 2026-05-01 11:45:12 -07:00
test_bedrock_anthropic_messages_test.py chore(ci): modernize model references in tests and configs (#27856) 2026-05-15 15:44:28 -07:00
test_bedrock_tool_use_beta_header.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_claude_code_marketplace.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_context_management_polyfill.py feat(context_management): compact_20260112 polyfill for non-Anthropic providers (#28868) 2026-05-30 09:20:05 -07:00
test_custom_logger_passthrough.py chore(ci): modernize model references in tests and configs (#27856) 2026-05-15 15:44:28 -07:00
test_pass_through_unit_tests.py fix(bedrock): support tool search results + chat annotations (#29120) 2026-05-29 20:48:36 -07:00
test_passthrough_managed_ids.py feat(pass_through): extend passthrough_managed_object_ids to Azure (#29160) 2026-05-30 16:30:10 -07:00
test_passthrough_registry_updates.py Fix passthrough tests 2026-02-20 17:28:06 -08:00
test_unit_test_anthropic_pass_through.py fix: passthrough endpoints duplicate logs (#29598) 2026-06-03 12:13:02 -07:00
test_unit_test_passthrough_router.py test_get_credentials_from_env 2026-03-30 16:02:14 -07:00
test_unit_test_streaming.py test(proxy): set status_code on chunk_processor response mocks 2026-07-04 12:49:54 -07:00
test_vertex_ai_anthropic_streaming_cost_injection.py fix(streaming): stamp completion_start_time on first chunk for /v1/messages and /v1/responses (#32284) 2026-07-06 19:30:31 -07:00
test_vertex_ai_live_passthrough.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_websearch_interception_e2e.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00