mirror of
https://github.com/BerriAI/litellm.git
synced 2026-10-25 05:54:53 +00:00
e8550c1454
* fix(openai): send chat completions through client.post so the SDK's per-message param transform stops holding the event loop create() walks every message, content part and tool of the request through openai._utils._transform before posting, 91 ms at 300k tokens and ~300 ms at 1M tokens on the event loop, and returns the same dict for the plain dicts litellm builds. client.post is what create() calls after that walk, same request, headers, retries, raw response and stream objects, so the chat helpers now call it directly through the helper embeddings already used * fix(openai): type the chat client.post result as LegacyAPIResponse so the type gate sees .headers and .parse * fix(openai): assert the chat client.post result is a LegacyAPIResponse instead of casting it * test(openai): stub client.post with a LegacyAPIResponse spec in the empty-response and no-leak tests * test(core-utils): stub client.post with a LegacyAPIResponse spec in the agentic loop leak test * test: every client.post stub on the OpenAI chat path returns a LegacyAPIResponse-spec'd mock --------- Co-authored-by: devin-ai-integration[bot] <158243242+devin-ai-integration[bot]@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| batches | ||
| chat | ||
| completion | ||
| image_edit | ||
| image_generation | ||
| passthrough | ||
| realtime | ||
| response | ||
| search | ||
| text_to_speech | ||
| vector_stores | ||
| videos | ||
| __init__.py | ||
| test_audio_transcriptions.py | ||
| test_azure.py | ||
| test_azure_common_utils.py | ||
| test_azure_cost_calculation.py | ||
| test_azure_embedding.py | ||
| test_azure_exception_mapping.py | ||
| test_azure_fine_tuning_api.py | ||
| test_azure_ptu_capacity.py | ||
| test_azure_speech_audio_transcription.py | ||