mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-06 08:16:43 +00:00
65af77c43b
Staging split batch output-line costing into _safe_output_line_stats / _compute_output_line_stats / _output_line_cost so one uncostable line can no longer zero a whole batch, and added _provider_output_file_id so model-encoded output file ids decode before the fetch. This branch's pass/fail counting was written against the pre-split shape, where every None line meant a provider failure. Keep staging's structure and layer the counts on a three-way classification: a provider-reported failure yields PROVIDER_FAILED, a provider-successful line litellm cannot price yields UNCOSTABLE and stays in successful_requests billed at $0. Without that split a litellm-side pricing gap would be reported to the customer as a failed request and the counts would stop reconciling with the provider's own request_counts. Route the error-file fetch through _provider_output_file_id too, and carry the new dataclass return through the callers staging added after this branch forked. |
||
|---|---|---|
| .. | ||
| batch_job_results_furniture.jsonl | ||
| bedrock_batch_completions.jsonl | ||
| conftest.py | ||
| openai_batch_completions.jsonl | ||
| pathrise-convert-1606954137718.json | ||
| test_batch_custom_pricing.py | ||
| test_batch_rate_limits.py | ||
| test_batches_logging_unit_tests.py | ||
| test_bedrock_files_and_batches.py | ||
| test_fine_tuning_api.py | ||
| test_manus_files_all_methods.py | ||
| test_openai_batches_and_files.py | ||
| vertex_batch_completions.jsonl | ||