mirror of
https://github.com/BerriAI/litellm.git
synced 2026-10-01 02:02:20 +00:00
abc85c2651
* feat(cost_calculator): add cost_per_second for chat per-second pricing Keep legacy input_cost_per_second and output_cost_per_second as aliases for chat, completion, embedding and responses. When both legacy fields are set, input_cost_per_second wins Move Bedrock commitment rows to cost_per_second so they bill once Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * refactor(cost_calculator): drop legacy per-second fields from chat paths Keep Azure chat token pricing generic and update inert Voxtral rates and SageMaker examples Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(cost_calculator): recognize output-only per-second rates Include output_cost_per_second when checking whether a deployment cost entry has pricing so output-only legacy aliases remain attached to the deployment during cost selection Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(pricing): cover cost_per_second and legacy per-second aliases through the proxy Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * refactor(cost_calculator): drop output_cost_per_second as a chat per-second alias Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * feat(cost_calculator): restore output_cost_per_second as a chat per-second fallback Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(cost-map): keep input_cost_per_second on bedrock commitment rows for older clients Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> --------- Co-authored-by: kerry <kerry@berri.ai> Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| ai_coding_tool_guides | ||
| anthropic_agent_sdk | ||
| benchmark | ||
| codellama-server | ||
| community-resources | ||
| gollem_go_agent_framework | ||
| litellm-ollama-docker-image | ||
| litellm_proxy_server | ||
| litellm_router | ||
| litellm_router_load_test | ||
| livekit_agent_sdk | ||
| logging_observability | ||
| misc | ||
| mock_guardrail_server | ||
| mock_prompt_management_server | ||
| Benchmarking_LLMs_by_use_case.ipynb | ||
| Claude_(Anthropic)_with_Streaming_liteLLM_Examples.ipynb | ||
| Evaluating_LLMs.ipynb | ||
| google_adk_litellm_tutorial.ipynb | ||
| liteLLM_A121_Jurrasic_example.ipynb | ||
| LiteLLM_Azure_and_OpenAI_example.ipynb | ||
| liteLLM_Baseten.ipynb | ||
| LiteLLM_batch_completion.ipynb | ||
| LiteLLM_Bedrock.ipynb | ||
| liteLLM_clarifai_Demo.ipynb | ||
| LiteLLM_CometAPI.ipynb | ||
| LiteLLM_Comparing_LLMs.ipynb | ||
| LiteLLM_Completion_Cost.ipynb | ||
| liteLLM_function_calling.ipynb | ||
| liteLLM_Getting_Started.ipynb | ||
| LiteLLM_HuggingFace.ipynb | ||
| liteLLM_IBM_Watsonx.ipynb | ||
| liteLLM_Langchain_Demo.ipynb | ||
| litellm_model_fallback.ipynb | ||
| LiteLLM_NovitaAI_Cookbook.ipynb | ||
| liteLLM_Ollama.ipynb | ||
| LiteLLM_OpenRouter.ipynb | ||
| LiteLLM_Petals.ipynb | ||
| LiteLLM_PromptLayer.ipynb | ||
| liteLLM_Replicate_Demo.ipynb | ||
| liteLLM_Streaming_Demo.ipynb | ||
| litellm_test_multiple_llm_demo.ipynb | ||
| litellm_Test_Multiple_Providers.ipynb | ||
| LiteLLM_User_Based_Rate_Limits.ipynb | ||
| liteLLM_VertextAI_Example.ipynb | ||
| Migrating_to_LiteLLM_Proxy_from_OpenAI_Azure_OpenAI.ipynb | ||
| mlflow_langchain_tracing_litellm_proxy.ipynb | ||
| nova_sonic_realtime.py | ||
| Parallel_function_calling.ipynb | ||
| Proxy_Batch_Users.ipynb | ||
| result.html | ||
| TogetherAI_liteLLM.ipynb | ||
| Using_Nemo_Guardrails_with_LiteLLM_Server.ipynb | ||
| veo_video_generation.py | ||
| VLLM_Model_Testing.ipynb | ||