mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-16 23:41:43 +00:00
152e233722
Stage 6 POC on top of the LIT-1697 stack. Adds an azure_billing branch to the daily rollup so a reservation with cost_source=azure_billing pulls accrued cost from the Azure Cost Management API instead of computing the manual (ptu_count * cost_per_ptu) / days-in-month formula. The client is a thin async wrapper around one endpoint the rollup needs; Entra ID auth is inherited from get_azure_ad_token_from_entra_id (no new dependency). Deliberately narrow: no retry, no reconciliation for Azure's 24-72h reporting lag, no UI toggle for cost_source. Those are follow-ups. Gated behind a second UI settings flag enable_azure_ptu_billing_pull that composes below enable_ptu_cost_attribution. The scheduler builds a fetcher just-in-time so runtime flag flips take effect without a proxy restart; manual reservations keep working when either flag is off. Behavior changes: azure_billing cost_source is now accepted by /ptu_reservation/new when azure_resource_id is present. The rollup uses the injected fetcher for those; when no fetcher is available (flag off or env creds missing) the reservation is skipped with a warning and no sentinel row is written. |
||
|---|---|---|
| .. | ||
| adaptive_router_demo | ||
| health_check | ||
| benchmark_anthropic_messages_perf.py | ||
| benchmark_chat_completions_perf.py | ||
| benchmark_mock.py | ||
| benchmark_model_response_creator.py | ||
| benchmark_proxy_vs_provider.py | ||
| benchmark_streaming_chunk_overhead.py | ||
| budget_ratchet_check.py | ||
| check_type_discipline.py | ||
| create_litellm_branch.ps1 | ||
| create_litellm_branch.sh | ||
| create_team_key_and_submit_guardrail.sh | ||
| eval_compression.py | ||
| install-cli.sh | ||
| install.sh | ||
| install_git_hooks.sh | ||
| mock_bedrock_passthrough_target.py | ||
| mock_grayswan_timeout_server.py | ||
| mutation_report.py | ||
| pre_commit_lint.sh | ||
| prisma_generate_if_needed.py | ||
| ptu_reservation_backfill.py | ||
| ruff_strict_gate.py | ||
| test_agent_mcp_endpoints.sh | ||
| test_guardrails_register_endpoints.sh | ||
| test_tool_allowlist_script.py | ||
| tpm_headline_test.sh | ||
| type_check_gate.py | ||
| type_discipline_gate.py | ||
| verify_adaptive_router.py | ||