kerry
5034b96fb6
Merge remote-tracking branch 'origin/litellm_cost_shard_pricing_dimensions' into litellm_cost_shard_provider_wires
2026-09-21 21:04:37 +00:00
kerry
b0070892da
Merge remote-tracking branch 'origin/main' into litellm_cost_shard_pricing_dimensions
2026-09-21 21:04:26 +00:00
kerry-berri
b5f02f72fe
Merge pull request #42028 from BerriAI/litellm_cost_shard_passthrough
...
test(integration): passthrough route cost cases
2026-09-21 14:04:03 -07:00
kerry-berri
89de508d6e
Merge pull request #42306 from BerriAI/litellm_fal_ai_surface_video_errors
...
fix(fal_ai): surface fal errors in video status and content instead of completed and generic 500
2026-09-21 13:59:04 -07:00
kerry
edc34a2921
chore: merge litellm_cost_shard_pricing_dimensions into litellm_cost_shard_provider_wires
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:49:55 +00:00
kerry
7ca6fda118
chore: merge litellm_cost_shard_passthrough into litellm_cost_shard_pricing_dimensions
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:47:34 +00:00
kerry
61ea3e0226
chore: merge litellm_cost_shard_audio_images into litellm_cost_shard_passthrough
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:46:44 +00:00
kerry
0afb9bb587
chore: merge main into litellm_cost_shard_audio_images
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:36:48 +00:00
kerry-berri
5d3dfe9b70
chore: merge litellm_cost_shard_pricing_dimensions into litellm_cost_shard_provider_wires
2026-09-21 20:25:17 +00:00
kerry-berri
5b51be83b8
chore: merge litellm_cost_shard_passthrough into litellm_cost_shard_pricing_dimensions
2026-09-21 20:25:13 +00:00
kerry-berri
f63a85e9cc
chore: merge litellm_cost_shard_audio_images into litellm_cost_shard_passthrough
2026-09-21 20:25:10 +00:00
kerry-berri
134c7111a5
chore: merge litellm_cost_shard_harness_extensions into litellm_cost_shard_audio_images
2026-09-21 20:24:37 +00:00
kerry-berri
7b1283ba18
chore: merge litellm_cost_shard_harness_extensions into litellm_cost_shard_embeddings_rerank
2026-09-21 20:24:32 +00:00
kerry
1ae2c0938a
chore: merge main into litellm_cost_shard_harness_extensions
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:23:58 +00:00
kerry
a909a7908e
fix(fal_ai): surface fal errors in video status and content
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:17:29 +00:00
kerry
8d73ce756a
feat(fal_ai): add MiniMax H3 text-to-video and reference-to-video
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 19:03:00 +00:00
kerry
7510697355
test(integration): fal image generation and edit wire contracts
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 17:39:53 +00:00
kerry-berri
af1f46af1a
Merge pull request #41980 from BerriAI/litellm_fal_seedance_video
...
feat(fal_ai): add Seedance 2.5 / 2.0 video generation via fal queue API
2026-09-20 10:18:48 -07:00
joshua-berri
daecea3eb8
Merge pull request #42050 from BerriAI/litellm_mcp_scoped_regressions_4506_rework
...
test(mcp): restore scoped execution and credential isolation regressions
2026-09-20 01:29:44 +00:00
kerry
a4488fccca
test(integration): add provider wire cost cases
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-19 23:45:51 +00:00
Joshua Valluru
479360ae87
test(mcp): restore scoped execution and credential isolation regressions
2026-09-19 16:41:31 -07:00
kerry
02736e20cc
fix(test): repin fireworks fallback cache-read case to the 50% default
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-19 23:33:29 +00:00
kerry
9a63e06c63
test(integration): cover fal Seedance video queue wire contract
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-19 23:28:51 +00:00
Mateo Wang
57c757e9d7
Revert "test(mcp): verify scoped execution and OAuth credential isolation"
2026-09-19 16:10:47 -07:00
kerry
c7113f043a
test(integration): use per-run request ids, drop unbillable perplexity search case
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-19 23:01:25 +00:00
kerry
72b007a4ae
test(integration): pricing dimension and provider cost cases
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-19 22:46:43 +00:00
kerry
110d4c2ad1
test(integration): add passthrough cost cases
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-19 22:05:57 +00:00
kerry
247c4dd68f
Merge remote-tracking branch 'origin/litellm_cost_shard_harness_extensions' into litellm_cost_shard_audio_images
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
# Conflicts:
# tests/integration/contracts.json
# tests/integration/cost_calculation/cost_tracking_case.py
# tests/integration/cost_calculation/cost_tracking_cases.json
2026-09-19 21:25:39 +00:00
kerry
f038a0558c
Merge remote-tracking branch 'origin/litellm_cost_shard_harness_extensions' into litellm_cost_shard_embeddings_rerank
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
# Conflicts:
# tests/integration/contracts.json
# tests/integration/cost_calculation/cost_tracking_case.py
# tests/integration/cost_calculation/cost_tracking_cases.json
2026-09-19 21:22:26 +00:00
kerry
c0c5cc84f8
test(integration): audio, image and per-unit cost cases
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-19 21:19:29 +00:00
kerry
8137d878a0
test(integration): drop contract nodes left behind by case renames
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-19 20:59:05 +00:00
kerry
125bda30e9
test(integration): embeddings, rerank, completions and moderations cost cases
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-19 20:58:13 +00:00
Joshua Valluru
a41b60cf77
test(mcp): align live regressions with discovery and error contracts
2026-09-19 13:03:00 -07:00
kerry
22d3441789
Merge branch 'litellm_cost_shard_harness_extensions' into litellm_cost_shard_responses_messages
2026-09-19 19:53:49 +00:00
kerry
8907a1d1fc
test: add native responses and messages cost cases
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-19 19:52:43 +00:00
kerry
9bd648baf5
test(integration): price fireworks cached input at the 50% default
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-19 19:22:25 +00:00
Joshua Valluru
e0b6bae516
test(mcp): cover scoped execution and OAuth credential isolation
2026-09-19 12:14:32 -07:00
Joshua Valluru
6f74aa80c0
chore: merge main into MCP regression coverage branch
2026-09-19 12:06:21 -07:00
kerry
c958f9db7e
test: extend cost tracking integration harness
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-19 18:44:51 +00:00
kerry-berri
6718fd67fb
Merge pull request #41328 from BerriAI/litellm_e2e_cost_calculation_scripted_provider
...
test(integration): literal request/response cost tracking suite on a test-owned cost map
2026-09-19 09:40:04 -07:00
kerry
ed0c32cdb0
test(integration): drive cost tracking from literal request/response data
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-19 04:04:40 +00:00
kerry
69f9106759
test(integration): move scripted-provider cost suite into cost shard
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-19 00:16:12 +00:00
kerry
83d89aa134
test(integration): cover off-peak pricing on a live proxy
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-19 00:10:22 +00:00
Joshua Valluru
15b45839e1
test(mcp): enforce security regression contracts through live gateway
2026-09-17 17:37:40 -07:00
Yuneng Jiang
fa01e2d5b7
Merge branch 'main' into litellm_/buildkite-241-triage-4a48cf
2026-09-17 10:39:37 -07:00
Yuneng Jiang
c3048dcd30
test(http): move the outbound HTTP/2 check into a new integration sdk suite
...
The check spins up a hypercorn TLS peer and drives the SDK's own httpx
handlers at it, so it needs litellm importable, hypercorn installed and a
loopback socket. It lived under tests/e2e, whose Buildkite runner image
installs neither litellm nor hypercorn by design (the suite drives a
remote proxy over HTTP), so every scheduled e2e build since #230 failed
to import the module and pytest reported it as a collection error. The
unit tree bans sockets, so it does not belong there either
tests/integration is the CircleCI tier built for real TCP against local
protocol peers. This adds an sdk shard to it for cases that exercise the
SDK's clients with no gateway in the path, registers the two HTTP/2
nodes in the contracts manifest, and adds the shard to the CircleCI
matrix. The test now flips the feature through LITELLM_HTTP2 (the user
surface) instead of patching module attributes, and asserts the version
the peer observed on the wire next to the one the client reports
2026-09-17 10:37:07 -07:00
Yuneng Jiang
4210f586c2
test(management): cover project authorization lifecycle
2026-09-16 23:08:00 -07:00
Yuneng Jiang
c00f1b4a5c
test: add extension and browser integration contracts
...
Terraform Provider / gofmt, vet, build, test (push) Has been cancelled
Terraform Provider / Provider endpoints vs proxy OpenAPI schema (push) Has been cancelled
LiteLLM Rust / rust-lint (push) Has been cancelled
LiteLLM Rust / rust-test (push) Has been cancelled
Adds integration contracts for MCP lifecycle, protocol errors and OAuth
configuration, A2A wire versions, the OpenAI consumer path, persisted
toolsets, callback delivery, guardrail effects, configured prices, the
filtered spend ledger, and a CircleCI-owned browser flow for project
detachment, with the ASGI, browser-state, client and MCP helpers they use.
Consolidates the eleven commits previously stacked on
litellm_integration_providers onto its rebased tip
2026-09-16 13:15:53 -07:00
Yuneng Jiang
7679e42736
test: cover provider wire contracts, streaming and recovery
...
Adds owned local TCP peers, a Redis process helper and SigV4 helpers to
tests/integration, and integration contracts for Anthropic and Bedrock wire
shapes, Bedrock role configuration, S3 wire, observed routing, Redis
recovery and stream contracts. Consolidates the four commits previously
stacked on litellm_integration_accounting onto its main-merged tip
2026-09-16 12:48:30 -07:00
Yuneng Jiang
682296ad68
test: verify database transactions and persisted accounting contracts
2026-09-14 05:00:32 -07:00