Commit graph

10107 commits

Author SHA1 Message Date
Ishaan Jaffer
98de60e741 test_completion_gpt4_turbo 2026-03-30 16:35:31 -07:00
Ishaan Jaffer
37bcc3252f test_completion_gpt4_turbo 2026-03-30 16:35:10 -07:00
Krrish Dholakia
c7e2bfc577 fix: cleanup tests 2026-03-30 16:24:35 -07:00
Krrish Dholakia
7b532fda66 test: cleanup tests 2026-03-30 16:20:01 -07:00
Ishaan Jaffer
899b5710d1 TestAzureAIFlux2ImageEdit 2026-03-30 16:15:03 -07:00
Krrish Dholakia
4c00a14ce0 fix: fix ci/cd + handle oidc jwt tokens 2026-03-30 16:12:58 -07:00
Ishaan Jaffer
e8c860d450 test fix 2026-03-30 16:05:03 -07:00
Ishaan Jaffer
bae3dcde13 test_get_credentials_from_env 2026-03-30 16:02:14 -07:00
Ishaan Jaffer
431782c3fe test azure blob storage 2026-03-30 15:54:07 -07:00
yuneng-jiang
c569d1f867
Merge pull request #24820 from BerriAI/litellm_fix_test_kwarg_name
[Fix] Correct kwarg name in test_user_api_key_auth tests
2026-03-30 15:37:27 -07:00
Ishaan Jaffer
dd75434bbe remove - outdated test 2026-03-30 15:29:57 -07:00
Ishaan Jaffer
87debe6254 test_litellm_overhead_non_streaming 2026-03-30 15:20:53 -07:00
Yuneng Jiang
6522d282b5
[Fix] Correct kwarg name in test_user_api_key_auth tests
PR #24755 renamed `azure_api_key_header` to `AZURE_AI_API_KEY_header` in
the test file but did not update the actual function signatures of
`get_api_key()` and `_user_api_key_auth_builder()`, causing TypeError
on all affected test cases.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-30 14:51:09 -07:00
yuneng-jiang
f2deefe453
Merge pull request #24814 from BerriAI/litellm_/agitated-montalcini
[Fix] WatsonX Tests Failing on CI Due to Missing Env Vars
2026-03-30 14:35:51 -07:00
yuneng-jiang
4332a0bf0a
Merge pull request #24812 from BerriAI/litellm_/objective-mendel
[Fix] Router code coverage CI failure for health check filter tests
2026-03-30 14:11:53 -07:00
yuneng-jiang
bcfa5355ac
Merge pull request #24817 from BerriAI/litellm_/strange-jackson
[Fix] Update gemini-2.0-flash to gemini-2.5-flash in test_gemini
2026-03-30 14:05:23 -07:00
Yuneng Jiang
b39748daf2
[Fix] Update gemini-2.0-flash to gemini-2.5-flash in test_gemini integration tests
gemini-2.0-flash is no longer available to new users, causing 404 errors
in llm_translation_testing tests.
2026-03-30 13:53:38 -07:00
Yuneng Jiang
123052ecf8
[Fix] WatsonX tests failing on CI due to missing env vars
Tests are fully mocked but require WATSONX_URL and WATSONX_PROJECT_ID
to pass provider validation before reaching the mocked HTTP client.
Add an autouse fixture with dummy values and clear WATSONX_ZENAPIKEY/
WATSONX_TOKEN to prevent env leakage from dotenv.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-30 13:27:03 -07:00
Yuneng Jiang
4f03273285
Merge remote-tracking branch 'origin/main' into litellm_/objective-mendel 2026-03-30 13:16:15 -07:00
Yuneng Jiang
fc32f91ffd
[Fix] Rename test file so router code coverage check detects it
The router_code_coverage.py script only scans test files with "router" in the filename.
test_health_check_routing.py was invisible to this check, causing _async_filter_health_check_unhealthy_deployments
and _filter_health_check_unhealthy_deployments to appear untested.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-30 13:13:41 -07:00
yuneng-jiang
0ccaff8ed9
Merge pull request #24805 from BerriAI/litellm_/compassionate-kirch
[Test] Mock DeepInfra completion tests to avoid real API calls
2026-03-30 11:42:00 -07:00
Yuneng Jiang
868468db14
[Test] Mock DeepInfra completion tests to avoid real API calls
The DeepInfra tests were making real API calls and failing with AuthenticationError.
Mock the HTTP layer to verify request shape instead.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-30 11:07:34 -07:00
Krrish Dholakia
5671baaadf fix: fix setup wizard 2026-03-30 09:06:31 -07:00
Krrish Dholakia
58120537af
Merge pull request #24756 from BerriAI/litellm_/pensive-sinoussi
[Fix] Remove NLP_CLOUD_API_KEY requirement from test_exceptions
2026-03-28 22:04:49 -07:00
Krrish Dholakia
a671083596
Merge pull request #24755 from BerriAI/litellm_test_cleanup
Litellm test cleanup
2026-03-28 22:04:26 -07:00
Krrish Dholakia
85cc7bc433 refactor: make unit test 2026-03-28 21:44:46 -07:00
Krrish Dholakia
1ba109079d test: update tests 2026-03-28 21:22:04 -07:00
Krrish Dholakia
9e070143fb test: update key names 2026-03-28 21:13:16 -07:00
Krrish Dholakia
25f2baad71 test: cleanup dead tests 2026-03-28 20:49:02 -07:00
Yuneng Jiang
14095ee144
[Fix] Remove NLP_CLOUD_API_KEY requirement from test_exceptions.py
The test only needs a bad key to verify AuthenticationError handling.
No other tests use this env var, and it's not provisioned in CI.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-28 20:38:54 -07:00
Krrish Dholakia
a92b31a636 test: remove dead tests 2026-03-28 20:36:08 -07:00
Krrish Dholakia
fe379fd738 test: rename env var 2026-03-28 20:27:39 -07:00
Krrish Dholakia
0fef88d67c test: remove dead tests 2026-03-28 20:23:44 -07:00
Krrish Dholakia
1fb677702d test: update to new vertex ai keys 2026-03-28 20:19:05 -07:00
Krrish Dholakia
92db2df2f6
Merge pull request #23794 from ndgigliotti/feat/bedrock-structured-output-cost-json
Bedrock: move native structured output model list to cost JSON, add Sonnet 4.6
2026-03-28 20:04:47 -07:00
Krrish Dholakia
ce26dd4101 test: update tests 2026-03-28 19:42:14 -07:00
Krrish Dholakia
cdcab8a243 refactor: cleanup deprecated models 2026-03-28 19:39:11 -07:00
Krrish Dholakia
bc829d51f2 test: test 2026-03-28 19:17:38 -07:00
Krrish Dholakia
a41ba7bb6a test: update test 2026-03-28 19:01:55 -07:00
Krrish Dholakia
bee1607248 test: update test apis 2026-03-28 18:57:27 -07:00
Krrish Dholakia
564ad3195b test: update testing 2026-03-28 18:42:55 -07:00
Krrish Dholakia
5cd8ca2365 refactor: refactor testing 2026-03-28 18:39:32 -07:00
Krrish Dholakia
6df995d0d1 refactor: dead test cleanup 2026-03-28 18:27:25 -07:00
Krrish Dholakia
44b03e6138 fix: fix azure tests 2026-03-28 18:19:41 -07:00
Krrish Dholakia
c75fb3650a fix: fix azure audio test 2026-03-28 18:14:01 -07:00
Krrish Dholakia
bc33cf662f
Merge pull request #24449 from J-Byron/feat/prometheus-org-budget-metrics
Feat/prometheus org budget metrics
2026-03-28 17:32:17 -07:00
Ryan Crabbe
a59acc8f8a
[Fix] Derive use_substring_matching from role, not auto-set path
Substring matching for user_id and key_alias on /key/list is now gated
by caller role (admin only) rather than by whether user_id was auto-set.
This closes the gap where a non-admin explicitly passing their own
user_id still got contains-based filtering, which could surface keys
belonging to other users with overlapping IDs.

Adds three unit tests covering the substring, exact-match, and default
code paths in _build_key_filter_conditions. Restores the existing
member-team test to assert exact matching as a security regression guard.
2026-03-28 16:50:09 -07:00
Ryan Crabbe
65df501f15
Simplify substring search — remove admin-only gating
Substring matching for user_id and key_alias now applies unconditionally.
The admin-only flag was unnecessary since user_ids are typically UUIDs/emails
where substring collisions are not a practical concern. Updated existing test
to assert the new filter structure.
2026-03-28 14:50:31 -07:00
Ryan Crabbe
8d9bbc6eb2
[Fix] Include access group models in UI model listing
Models associated with a team only through access groups (not directly in
team.models) were not appearing on the /ui/?page=models page. The API
authorization path already resolved access groups correctly, but the
/v2/model/info listing endpoint only checked team.models.

Add _add_access_group_models_to_team_models() which batch-fetches all
distinct access groups in a single find_many query, then resolves each
team's access group models into deployments and merges them into the
team_models dict.
2026-03-28 12:32:12 -07:00
Yuneng Jiang
7851567091
[Fix] Scope documentation workflow to match CircleCI and add missing router settings
Revert path fixes for documentation tests that CircleCI never ran
(test_exception_types, test_general_setting_keys, test_readme_providers,
test_standard_logging_payload). Update the GHA workflow to run only the
4 tests CircleCI actually executed: test_env_keys, test_router_settings,
test_api_docs, test_circular_imports.

Add 2 missing router_settings keys (enable_health_check_routing,
health_check_staleness_threshold) and 27 missing general_settings keys
to config_settings.md so test_router_settings passes.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-28 11:23:53 -07:00