Commit graph

715 commits

Author SHA1 Message Date
Yuneng Jiang
2038c9ee2c
chore: fixes
Some checks failed
Unit Tests: Caching (Redis) / caching-redis (push) Has been cancelled
Unit Tests: Proxy DB Operations / proxy-db (auth-checks, tests/proxy_unit_tests/test_auth_checks.py tests/proxy_unit_tests/test_user_api_key_auth.py, 20, 8) (push) Has been cancelled
Unit Tests: Proxy DB Operations / proxy-db (key-generation, tests/proxy_unit_tests/test_key_generate_prisma.py, 30, 0) (push) Has been cancelled
Unit Tests: Proxy DB Operations / proxy-db (remaining, tests/proxy_unit_tests --ignore=tests/proxy_unit_tests/test_key_generate_prisma.py --ignore=tests/proxy_unit_tests/test_auth_checks.py --ignore=tests/proxy_unit_tests/test_user_api_key_auth.py, 20, 8) (push) Has been cancelled
Unit Tests: Security / security (push) Has been cancelled
2026-04-05 00:14:54 -07:00
Yuta Saito
44a166a792 fix: ci mcp version up 2026-01-19 14:27:00 +09:00
YutaSaito
7aba0f738a
Revert "Litellm staging 01 15 2026" 2026-01-17 06:31:34 +09:00
Sameer Kankute
84974d5745 Fix boto3 conflicting dependency 2026-01-16 16:55:12 +05:30
burnerburnerburnerman
5676c6c135
Chore: bump boto3 version (#19090) 2026-01-16 02:39:30 +05:30
Alexsander Hamir
15c3bc219b
[Refactor] Add CI enforcement for O(1) operations in _get_model_cost_key to prevent performance regressions (#19052)
* Optimize _get_model_cost_key to avoid expensive scans

- Remove expensive O(n) scan fallback that was causing 42.87% CPU overhead
- Only scan when size mismatch detected (O(1) check)
- Add warning in docstring: Only O(1) lookup operations are acceptable
- Clean up comments to be more concise
- Keep stale entry rebuild for pop() case (only triggers when stale entry found)

This fixes the performance issue where the scan was being triggered on every
failed lookup, causing severe CPU overhead during router operations.

* Add code quality check to enforce O(1) operations in _get_model_cost_key

- Add check_get_model_cost_key_performance.py to statically analyze _get_model_cost_key
- Detects O(n) operations (loops, comprehensions, problematic function calls)
- Recursively checks called functions to find nested O(n) operations
- Allows conditional O(n) rebuilds in helper functions (_rebuild_model_cost_lowercase_map, _handle_stale_map_entry_rebuild, _handle_new_key_with_scan)

* Integrate _get_model_cost_key performance check into CI pipeline

- Add check_get_model_cost_key_performance.py to check_code_and_doc_quality job
- Ensures O(1) requirement is enforced in CI to prevent performance regressions

* Remove unused performance test and clean up utils.py

- Remove test_get_model_info_performance.py (no longer needed)
- Remove extra blank line in utils.py

* Document allowed helper functions and exception process in _get_model_cost_key

- Add documentation listing allowed helper functions with O(n) operations
- Explain why these are acceptable (conditionally called)
- Add instructions for adding new exceptions to check_get_model_cost_key_performance.py

* Fix docstring detection and type checker error in performance check

- Add proper docstring tracking to skip docstring content (fixes false positive for 'map' in docstring)
- Add None check for docstring_quote to fix type checker error
- Restore _handle_new_key_with_scan to allowed_helpers list

* Remove check_get_model_cost_key_performance from CI pipeline

- Temporarily remove the performance check from CI to avoid blocking builds

* Restore performance check and remove memory leak tests from CI

- Add back check_get_model_cost_key_performance.py to CI pipeline
- Remove memory_leak_tests job that was causing port conflicts

* Remove extra blank line in CI config
2026-01-13 17:08:03 -08:00
Yuta Saito
b6bb90f252 test: helm chart testing
load local Docker image for helm chart tests
2026-01-13 06:40:57 +09:00
YutaSaito
a0b7e28fbc
Merge pull request #18882 from BerriAI/litellm_fix_db-migration-log-grep-flaky
[test] stabilize db_migration_disable_update_check test log check
2026-01-12 05:41:46 +09:00
yuneng-jiang
3a2de85e7b
Merge pull request #18885 from BerriAI/litellm_ui_fallbacks_refactor
[Infra] UI - E2E Test: New DB Branch Per Test Run
2026-01-09 23:37:44 -08:00
yuneng-jiang
bdab97c520 Neon Branch on every commit + skip flaky tests 2026-01-09 23:25:42 -08:00
yuneng-jiang
b2c7a59d4e directly set db url 2026-01-09 22:57:28 -08:00
yuneng-jiang
ff04a23656 db url 2026-01-09 22:54:13 -08:00
yuneng-jiang
e2d61a6131 final 2026-01-09 22:43:01 -08:00
yuneng-jiang
78313d79ba adding expiry 2026-01-09 22:37:30 -08:00
yuneng-jiang
b0bbdc2fad neon delete 2026-01-09 22:26:32 -08:00
yuneng-jiang
70e904102e fixing export 2026-01-09 22:22:55 -08:00
yuneng-jiang
554fc0d39d fixing parent pt2 2026-01-09 22:14:31 -08:00
yuneng-jiang
bb015ab172 fixing parent 2026-01-09 22:09:00 -08:00
yuneng-jiang
773a1f434b parent id 2026-01-09 22:06:16 -08:00
yuneng-jiang
7d5716a3e0 create branch from e2e 2026-01-09 22:00:00 -08:00
yuneng-jiang
83157b83f8 testing neon 2026-01-09 21:56:22 -08:00
yuneng-jiang
a8e4a24189 testing only neon 2026-01-09 21:48:08 -08:00
yuneng-jiang
cf9b69aa12 Neon branching per e2e test 2026-01-09 21:38:19 -08:00
Yuta Saito
c2a0b221b1 test: stabilize db_migration_disable_update_check test log check 2026-01-10 14:11:08 +09:00
Alexsander Hamir
578abd4465
Add memory leak detection tests with CI integration (#18881) 2026-01-09 17:36:10 -08:00
Ishaan Jaffer
bbabc1089c litellm_mapped_tests_litellm_core_utils 2026-01-07 21:35:12 +05:30
Ishaan Jaffer
6c2408f957 litellm_mapped_tests_integrations 2026-01-07 21:22:10 +05:30
Krish Dholakia
80ead21c3a
Litellm improve endpoint discovery (#18762)
* docs: document all endpoints in .json and add consistency checks against docs + providers.json

* docs: add more tests + improve coverage
2026-01-07 17:35:01 +05:30
Alexsander Hamir
b732710ed0
Add memory pattern detection test and fix bad memory patterns (#18589) 2026-01-02 10:52:25 -08:00
yuneng-jiang
ba52490488 adding attach workspace 2026-01-01 11:15:10 -08:00
yuneng-jiang
e22b2186c2 Mirroring to other ci jobs that require docker database 2026-01-01 11:04:13 -08:00
yuneng-jiang
5b66658a87 using built image instead of latest 2026-01-01 10:37:25 -08:00
yuneng-jiang
c7820997a4 saving docker build at root 2026-01-01 10:19:24 -08:00
yuneng-jiang
22019aed79 fixing path for e2e 2026-01-01 10:12:10 -08:00
yuneng-jiang
75a43e1a59 fixing path 2026-01-01 10:03:43 -08:00
yuneng-jiang
3ce5de485f add job to build_and_test 2026-01-01 09:52:05 -08:00
yuneng-jiang
5ccc1a762c Save database build to reusable workspace 2026-01-01 09:48:12 -08:00
yuneng-jiang
46ce68619c attempt fix 3 2025-12-29 20:49:24 -08:00
yuneng-jiang
554830d2e2 reverting 2025-12-29 20:33:46 -08:00
yuneng-jiang
a4341c6e5b test removing python install step 2025-12-29 19:56:44 -08:00
yuneng-jiang
f8d90939fe Attempt fix 2025-12-29 13:40:36 -08:00
yuneng-jiang
ec29fe1472 remove google dns for e2e 2025-12-29 13:27:00 -08:00
yuneng-jiang
990b7ff93d Fixing CI/CD 2025-12-29 13:18:48 -08:00
yuneng-jiang
108fc4a59f Using microsoft official docker for playwright 2025-12-29 13:10:50 -08:00
yuneng-jiang
657eb2b09b attempt fix 2 2025-12-29 12:57:36 -08:00
yuneng-jiang
ab89587aca circle ci config change for e2e 2025-12-29 12:49:28 -08:00
yuneng-jiang
41fa2c0812 migrate e2e tests to ui directory 2025-12-29 12:00:03 -08:00
Ishaan Jaffer
46438684ca fix config.yml 2025-12-22 10:48:12 +05:30
Alexsander Hamir
4b652e19d8
[Fix] CI/CD - security­_tests (#18305) 2025-12-20 17:08:28 -08:00
Ishaan Jaffer
d808e10e53 fix DB URL 2025-12-20 21:17:42 +05:30