Ishaan Jaffer
6c2408f957
litellm_mapped_tests_integrations
2026-01-07 21:22:10 +05:30
Krish Dholakia
80ead21c3a
Litellm improve endpoint discovery ( #18762 )
...
* docs: document all endpoints in .json and add consistency checks against docs + providers.json
* docs: add more tests + improve coverage
2026-01-07 17:35:01 +05:30
Alexsander Hamir
b732710ed0
Add memory pattern detection test and fix bad memory patterns ( #18589 )
2026-01-02 10:52:25 -08:00
yuneng-jiang
ba52490488
adding attach workspace
2026-01-01 11:15:10 -08:00
yuneng-jiang
e22b2186c2
Mirroring to other ci jobs that require docker database
2026-01-01 11:04:13 -08:00
yuneng-jiang
5b66658a87
using built image instead of latest
2026-01-01 10:37:25 -08:00
yuneng-jiang
c7820997a4
saving docker build at root
2026-01-01 10:19:24 -08:00
yuneng-jiang
22019aed79
fixing path for e2e
2026-01-01 10:12:10 -08:00
yuneng-jiang
75a43e1a59
fixing path
2026-01-01 10:03:43 -08:00
yuneng-jiang
3ce5de485f
add job to build_and_test
2026-01-01 09:52:05 -08:00
yuneng-jiang
5ccc1a762c
Save database build to reusable workspace
2026-01-01 09:48:12 -08:00
yuneng-jiang
46ce68619c
attempt fix 3
2025-12-29 20:49:24 -08:00
yuneng-jiang
554830d2e2
reverting
2025-12-29 20:33:46 -08:00
yuneng-jiang
a4341c6e5b
test removing python install step
2025-12-29 19:56:44 -08:00
yuneng-jiang
f8d90939fe
Attempt fix
2025-12-29 13:40:36 -08:00
yuneng-jiang
ec29fe1472
remove google dns for e2e
2025-12-29 13:27:00 -08:00
yuneng-jiang
990b7ff93d
Fixing CI/CD
2025-12-29 13:18:48 -08:00
yuneng-jiang
108fc4a59f
Using microsoft official docker for playwright
2025-12-29 13:10:50 -08:00
yuneng-jiang
657eb2b09b
attempt fix 2
2025-12-29 12:57:36 -08:00
yuneng-jiang
ab89587aca
circle ci config change for e2e
2025-12-29 12:49:28 -08:00
yuneng-jiang
41fa2c0812
migrate e2e tests to ui directory
2025-12-29 12:00:03 -08:00
Ishaan Jaffer
46438684ca
fix config.yml
2025-12-22 10:48:12 +05:30
Alexsander Hamir
4b652e19d8
[Fix] CI/CD - security_tests ( #18305 )
2025-12-20 17:08:28 -08:00
Ishaan Jaffer
d808e10e53
fix DB URL
2025-12-20 21:17:42 +05:30
Ishaan Jaffer
6112160a16
Revert "[Fix] Security - Remove example API keys with high entropy ( #18255 )"
...
This reverts commit 24edbccf5c
2025-12-20 20:48:11 +05:30
Ishaan Jaffer
816cb17f4e
fix dcker containers
2025-12-20 15:12:44 +05:30
Alexsander Hamir
24edbccf5c
[Fix] Security - Remove example API keys with high entropy ( #18255 )
2025-12-19 10:09:50 -08:00
Alexsander Hamir
0c48826cdc
Revert "[Fix] CI/CD - local_testing & mapped tests ( #18222 )" ( #18223 )
...
This reverts commit dc7f500c47
2025-12-18 14:46:09 -08:00
Alexsander Hamir
dc7f500c47
[Fix] CI/CD - local_testing & mapped tests ( #18222 )
2025-12-18 14:34:48 -08:00
Alexsander Hamir
1393c76578
[Fix] CI/CD - Fix failing proxy and core integration tests ( #17926 )
...
* Fix: Add prisma generate to proxy tests CI job
- Add prisma generate command before pytest in litellm_mapped_tests_proxy job
- Fixes 3 test failures: test_health_liveliness_endpoint, test_health_liveness_endpoint, test_health_readiness
- Matches pattern used in litellm_mapped_enterprise_tests job
* Fix: Add missing prompt_spec parameter to TestCustomPromptManagement
- Add prompt_spec parameter to get_chat_completion_prompt() method signature
- Fixes 2 test failures: test_custom_prompt_management_with_prompt_id and test_custom_prompt_management_with_prompt_id_and_prompt_variables
- Aligns test mock with base class method signature from CustomPromptManagement
* Fix: Handle string datetime values in OpenTelemetry timestamp conversion
- Add _to_timestamp helper to handle datetime, float, and string inputs
- Fixes test_handle_success_spans_and_metrics failure
- Handles string datetime format from JSON deserialization (e.g. '2025-06-22 10:59:08.399523')
- Applied to all timestamp conversions in OpenTelemetry metrics methods
* Fix OpenTelemetry timestamp parsing to handle datetime strings with/without microseconds
2025-12-13 10:11:01 -08:00
Alexsander Hamir
9c39539d78
revert CI changes ( #17879 )
2025-12-12 08:13:18 -08:00
Alexsander Hamir
5f2f823d44
fix: use docker executor ( #17878 )
2025-12-12 07:56:03 -08:00
Alexsander Hamir
c9063d13b1
Add health endpoint tests to CI with database and Redis support ( #17877 )
...
- Add database and Redis setup to litellm_mapped_tests_proxy job in CircleCI
- Create shared test helpers in tests/test_litellm/proxy/conftest.py for proxy test setup
- Refactor health endpoint tests to use shared helpers from conftest
- Support automatic Redis cache configuration when REDIS_HOST is set
- Ensure minimal config is created when Redis/database is needed
2025-12-12 07:35:50 -08:00
Alexsander Hamir
e9baa83a0f
[Fix] CI/CD – Clean Up Performance PR Changes & others ( #17838 )
2025-12-11 12:50:03 -08:00
yuneng-jiang
a4341ccf83
ci/cd changes for debugging
2025-12-03 21:00:49 -08:00
Ishaan Jaffer
31620481de
ui unit test fix
2025-11-22 13:53:10 -08:00
Ishaan Jaffer
2a92e97d63
installing_litellm_on_python
2025-11-22 10:27:23 -08:00
yuneng-jiang
ff90585bfe
Break e2e_ui_testing into build, unit, and e2e steps ( #16783 )
2025-11-18 17:40:32 -08:00
Ishaan Jaff
06eeb28c8f
Litellm ci cd fixes 2 ( #16693 )
...
* litellm_proxy_unit_testing_part1
* test proxy unit test
* litellm_proxy_unit_testing_key_generation
* test_async_call_with_key_over_model_budget
* test_aasync_call_with_key_over_model_budget
2025-11-15 14:12:44 -08:00
Ishaan Jaffer
32beb330fd
fix pt endpoint test
2025-11-15 11:18:33 -08:00
Ishaan Jaff
8c4d4aeef3
[Ci/CD] Speed up litellm mapped tests job on circle ci ( #16688 )
...
* fix mapped tests speed
* fixes
* split up test_litellm
* refactor mapped tests
2025-11-15 10:44:18 -08:00
Ishaan Jaffer
2bc122302f
fix build and test
2025-11-15 10:41:15 -08:00
Ishaan Jaffer
c2df54a8f0
proxy_pass_through_endpoint_tests
2025-11-15 10:28:24 -08:00
Ishaan Jaffer
90c8233fa3
fix pt tests
2025-11-15 10:04:18 -08:00
Ishaan Jaffer
a69011883a
fix logging_testing
2025-11-14 18:48:20 -08:00
Ishaan Jaffer
8be374c98d
fix docker v
2025-11-13 16:12:48 -08:00
yuneng-jiang
627463b21f
[Infra] CI/CD - Bump up docker version for e2e ui testing ( #16506 )
...
* Bump up docker version for e2e ui testing CICD
* Fixing config file
2025-11-11 15:07:30 -08:00
Ishaan Jaffer
b8eda0ef55
proxy_store_model_in_db_tests
2025-11-10 18:20:52 -08:00
Krish Dholakia
06906534b3
feat(audio_transcriptions/): calculate duration of audio file for cost calculation + feat (image_generations): cost tracking accuracy improved with output_format, quality, size values fixed per openai model
...
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation
Fixes https://github.com/BerriAI/litellm/issues/11846
Closes https://github.com/BerriAI/litellm/issues/14605
* fix(cost_calculator.py): correctly use base model, when set
Fixes issue where azure base model was being ignored
* feat(cost_calculator.py): fix default cost tracking quality param for image generation
* feat(image_generations/): return output_format, quality, size
aligns response to openai spec and improves cost tracking accuracy
* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params
* build: update build
* fix: fix cost calculation
* build: update poetry lock
* fix: fix ruff checks
* fix: fix aembedding
* fix: fix ruff errors
* fix: modify to catch errors
* fix: test
* fix: loosen test to handle openai lib out of sync
* fix: fix base models
* fix: fix usage object
2025-11-08 16:24:31 -08:00
Krish Dholakia
202eaeb1a2
Revert "(feat) Audio transcription - cost tracking + (feat) image generation …" ( #16409 )
...
This reverts commit c96da44265
2025-11-08 15:38:16 -08:00
