Commit graph

1168 commits

Author SHA1 Message Date
Ishaan Jaffer
172dc07e52 test_cooldown_same_model_name 2025-09-27 11:29:05 -07:00
Ishaan Jaffer
401ec6f2cf test_cooldown_badrequest_error 2025-09-27 11:28:20 -07:00
Ishaan Jaffer
66b86e46e3 test_azure_embedding_on_router 2025-09-27 11:27:56 -07:00
Ishaan Jaffer
bd77bdabe6 test_call_one_endpoint 2025-09-27 11:27:34 -07:00
Ishaan Jaffer
2b39663291 test_async_fallbacks_embeddings 2025-09-27 10:18:18 -07:00
Ishaan Jaffer
a2e72fbcc9 test_caching_with_models_v2 2025-09-27 10:08:32 -07:00
Ishaan Jaffer
9220ddc598 test router policy violation 2025-09-27 10:04:02 -07:00
Ishaan Jaffer
6cca81291b test_acompletion_caching_on_router 2025-09-27 09:57:07 -07:00
Ishaan Jaffer
d6e882163a test_acompletion_caching_on_router_caching_groups 2025-09-27 09:53:37 -07:00
Ishaan Jaffer
22c033d3d7 test_acompletion_caching_on_router_caching_groups 2025-09-27 09:28:24 -07:00
Ishaan Jaffer
8510c70416 test fixes 2025-09-27 09:11:43 -07:00
Krish Dholakia
79ebb2c95e
Merge pull request #14888 from mrFranklin/feat/improve-opik
feat: improve opik integration code
2025-09-25 23:40:41 -07:00
Alexsander Hamir
eaa04cd8ce
fix: use fastuuid helper (#14903)
* fix: use fastuuid helper across the codebase

First batch of changes, simple drop in replacement.

* second batch of changes

* fixed: script mistake on helper file
2025-09-25 15:47:01 -07:00
mrFranklin
f221ce5866 chore: add a comment explaining why update one second to three second 2025-09-25 14:28:49 +08:00
mrFranklin
02a41d76be fix: add default value to pass the opik test 2025-09-25 14:23:00 +08:00
Ishaan Jaffer
e1b342604d test vertex test_get_token_url 2025-09-23 19:34:50 -07:00
Ishaan Jaffer
6964b5a67a test humanloop 2025-09-23 18:28:27 -07:00
daily-kim
62622ef4b2 fix: update authorization header to use 'Bearer' instead of 'bearer' 2025-09-21 10:44:47 +00:00
Krish Dholakia
1f9afcb349
Merge pull request #14438 from hakasecurity/change-aim-headers
rename aim headers + tests
2025-09-19 23:32:50 -07:00
Krrish Dholakia
92e841e311 fix: fix test 2025-09-18 23:37:38 -07:00
Krish Dholakia
664c83cfb5
Merge branch 'litellm_contributor_prs_09_18_2025_p2' into litellm_dev_09_17_2025_p2_v2 2025-09-18 19:50:55 -07:00
Sameer Kankute
d213a2e066
correct the gaurdcontent name (#14684)
* correct the gaurdcontent name

* correct the gaurdcontent name

* fix model required error in test

* Add correct model
2025-09-18 11:00:19 -07:00
Ishaan Jaffer
1e1d174733 fix: test_completion_with_no_model 2025-09-18 10:13:32 -07:00
Krrish Dholakia
e32ce6b053 feat(anthropic/chat/transformation.py): separate 5m vs. 1h cache creation token details for anthropic cost tracking 2025-09-17 15:51:07 -07:00
Krish Dholakia
895c41efa3
Merge pull request #14619 from BerriAI/litellm_dev_09_16_2025_p1
UI - allow team member to view service account keys they create + Anthropic - include cache creation tokens in prompt token total (separate out during cost tracking)
2025-09-17 15:43:04 -07:00
Krrish Dholakia
0e747aaaf1 test: fix test 2025-09-16 19:20:12 -07:00
Krrish Dholakia
1c855385c9 build(model_cost): add cache_creation_input_token_cost_above_1hr pricing 2025-09-16 18:43:57 -07:00
Krrish Dholakia
0341e7fc09 fix: fix test 2025-09-16 18:34:24 -07:00
Krrish Dholakia
e488312873 fix(utils.py): log cache_creation_tokens in prompt token details
Closes LIT-907
2025-09-16 18:24:10 -07:00
Krish Dholakia
a11f50d8ba
Merge branch 'main' into litellm_dev_09_11_2025_p1 2025-09-12 19:59:28 -07:00
Arseny Boykov
f4318bccd3
[Performance] Use _PROXY_MaxParallelRequestsHandler_v3 by default again (#14450)
* Use _PROXY_MaxParallelRequestsHandler_v3 by default (#14352)

(cherry picked from commit f3fa45cf8fbd5f5cce2f45a7312776d5005fb08e)
(cherry picked from commit 5b680bb4a3)

* Use random api_key for parallel requests test

* Fix off-by-one error in parallel request rate limit

The rate limiter was incorrectly rejecting requests when the limit was met, but not exceeded. The check in `is_cache_list_over_limit` was `int(counter_value) + 1 > current_limit`, which caused the first request to be rejected if the limit was 1.

This commit removes the `+ 1`, changing the logic to `int(counter_value) > current_limit`. The check now correctly allows requests up to the specified parallel limit.

* Test actual parallel requests

* Ensure rate limiting works correctly for multiple users

* Add sequential rate-limit test

* Revert random key usage
2025-09-12 17:33:55 -07:00
Boopesh Shanmugam
8b338a4d8c
User Headers X LiteLLM Users Mapping feature (#14485)
* Draft commit.

* user header mapping feature with backward compatibility with user_header_name field.

* user header mapping feature with backward compatibility with user_header_name field optimizations.

* Added unit tests.
2025-09-12 11:49:37 -07:00
Krrish Dholakia
3f3efea301 test(test_gemini.py): add additional testing for additionalproperties case 2025-09-11 15:12:21 -07:00
drorbaron
2ee8c0c6d7 rename aim headers + tests 2025-09-11 11:19:58 +03:00
Krrish Dholakia
a504c7dae3 test: update tests 2025-09-09 21:43:37 -07:00
Krrish Dholakia
d05f58721e test: remove end of life model from tests 2025-09-09 21:01:45 -07:00
Krrish Dholakia
e443d01925 test: remove redundant test 2025-09-09 20:37:09 -07:00
Krrish Dholakia
0854c35d3e test: remove eol bedrock model from tests 2025-09-09 19:48:35 -07:00
Krish Dholakia
351896cd1d
Merge pull request #12414 from dotmobo/feature/fix-timestamp-granularities
The parameter timestamp_granularities is broken for openai-like transcription
2025-09-08 23:13:13 -07:00
Krish Dholakia
b9ce3a1587
Merge pull request #12416 from dotmobo/feature/fix-alloy
feat: add a health_check_voice parameter in model_info
2025-09-08 23:12:48 -07:00
Ishaan Jaff
c7f9be6803 test_async_log_cache_hit_on_callbacks 2025-09-08 17:15:53 -07:00
Ishaan Jaff
679d0414e2 test fix 2025-09-06 17:08:31 -07:00
Ishaan Jaff
d89a2a0797 test 2025-09-06 16:38:43 -07:00
Ishaan Jaff
7054067238 test_cooldown_handlers.py 2025-09-06 16:13:30 -07:00
Ishaan Jaff
c709d7505d test fix: test_parallel_streaming_requests 2025-09-06 16:07:30 -07:00
Ishaan Jaff
982800069c
[Bug Fix] x-litellm-tags not routing with Responses API (#14289)
* fix: get_deployments_for_tag

* fix get_deployments_for_tag

* test_router_tag_routing.py

* test_get_metadata_variable_name_from_kwargs

* fix mapped tests

* docs fix
2025-09-05 09:40:37 -07:00
Ishaan Jaff
8e9352fce7 test fix 2025-09-03 11:06:09 -07:00
Ishaan Jaff
c821f1ddf1
[Feature]: Support GPT-OSS models on vertex ai (#14184)
* add VertexAIGPTOSSTransformation

* fix: optional_params

* fix: is_vertex_partner_model

* test_partner_models_httpx

* docs GPT oss docs

* test_vertex_ai_gpt_oss_reasoning_effort

* add vertex ai models
2025-09-02 14:15:26 -07:00
Ishaan Jaff
d37be48a80 test: llama-3.3-70b-versatile 2025-09-01 20:14:12 -07:00
Ishaan Jaff
8e72f991cc test_model_alias_map 2025-09-01 17:59:40 -07:00