Ishaan Jaffer
a2e72fbcc9
test_caching_with_models_v2
2025-09-27 10:08:32 -07:00
Ishaan Jaffer
c9c52b3ccc
test_azure_ai_request_format
2025-09-27 10:05:57 -07:00
Ishaan Jaffer
9220ddc598
test router policy violation
2025-09-27 10:04:02 -07:00
Ishaan Jaffer
9e7ee0614a
test fix
2025-09-27 10:01:14 -07:00
Ishaan Jaffer
a86e78f13a
test_azure_ai_request_format
2025-09-27 09:58:00 -07:00
Ishaan Jaffer
6cca81291b
test_acompletion_caching_on_router
2025-09-27 09:57:07 -07:00
Ishaan Jaffer
3a8e4f3160
test_async_embedding_azure_caching
2025-09-27 09:54:54 -07:00
Ishaan Jaffer
d6e882163a
test_acompletion_caching_on_router_caching_groups
2025-09-27 09:53:37 -07:00
Ishaan Jaffer
1f42ac1aec
test_async_completion_azure_caching_streaming
2025-09-27 09:48:24 -07:00
Ishaan Jaffer
22c033d3d7
test_acompletion_caching_on_router_caching_groups
2025-09-27 09:28:24 -07:00
Ishaan Jaffer
9790451cce
test_custom_callback_router.py
2025-09-27 09:23:49 -07:00
Ishaan Jaffer
afbebcd626
test_async_chat_azure
2025-09-27 09:12:37 -07:00
Ishaan Jaffer
8510c70416
test fixes
2025-09-27 09:11:43 -07:00
Ishaan Jaffer
e04df1416d
test_async_chat_azure
2025-09-27 09:07:44 -07:00
Krish Dholakia
0350a44ab1
Merge pull request #14965 from Maximgitman/issue-14962-anthropic-streaming-id
...
Fix Anthropic streaming IDs (#14962 )
2025-09-27 07:36:48 -07:00
deepanshu
198777f2d2
Merge branch 'main' into feature/sqs_pushes_errors
2025-09-27 08:51:35 -04:00
deepanshu
3d0ec68798
Make errors go through SQS
2025-09-27 08:51:29 -04:00
Ishaan Jaffer
81765bba17
fix fastuuid
2025-09-26 18:20:32 -07:00
Ishaan Jaff
36cc98254c
[Fix] Parallel Request Limiter v3 - ensure Lua scripts can execute on redis cluster ( #14968 )
...
* use hashtag slots for rate limiting logic
* redis_startup_nodes fix
* test_execute_redis_batch_rate_limiter_script_cluster_compatibility
* async_increment_tokens_with_ttl_preservation
2025-09-26 18:15:57 -07:00
Ishaan Jaff
628cd13755
[Feat] UI - Allow scheduling key rotations when creating virtual keys ( #14960 )
...
* fix design of key reset interval
* fix: LiteLLM_VerificationToken
* fix key manager
* add key_rotation_at
* ui fix
* fix ui view
* set key_rotation_at on creation
* add key_rotation_at
* fix info
* fix: _set_key_rotation_fields
* fix KeyRotationManager
* fix key edit view
* test_update_key_fn_auto_rotate_enable
* fix KeyRotationManager
2025-09-26 16:24:40 -07:00
Maximgitman
f2d7c1c14d
Fix Anthropic streaming IDs
2025-09-26 18:31:10 -04:00
Ishaan Jaff
ea8d0bb7d5
fix: re-add scheduled rotations
2025-09-26 11:40:46 -07:00
Ishaan Jaffer
539d10f9cb
test fix
2025-09-26 11:06:26 -07:00
Ishaan Jaff
d04c6d4eea
[Feat] Add new anthropic web fetch tool support ( #14951 )
...
* add web_fetch tool for ANTHROPIC_HOSTED_TOOLS
* add ANTHROPIC_BETA_HEADER_VALUES, ANTHROPIC_HOSTED_TOOLS
* feat: add web fetch tool anthropic
* test_anthropic_tool_use
* docs web fetch
* docs fix
* docs fix
2025-09-26 11:04:11 -07:00
Alex Shoop
914844122c
Fix: revert fastuuid optional dependency, always use fastuuid in .__uid helper ( #14941 )
...
* always use fastuuid
* rm from proxy extras since its now default
* poetry lock
2025-09-26 09:14:20 -07:00
Krish Dholakia
79ebb2c95e
Merge pull request #14888 from mrFranklin/feat/improve-opik
...
feat: improve opik integration code
2025-09-25 23:40:41 -07:00
Krish Dholakia
f2f75bf911
Merge pull request #14893 from vertexcover-io/fix/openai-image-edit-support-images
...
🐛 Fix a bug where openai image edit siltently ignores multiple images
2025-09-25 23:37:52 -07:00
Ritesh Kadmawala
af0cb7c277
🐛 Fix a bug where openai image edit siltently ignores multiple images
2025-09-26 10:56:06 +05:30
Mubashir Osmani
625ed3f8cf
fix: prisma client state retries ( #14925 )
...
* added qwen models and gpt-5-codex
* fix flaky test
* fix failing test
* Added retries to prisma client state
* fix: prisma client state retries in pods
* Revert "fix failing test"
This reverts commit dbec4988a2 .
* Revert "fix flaky test"
This reverts commit b0ac2f2dc3 .
* Revert "added qwen models and gpt-5-codex"
This reverts commit 9a8a8f2d47 .
* Revert "fix: prisma client state retries in pods"
This reverts commit 04e58e5ca1 .
* fix lint
* Revert "fix lint"
This reverts commit 5303d52a5e .
* fixed lint
2025-09-25 21:54:00 -07:00
Sameer Kankute
1681bf7175
(Feat) Add BitBucket Integration for Prompt Management ( #14882 )
...
* Add bitbucket integration for prompt management
* remove not needed file
* remove not needed file
* Add the correct readme
* Add the correct readme
* fix test for bitbucket
* fix test for bitbucket
2025-09-25 15:51:00 -07:00
Ishaan Jaff
2dd38420a7
[Feat] - Cost Tracking - show input, output, tool call cost breakdown in StandardLoggingPayload ( #14921 )
...
* add new CostBreakdown typed dict
* fix CostBreakdown type
* fix fix _store_cost_breakdown_in_logging_obj
* fix CostBreakdown
* test_cost_breakdown_in_standard_logging_payload
2025-09-25 15:48:22 -07:00
Alexsander Hamir
eaa04cd8ce
fix: use fastuuid helper ( #14903 )
...
* fix: use fastuuid helper across the codebase
First batch of changes, simple drop in replacement.
* second batch of changes
* fixed: script mistake on helper file
2025-09-25 15:47:01 -07:00
Ishaan Jaff
ab5fb704c2
[Feat] Logging - datadog callback Log message content w/o sending to datadog ( #14909 )
...
* add DatadogInitParams
* fix _get_datadog_params
* test_datadog_message_redaction
2025-09-25 15:46:22 -07:00
Arshdeep Singh
471f011ae5
fix: add return type annotation for full mypy compliance
2025-09-25 12:52:12 -04:00
Arshdeep Singh
8193f56876
fix: remove print statement to pass ruff linting checks
2025-09-25 12:39:49 -04:00
Arshdeep Singh
39683cc3d8
fix: remove unused custom_recognizers variable to pass linting
2025-09-25 12:31:08 -04:00
Arshdeep Singh
8364da014f
style: format code with black
2025-09-25 12:23:44 -04:00
Arshdeep Singh
82ec42993f
fix(presidio): enable custom PII entities with Union type
2025-09-25 12:16:22 -04:00
mrFranklin
f221ce5866
chore: add a comment explaining why update one second to three second
2025-09-25 14:28:49 +08:00
mrFranklin
02a41d76be
fix: add default value to pass the opik test
2025-09-25 14:23:00 +08:00
Ishaan Jaffer
b1e56c55ad
merge
2025-09-24 22:11:37 -07:00
Ishaan Jaff
ded823a3a3
[Feat] Initial support for scheduled key rotations ( #14877 )
...
* add KeyRotationSettings
* add KeyRotationManager
* add key rotation manager
* add KeyRotationManager
* fix _initialize_spend_tracking_background_jobs
* fix add_key_rotation_fields
* fixes
* new fields in schema
* update schema
* fix fixes for init key rotation manager
* fixes for init key rotation manager
* fix KeyRotationManager
* tests for key rotation
* fix key_rotation_settings
* fix KeyRotationManager
* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS
* fix fixes for init key rotation manager
* ruff check fix
* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS
* fix _initialize_spend_tracking_background_jobs
* docs fix
* docs auto rotate
* schema fix
* bump proxy extras
* fix config.yml
2025-09-24 21:37:56 -07:00
Ishaan Jaffer
ba1cd3f0d2
Revert "feature: generic object pool ( #14702 )"
...
This reverts commit 60800698f2 .
2025-09-24 21:36:49 -07:00
Ishaan Jaff
d9bf6a8c53
Revert "Fix: make pondpond as optional dependency for proxy extras, disab…" ( #14880 )
...
This reverts commit e75d8b711e .
2025-09-24 21:34:42 -07:00
Alex Shoop
e75d8b711e
Fix: make pondpond as optional dependency for proxy extras, disable object pooling gracefully ( #14863 )
...
* pondpond optional dep proxy extra
* lock
2025-09-24 17:09:30 -07:00
Krrish Dholakia
df88b0656e
test: update .json
2025-09-24 16:13:51 -07:00
Copilot
1816176f9d
[Memory Leak Fix] Fix InMemoryCache unbounded growth when TTLs are set ( #14869 )
...
* Initial plan
* Fix InMemoryCache unbounded growth issue when TTLs are set
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
2025-09-24 11:54:06 -07:00
Ishaan Jaff
c69bac991b
[Fix] LakeraAI v2 Guardrail - Ensure exception is raised correctly ( #14867 )
...
* fix exception lakera
* test lakera ai v2
* ruff fix
2025-09-24 10:55:56 -07:00
Mubashir Osmani
0cd91a82d2
Added vertex_ai/qwen models and azure/gpt-5-codex ( #14844 )
...
* added qwen models and gpt-5-codex
* fix flaky test
* fix failing test
2025-09-24 10:40:00 -07:00
Fabrício Ceschin
5eb32e0c24
Merge branch 'BerriAI:main' into LangfuseUsageDetails
2025-09-24 09:43:43 -04:00