xprilion
667481e75b
(feat): Add W&B Inference to LiteLLM
2025-09-11 00:07:30 +05:30
Tom Alon
f6bc4d0bf9
Noma non blocking on monitor mode
2025-09-10 13:35:17 +03:00
Krish Dholakia
a80cfe5fb5
Merge branch 'main' into feature/databricks-function-call-missing-pass-description
2025-09-09 22:42:32 -07:00
Krish Dholakia
53bf023876
Merge pull request #14092 from gotsysdba/main
...
OCI Provder: Update OCIPromptTokensDetails
2025-09-09 22:39:16 -07:00
Krish Dholakia
d72081113e
Merge pull request #14111 from dharamendrak/feature/aiohttp-dependency-injection
...
feat: Add dependency injection support to BaseLLMAIOHTTPHandler
2025-09-09 22:35:30 -07:00
Krish Dholakia
03a457842d
Merge pull request #14310 from swarna1101/fix-anthropic-prompt-caching-vertex-ai
...
fix: remove anthropic-beta header for Vertex AI requests with prompt caching
2025-09-09 22:32:40 -07:00
Krrish Dholakia
bdd7255bab
test: remove redundant tests - moved to parallel_request_limiter_v3.py
2025-09-09 21:35:50 -07:00
pinkgu
285b14bd69
Fix/gcp model armor ( #14381 )
...
* chore: fix model armor always success
Signed-off-by: bjorn <bjornjee95@gmail.com>
* chore: fix sanitisation field extraction
Signed-off-by: bjorn <bjornjee95@gmail.com>
---------
Signed-off-by: bjorn <bjornjee95@gmail.com>
2025-09-09 09:18:37 -07:00
swarnabhasinha
f8ddd123d1
fix: add missing patch import in vertex_ai test
2025-09-09 16:16:59 +05:30
Krish Dholakia
54c3ae15c8
Merge pull request #14312 from mubashir1osmani/main
...
fix: spend tags endpoint returns 500
2025-09-08 19:05:13 -07:00
Fabricio Ceschin
faaae888f1
Merge conflicts
2025-09-08 11:34:45 -04:00
Dharamendra Kumar
5b26e78ad6
Fix linting
2025-09-07 18:04:00 -07:00
Dharamendra Kumar
92596e48fe
Merge branch 'main' into feature/aiohttp-dependency-injection
2025-09-07 17:54:55 -07:00
mubashir1osmani
d9bbbc10a6
added tests
2025-09-07 10:17:28 -04:00
Krish Dholakia
fbc0ec98b6
Merge pull request #12438 from jasonpnnl/fix-customer-update
...
Fix 500 error in `/customer/update` endpoint when updating with `budget_id`
2025-09-06 22:12:30 -07:00
Krish Dholakia
ba10173ec7
Merge branch 'main' into heroku-llms
2025-09-06 22:10:20 -07:00
Krish Dholakia
884cca7da9
Merge pull request #12984 from darashenka/main
...
honor OLLAMA_API_KEY for ollama_chat
2025-09-06 22:07:28 -07:00
Krish Dholakia
db6fd68540
Merge pull request #14160 from BerriAI/litellm_dev_09_01_2025_p1
...
MINOR update: Add openrouter image generation support + refactor Gemini `image` output param to be `images` (openrouter compatible)
2025-09-06 19:26:00 -07:00
Ishaan Jaff
c9ab104445
[Fix] Perf fix: Heavy RAM Usage over time when using Passthrough Routes ( #14305 )
...
* Implement pass-through route registration and removal to prevent duplicates and memory leaks
* fix MYPY linting
* fix InitPassThroughEndpointHelpers
* fix test_aaparallel_function_call
---------
Co-authored-by: Jugal Bhatt <jugalbhatt3@gmail.com>
2025-09-06 19:22:25 -07:00
Krrish Dholakia
5a0328b1a9
test: update tests
2025-09-06 19:02:03 -07:00
Ishaan Jaff
d89a2a0797
test
2025-09-06 16:38:43 -07:00
Ishaan Jaff
c168fff38a
test_cooldown_badrequest_error
2025-09-06 16:28:00 -07:00
Ishaan Jaff
7054067238
test_cooldown_handlers.py
2025-09-06 16:13:30 -07:00
Ishaan Jaff
7f5460465c
unit test oai pass through
2025-09-06 14:54:34 -07:00
Ishaan Jaff
b1552cae46
fix mocked CZ tests
2025-09-06 14:33:02 -07:00
Ishaan Jaff
8920a645e9
Revert "feat: add redis ssl and username support ( #11319 )" ( #14303 )
...
This reverts commit 31f806f7d0
2025-09-06 14:01:00 -07:00
Ishaan Jaff
fc7accad74
test_dry_run_export_usage_data_cbf_transformation_failure
2025-09-06 13:59:28 -07:00
Ishaan Jaff
1227b54fa6
test_get_model_info_gemini
2025-09-06 13:43:42 -07:00
Krish Dholakia
1980960218
Merge branch 'main' into litellm_responses_structured_output
2025-09-06 09:20:00 -07:00
Ishaan Jaff
5310bba35b
[Feat] Litellm x CloudZero Integration - Cost Tracking ( #14296 )
...
* fix: just pull LiteLLM_DailyUserSpend
* get the team_id from user daily spend table
* cloudzero_dry_run_export
* fix CZ endpoints
* trace entity_id
* fix: get_usage_data
* fix get_usage_data
* fix _create_cbf_record
* fix get_usage_data
* ensure start and end time is used for exporting data
* fix init_cloudzero_background_job
* fix CloudZeroExportRequest
* fix initialize_cloudzero_export_job
* fix initialize_cloudzero_export_job
* allow init with env + config.yaml for cloudzero
* fix: init CZ through config.yaml
* fix DRY run on CZ
* TestCloudZeroDryRunEndpoint
* fix: CLOUDZERO_EXPORT_INTERVAL_MINUTES
* fix init_cloudzero_background_job
* fix exporting data
* fix transform
* stash cloudzero docs
* docs: CloudZero
* ruff fix
* fix rendering key alias
* fix polars
2025-09-05 21:29:41 -07:00
Sameer Kankute
07ba3ff036
[Feat] Add pass through image gen and image editing on OpenAI ( #14292 )
...
* add pass through image gen and image editing on OpenAI
* fix lint
2025-09-05 12:25:49 -07:00
Pierre-Emmanuel MERCIER
31f806f7d0
feat: add redis ssl and username support ( #11319 )
2025-09-05 10:35:11 -07:00
Ishaan Jaff
0a60390521
Revert "[Feat] LiteLLM CloudZero Integration updates - using LiteLLM_SpendLogs Table ( #12922 )"
...
This reverts commit e3b752d3dc
2025-09-05 10:04:07 -07:00
Ishaan Jaff
982800069c
[Bug Fix] x-litellm-tags not routing with Responses API ( #14289 )
...
* fix: get_deployments_for_tag
* fix get_deployments_for_tag
* test_router_tag_routing.py
* test_get_metadata_variable_name_from_kwargs
* fix mapped tests
* docs fix
2025-09-05 09:40:37 -07:00
Sameer Kankute
231d54741f
Move test to test_litellm/ folder
2025-09-05 10:40:26 +05:30
Sameer Kankute
4fefac1bf2
Move test to test_litellm/ folder
2025-09-05 10:24:55 +05:30
Sameer Kankute
ad9f54a192
Move test to test_litellm/ folder
2025-09-05 10:08:34 +05:30
Sameer Kankute
f7f106f8b8
Move test to test_litellm/ folder
2025-09-05 10:00:58 +05:30
Krish Dholakia
f67339a86c
Merge pull request #14028 from onlylhf/volcengine-embedding-support
...
Add Volcengine embedding module with handler and transformation logic
2025-09-04 21:01:25 -07:00
Krish Dholakia
62d4623d1c
Merge pull request #14107 from uc4w6c/feat/add_guardrails_anthropic
...
feat: Add guardrail to the Anthropic API endpoint
2025-09-04 20:50:43 -07:00
Krish Dholakia
5d5c19a302
Merge pull request #14077 from TomeHirata/codex/add-support-for-anthropic-citation-api
...
Add support for anthropic citation api in Databricks
2025-09-04 20:46:11 -07:00
Ishaan Jaff
379b0dbf14
[Fix] Ensure team_id is a required field for generating service account keys ( #14270 )
...
* generate_service_account_key_fn
* fix validate_team_id_used_in_service_account_request
* fix types
* test_validate_team_id_used_in_service_account_request_requires_team_id
2025-09-04 18:14:38 -07:00
Ishaan Jaff
1352545617
[Fix] DD LLM Observability - Ensure apm_id is set on traces ( #14272 )
...
* add apm_id for DD LLM
* feat: add _get_apm_trace_id
2025-09-04 14:35:41 -07:00
Krish Dholakia
796192dabe
Merge pull request #14130 from moshemorad/bedrock_fix_structure_output
...
Bedrock fix structure output
2025-09-04 12:22:35 -07:00
Krish Dholakia
e7b4892124
Merge pull request #14156 from byrongrogan/byron--bedrock-passthrough-override
...
fix: Support AWS_BEDROCK_RUNTIME_ENDPOINT on bedrock passthrough, make work for URLs with a base path
2025-09-04 12:20:17 -07:00
Sameer Kankute
fc9560573b
[BUG] Fix response api for reasoning item in input for litellm proxy ( #14200 )
...
* fix response api for litellm proxy
* Add test for checking if status is getting removed
* add test in correct file
* remove hardcoded fields
* Make the handling simpler
* fix lint error:
2025-09-04 10:36:48 -07:00
Sameer Kankute
5f79e8aac6
Litellm passthrough cost tracking chat completion ( #14256 )
...
* feat: add structured output for sdk
* Add support for cost tracking for chat completion in passthrough
* remove not required changes
2025-09-04 09:57:48 -07:00
Ishaan Jaff
1237be04a5
test_aaamodel_prices_and_context_window_json_is_valid
2025-09-04 07:58:20 -07:00
Krish Dholakia
a8cce5fbf3
Merge pull request #14237 from yeahyung/fix/tpm_limit_bug
...
Fixes #14204 TPM Rate Limit Bug
2025-09-04 07:29:47 -07:00
22mSqRi
25afa67616
fix: Key Budget not resets at expectable times
2025-09-04 09:04:01 +00:00
