Krrish Dholakia
|
805069c287
|
fix(adapters/streaming_iterator.py): Don't send content block after message delta block is sent
Fixes https://github.com/BerriAI/litellm/issues/14315
|
2025-09-11 18:52:02 -07:00 |
|
Ishaan Jaff
|
dda115cc6d
|
[Feat] Cost Tracking - Add support for Tiered Cost Tracking for Qwen API (Dashscope) (#14471)
* add dashscope logo
* docs fix
* docs fix
* fix supports_batch_calling
* fix naming
* fix input_cost_per_audio_token
* use output_cost_per_reasoning_token
* add tiered_pricing in get_model_info
* test fixes
* fix cost calc
* ruff fix
|
2025-09-11 18:14:39 -07:00 |
|
Krrish Dholakia
|
d0732f55b3
|
test(test_get_azure_ad_token_provider.py): add unit test to ensure default azure credentials used in the right context
|
2025-09-11 16:07:32 -07:00 |
|
Burt Holzman
|
e9e548d797
|
Fix provider budgets
|
2025-09-11 12:08:43 -05:00 |
|
Sameer Kankute
|
090e0fddf4
|
fix vertex ai file upload
|
2025-09-11 22:20:54 +05:30 |
|
Din
|
ee5a9d0aa0
|
propagate execution context into logging tasks
|
2025-09-11 15:54:40 +01:00 |
|
Fabrício Ceschin
|
5cb5268e43
|
Merge branch 'BerriAI:main' into LangfuseUsageDetails
|
2025-09-11 10:15:22 -04:00 |
|
Tom Alon
|
b83b497d38
|
PR fixes
|
2025-09-11 13:38:06 +03:00 |
|
Tom Alon
|
b473344f70
|
Implement anonymization logic
|
2025-09-11 11:47:19 +03:00 |
|
Ishaan Jaff
|
258b674dbb
|
fix deepinfra test
|
2025-09-10 19:39:23 -07:00 |
|
Ishaan Jaff
|
a13aa4740a
|
[Fixes] Bug fixes to using LiteLLM MCP Gateway (#14392)
* fix: use _get_mcp_servers_in_path
* fix checks for using litellm_proxy as MCP tool provider
* fix: fix mcp_tools_with_litellm_proxy
* fix: fix aresponses_api_with_mcp
* aresponses_api_with_mcp
* test_mcp_allowed_tools_filtering
* fix: _filter_mcp_tools_by_allowed_tools
* fix: _filter_mcp_tools_by_allowed_tools
* test_streaming_responses_api_with_mcp_tools
* fixes: test tools transfrom MCP->OpenaI spec
* test_streaming_responses_api_with_mcp_tools
* fix: chat ui allow multi select with allowed tools
* fix: use correct MCP events with litellm proxy response API
* fix get_event_model_class
* fix litellm proxy MCP handler
* fix MCPEnhancedStreamingIterator
* chat ui show list tools result
* UI: show MCP events
* fix stream iterator
* fixes: litellm proxy mcp handler
* test responses + mcp
* fix: update responses api with mcp handling
* ruff check fix
* central: _process_mcp_tools_to_openai_format
* fix: refactor code
* test_mcp_allowed_tools_filtering
* test mcp with litellm proxy
* fix mcp call
* demo: video using MCP ui
* fixes for using stream iterator
* test_no_duplicate_mcp_tools_in_streaming_e2e
* docs fix
* fix code snippet
|
2025-09-10 19:12:11 -07:00 |
|
Ishaan Jaff
|
dc5650eeda
|
Revert "fix: remove anthropic-beta header for Vertex AI requests with prompt caching" (#14421)
|
2025-09-10 15:47:18 -07:00 |
|
iabhi4
|
384ad7e99c
|
fix: avoid deepcopy crash with non-pickleables in Gemini/Vertex
|
2025-09-10 12:59:03 -07:00 |
|
xprilion
|
667481e75b
|
(feat): Add W&B Inference to LiteLLM
|
2025-09-11 00:07:30 +05:30 |
|
Tom Alon
|
f6bc4d0bf9
|
Noma non blocking on monitor mode
|
2025-09-10 13:35:17 +03:00 |
|
Krish Dholakia
|
a80cfe5fb5
|
Merge branch 'main' into feature/databricks-function-call-missing-pass-description
|
2025-09-09 22:42:32 -07:00 |
|
Krish Dholakia
|
53bf023876
|
Merge pull request #14092 from gotsysdba/main
OCI Provder: Update OCIPromptTokensDetails
|
2025-09-09 22:39:16 -07:00 |
|
Krish Dholakia
|
d72081113e
|
Merge pull request #14111 from dharamendrak/feature/aiohttp-dependency-injection
feat: Add dependency injection support to BaseLLMAIOHTTPHandler
|
2025-09-09 22:35:30 -07:00 |
|
Krish Dholakia
|
03a457842d
|
Merge pull request #14310 from swarna1101/fix-anthropic-prompt-caching-vertex-ai
fix: remove anthropic-beta header for Vertex AI requests with prompt caching
|
2025-09-09 22:32:40 -07:00 |
|
Krrish Dholakia
|
bdd7255bab
|
test: remove redundant tests - moved to parallel_request_limiter_v3.py
|
2025-09-09 21:35:50 -07:00 |
|
pinkgu
|
285b14bd69
|
Fix/gcp model armor (#14381)
* chore: fix model armor always success
Signed-off-by: bjorn <bjornjee95@gmail.com>
* chore: fix sanitisation field extraction
Signed-off-by: bjorn <bjornjee95@gmail.com>
---------
Signed-off-by: bjorn <bjornjee95@gmail.com>
|
2025-09-09 09:18:37 -07:00 |
|
swarnabhasinha
|
f8ddd123d1
|
fix: add missing patch import in vertex_ai test
|
2025-09-09 16:16:59 +05:30 |
|
Krish Dholakia
|
54c3ae15c8
|
Merge pull request #14312 from mubashir1osmani/main
fix: spend tags endpoint returns 500
|
2025-09-08 19:05:13 -07:00 |
|
Fabricio Ceschin
|
faaae888f1
|
Merge conflicts
|
2025-09-08 11:34:45 -04:00 |
|
Dharamendra Kumar
|
5b26e78ad6
|
Fix linting
|
2025-09-07 18:04:00 -07:00 |
|
Dharamendra Kumar
|
92596e48fe
|
Merge branch 'main' into feature/aiohttp-dependency-injection
|
2025-09-07 17:54:55 -07:00 |
|
mubashir1osmani
|
d9bbbc10a6
|
added tests
|
2025-09-07 10:17:28 -04:00 |
|
Krish Dholakia
|
fbc0ec98b6
|
Merge pull request #12438 from jasonpnnl/fix-customer-update
Fix 500 error in `/customer/update` endpoint when updating with `budget_id`
|
2025-09-06 22:12:30 -07:00 |
|
Krish Dholakia
|
ba10173ec7
|
Merge branch 'main' into heroku-llms
|
2025-09-06 22:10:20 -07:00 |
|
Krish Dholakia
|
884cca7da9
|
Merge pull request #12984 from darashenka/main
honor OLLAMA_API_KEY for ollama_chat
|
2025-09-06 22:07:28 -07:00 |
|
Krish Dholakia
|
db6fd68540
|
Merge pull request #14160 from BerriAI/litellm_dev_09_01_2025_p1
MINOR update: Add openrouter image generation support + refactor Gemini `image` output param to be `images` (openrouter compatible)
|
2025-09-06 19:26:00 -07:00 |
|
Ishaan Jaff
|
c9ab104445
|
[Fix] Perf fix: Heavy RAM Usage over time when using Passthrough Routes (#14305)
* Implement pass-through route registration and removal to prevent duplicates and memory leaks
* fix MYPY linting
* fix InitPassThroughEndpointHelpers
* fix test_aaparallel_function_call
---------
Co-authored-by: Jugal Bhatt <jugalbhatt3@gmail.com>
|
2025-09-06 19:22:25 -07:00 |
|
Krrish Dholakia
|
5a0328b1a9
|
test: update tests
|
2025-09-06 19:02:03 -07:00 |
|
Ishaan Jaff
|
d89a2a0797
|
test
|
2025-09-06 16:38:43 -07:00 |
|
Ishaan Jaff
|
c168fff38a
|
test_cooldown_badrequest_error
|
2025-09-06 16:28:00 -07:00 |
|
Ishaan Jaff
|
7054067238
|
test_cooldown_handlers.py
|
2025-09-06 16:13:30 -07:00 |
|
Ishaan Jaff
|
7f5460465c
|
unit test oai pass through
|
2025-09-06 14:54:34 -07:00 |
|
Ishaan Jaff
|
b1552cae46
|
fix mocked CZ tests
|
2025-09-06 14:33:02 -07:00 |
|
Ishaan Jaff
|
8920a645e9
|
Revert "feat: add redis ssl and username support (#11319)" (#14303)
This reverts commit 31f806f7d0.
|
2025-09-06 14:01:00 -07:00 |
|
Ishaan Jaff
|
fc7accad74
|
test_dry_run_export_usage_data_cbf_transformation_failure
|
2025-09-06 13:59:28 -07:00 |
|
Ishaan Jaff
|
1227b54fa6
|
test_get_model_info_gemini
|
2025-09-06 13:43:42 -07:00 |
|
Krish Dholakia
|
1980960218
|
Merge branch 'main' into litellm_responses_structured_output
|
2025-09-06 09:20:00 -07:00 |
|
Ishaan Jaff
|
5310bba35b
|
[Feat] Litellm x CloudZero Integration - Cost Tracking (#14296)
* fix: just pull LiteLLM_DailyUserSpend
* get the team_id from user daily spend table
* cloudzero_dry_run_export
* fix CZ endpoints
* trace entity_id
* fix: get_usage_data
* fix get_usage_data
* fix _create_cbf_record
* fix get_usage_data
* ensure start and end time is used for exporting data
* fix init_cloudzero_background_job
* fix CloudZeroExportRequest
* fix initialize_cloudzero_export_job
* fix initialize_cloudzero_export_job
* allow init with env + config.yaml for cloudzero
* fix: init CZ through config.yaml
* fix DRY run on CZ
* TestCloudZeroDryRunEndpoint
* fix: CLOUDZERO_EXPORT_INTERVAL_MINUTES
* fix init_cloudzero_background_job
* fix exporting data
* fix transform
* stash cloudzero docs
* docs: CloudZero
* ruff fix
* fix rendering key alias
* fix polars
|
2025-09-05 21:29:41 -07:00 |
|
Sameer Kankute
|
07ba3ff036
|
[Feat] Add pass through image gen and image editing on OpenAI (#14292)
* add pass through image gen and image editing on OpenAI
* fix lint
|
2025-09-05 12:25:49 -07:00 |
|
Pierre-Emmanuel MERCIER
|
31f806f7d0
|
feat: add redis ssl and username support (#11319)
|
2025-09-05 10:35:11 -07:00 |
|
Ishaan Jaff
|
0a60390521
|
Revert "[Feat] LiteLLM CloudZero Integration updates - using LiteLLM_SpendLogs Table (#12922)"
This reverts commit e3b752d3dc.
|
2025-09-05 10:04:07 -07:00 |
|
Ishaan Jaff
|
982800069c
|
[Bug Fix] x-litellm-tags not routing with Responses API (#14289)
* fix: get_deployments_for_tag
* fix get_deployments_for_tag
* test_router_tag_routing.py
* test_get_metadata_variable_name_from_kwargs
* fix mapped tests
* docs fix
|
2025-09-05 09:40:37 -07:00 |
|
Sameer Kankute
|
231d54741f
|
Move test to test_litellm/ folder
|
2025-09-05 10:40:26 +05:30 |
|
Sameer Kankute
|
4fefac1bf2
|
Move test to test_litellm/ folder
|
2025-09-05 10:24:55 +05:30 |
|
Sameer Kankute
|
ad9f54a192
|
Move test to test_litellm/ folder
|
2025-09-05 10:08:34 +05:30 |
|