Toy-97
890ee1abfa
update: DeepInfra model data refresh [2025-09-08]
...
Removed models:
deepinfra/Qwen/Qwen2.5-Coder-32B-Instruct
deepinfra/deepseek-ai/DeepSeek-V3-0324-Turbo
deepinfra/meta-llama/Llama-3.2-90B-Vision-Instruct
deepinfra/meta-llama/Llama-4-Maverick-17B-128E-Instruct-Turbo
deepinfra/meta-llama/Meta-Llama-3-70B-Instruct
deepinfra/mistralai/Devstral-Small-2507
deepinfra/mistralai/Mistral-7B-Instruct-v0.3
deepinfra/mistralai/Mistral-Small-3.1-24B-Instruct-2503
Modified models:
deepinfra/deepseek-ai/DeepSeek-R1-0528:
- cache_read_input_token_cost: None → 4e-07
deepinfra/google/gemma-3-4b-it:
- input_cost_per_token: 2e-08 → 4e-08
- output_cost_per_token: 4e-08 → 8e-08
deepinfra/Qwen/QwQ-32B:
- input_cost_per_token: 7.5e-08 → 1.5e-07
- output_cost_per_token: 1.5e-07 → 4e-07
deepinfra/deepseek-ai/DeepSeek-V3-0324:
- cache_read_input_token_cost: None → 2.24e-07
deepinfra/deepseek-ai/DeepSeek-V3.1:
- input_cost_per_token: 3e-07 → 2.7e-07
- cache_read_input_token_cost: None → 2.16e-07
deepinfra/Qwen/Qwen3-Coder-480B-A35B-Instruct-Turbo:
- cache_read_input_token_cost: 1.5e-07 → 2.4e-07
deepinfra/NousResearch/Hermes-3-Llama-3.1-70B:
- supports_tool_choice: True → False
deepinfra/deepseek-ai/DeepSeek-R1-Turbo:
- max_output_tokens: 163840 → 40960
- max_input_tokens: 163840 → 40960
- max_tokens: 163840 → 40960
2025-09-08 19:17:58 +08:00
Krish Dholakia
9a62b9bdb9
Merge pull request #14161 from BerriAI/litellm_dev_09_01_2025_p2
...
Security fix - prevent proxy_admin_viewer from modifying other user's credentials + remove hardcoded sensitive keys from test repo
2025-09-06 22:14:45 -07:00
Krish Dholakia
e31b2d9eba
Merge pull request #9902 from btemplep/main
...
fix bedrock embedding invocations with app inference profiles
2025-09-06 22:13:35 -07:00
Krish Dholakia
fbc0ec98b6
Merge pull request #12438 from jasonpnnl/fix-customer-update
...
Fix 500 error in `/customer/update` endpoint when updating with `budget_id`
2025-09-06 22:12:30 -07:00
Krish Dholakia
2269ea7f31
Merge pull request #12992 from tlowrimore-heroku/heroku-llms
...
Heroku llms
2025-09-06 22:11:34 -07:00
Krish Dholakia
ba10173ec7
Merge branch 'main' into heroku-llms
2025-09-06 22:10:20 -07:00
Krish Dholakia
884cca7da9
Merge pull request #12984 from darashenka/main
...
honor OLLAMA_API_KEY for ollama_chat
2025-09-06 22:07:28 -07:00
Krish Dholakia
dc77923f47
Merge pull request #13092 from ozzieba/fix_vertex_expired_tokens
...
(Not fully tested, LLM-generated code) fix issue where vertex ai fails to use new credentials after token expiration plus gcloud auth login --update-adc
2025-09-06 22:06:09 -07:00
Krish Dholakia
cf3c18a420
Merge pull request #13855 from edify42/allow-no-db-url
...
feat(helm): Allow no DATABASE_URL to be set on migration job to keep the behaviour same as deployment
2025-09-06 22:02:01 -07:00
Krish Dholakia
ca33657015
Merge pull request #13947 from c3-AndrewDoan/cryptography_upgrade
...
Modify cryptography dependency to latest
2025-09-06 22:00:58 -07:00
Krrish Dholakia
06d472f205
test: fix tests
2025-09-06 21:59:02 -07:00
Krish Dholakia
d2f02a55b9
Merge pull request #14308 from mubashir1osmani/main
...
docs: moved custom spend tags
2025-09-06 21:58:20 -07:00
Krish Dholakia
db6fd68540
Merge pull request #14160 from BerriAI/litellm_dev_09_01_2025_p1
...
MINOR update: Add openrouter image generation support + refactor Gemini `image` output param to be `images` (openrouter compatible)
2025-09-06 19:26:00 -07:00
mubashir1osmani
b9be68cc45
spend tracking details
2025-09-06 22:24:49 -04:00
Ishaan Jaff
c9ab104445
[Fix] Perf fix: Heavy RAM Usage over time when using Passthrough Routes ( #14305 )
...
* Implement pass-through route registration and removal to prevent duplicates and memory leaks
* fix MYPY linting
* fix InitPassThroughEndpointHelpers
* fix test_aaparallel_function_call
---------
Co-authored-by: Jugal Bhatt <jugalbhatt3@gmail.com>
2025-09-06 19:22:25 -07:00
mubashir1osmani
2095fe3c98
moved custom spend tags
2025-09-06 22:14:52 -04:00
mubashir1osmani
976967f1e0
Revert "docs: moved custom spend tags metadata to spend tracking"
...
This reverts commit d1eb87a1e6
2025-09-06 22:12:16 -04:00
mubashir1osmani
d1eb87a1e6
docs: moved custom spend tags metadata to spend tracking
2025-09-06 22:09:03 -04:00
Krish Dholakia
2716fa7981
Merge branch 'main' into litellm_dev_09_01_2025_p2
2025-09-06 19:03:25 -07:00
Krrish Dholakia
7bc2709a27
fix: fix import
2025-09-06 19:02:03 -07:00
Krrish Dholakia
5a0328b1a9
test: update tests
2025-09-06 19:02:03 -07:00
mubashir1osmani
2674c49283
added spend tags
2025-09-06 21:59:45 -04:00
Krish Dholakia
a3ffc3060e
Merge branch 'main' into litellm_dev_09_01_2025_p1
2025-09-06 18:50:49 -07:00
Krish Dholakia
b8fdbd479b
Merge pull request #13931 from BerriAI/litellm_release_notes_08_23_2025
...
docs(index.md): initial commit with release notes
2025-09-06 18:48:44 -07:00
Krish Dholakia
f7810eec79
Merge pull request #14299 from TeddyAmkie/docs-update-clean
...
Doc Updates 9-5-25
2025-09-06 18:47:18 -07:00
Ishaan Jaff
0f26ec57d8
TestGroq
2025-09-06 18:19:09 -07:00
Ishaan Jaff
52ed60ca45
test fix
2025-09-06 18:14:47 -07:00
Krrish Dholakia
05dfad8837
docs: add basic setup to ui contribution doc
2025-09-06 18:03:17 -07:00
Ishaan Jaff
3b0aec2e5d
test_azure_openai_gpt_5_responses_api
2025-09-06 17:47:01 -07:00
Ishaan Jaff
679d0414e2
test fix
2025-09-06 17:08:31 -07:00
Ishaan Jaff
d89a2a0797
test
2025-09-06 16:38:43 -07:00
Ishaan Jaff
c168fff38a
test_cooldown_badrequest_error
2025-09-06 16:28:00 -07:00
Ishaan Jaff
2982c2a932
fix test_key_budget_metrics
2025-09-06 16:18:50 -07:00
Ishaan Jaff
7054067238
test_cooldown_handlers.py
2025-09-06 16:13:30 -07:00
Ishaan Jaff
c709d7505d
test fix: test_parallel_streaming_requests
2025-09-06 16:07:30 -07:00
Ishaan Jaff
71ce338b24
docs fix
2025-09-06 16:07:02 -07:00
Ishaan Jaff
0754ad9e02
docs fix
2025-09-06 16:01:03 -07:00
Ishaan Jaff
6533ce45a5
docs fix
2025-09-06 16:00:46 -07:00
Ishaan Jaff
0d5bc894f2
fixes
2025-09-06 15:59:35 -07:00
Ishaan Jaff
2d5868b18d
1.76.3
2025-09-06 15:49:10 -07:00
Ishaan Jaff
49532d6d8b
Revert "[Feat]Cancel upstream on client disconnect ( #14295 )" ( #14304 )
...
This reverts commit 51de2ebb64
2025-09-06 15:29:15 -07:00
berri-teddy
3268f1cac6
fix: correct tabs in load_balancing.md
2025-09-06 15:20:40 -07:00
Ishaan Jaff
7f5460465c
unit test oai pass through
2025-09-06 14:54:34 -07:00
Ishaan Jaff
9316dd5c73
fix assistants logging
2025-09-06 14:43:34 -07:00
Ishaan Jaff
b1552cae46
fix mocked CZ tests
2025-09-06 14:33:02 -07:00
Ishaan Jaff
3915a4455a
fix pip install
2025-09-06 14:29:08 -07:00
Ishaan Jaff
66860efd5d
docs config settings
2025-09-06 14:24:18 -07:00
Ishaan Jaff
02763500f6
fix: refactor _translate_response_format_param
2025-09-06 14:16:15 -07:00
Ishaan Jaff
8920a645e9
Revert "feat: add redis ssl and username support ( #11319 )" ( #14303 )
...
This reverts commit 31f806f7d0
2025-09-06 14:01:00 -07:00
Ishaan Jaff
fc7accad74
test_dry_run_export_usage_data_cbf_transformation_failure
2025-09-06 13:59:28 -07:00
