scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-06 02:48:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 103

fix: correct cache pricing for Claude 3 Haiku CRIS variants on Bedrock

Browse source 
Four cross-region Bedrock keys for Claude 3 Haiku carry cache prices
derived from the generic 1.25x write / 0.1x read ratios, but Anthropic's
published prices are non-round values (/usr/bin/zsh.30 write / /usr/bin/zsh.03 read per Mtok).

Keys fixed:
- anthropic.claude-3-haiku-20240307-v1:0
- apac.anthropic.claude-3-haiku-20240307-v1:0
- eu.anthropic.claude-3-haiku-20240307-v1:0
- us.anthropic.claude-3-haiku-20240307-v1:0

Changes:
- cache_read_input_token_cost: 2.5e-08 → 3e-08 (/usr/bin/zsh.025 → /usr/bin/zsh.03)
- cache_creation_input_token_cost: 3.125e-07 → 3e-07 (/usr/bin/zsh.3125 → /usr/bin/zsh.30)

Impact: corrects cache-read costs understated by 16.7% and
cache-write costs overstated by 4.2% for these four keys.

Fixes #40360
This commit is contained in:
truongsontung 2026-09-09 12:50:26 +07:00
parent ee7c7e14f3
commit 528cc06045
1 changed files with 8 additions and 8 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

16
model_prices_and_context_window.json
View file

@ -953,8 +953,8 @@
"supports_response_schema": true,
"supports_tool_choice": true,
"supports_vision": true,
"cache_read_input_token_cost": 2.5e-08,
"cache_creation_input_token_cost": 3.125e-07
"cache_read_input_token_cost": 3e-08,
"cache_creation_input_token_cost": 3e-07
},
"anthropic.claude-3-opus-20240229-v1:0": {
"input_cost_per_token": 1.5e-05,
@ -2955,8 +2955,8 @@
"supports_response_schema": true,
"supports_tool_choice": true,
"supports_vision": true,
"cache_read_input_token_cost": 2.5e-08,
"cache_creation_input_token_cost": 3.125e-07
"cache_read_input_token_cost": 3e-08,
"cache_creation_input_token_cost": 3e-07
},
"apac.anthropic.claude-haiku-4-5-20251001-v1:0": {
"cache_creation_input_token_cost": 1.375e-06,
@ -21104,8 +21104,8 @@
"supports_response_schema": true,
"supports_tool_choice": true,
"supports_vision": true,
"cache_read_input_token_cost": 2.5e-08,
"cache_creation_input_token_cost": 3.125e-07
"cache_read_input_token_cost": 3e-08,
"cache_creation_input_token_cost": 3e-07
},
"eu.anthropic.claude-3-opus-20240229-v1:0": {
"input_cost_per_token": 1.5e-05,
@ -43829,8 +43829,8 @@
"supports_response_schema": true,
"supports_tool_choice": true,
"supports_vision": true,
"cache_read_input_token_cost": 2.5e-08,
"cache_creation_input_token_cost": 3.125e-07
"cache_read_input_token_cost": 3e-08,
"cache_creation_input_token_cost": 3e-07
},
"us.anthropic.claude-3-opus-20240229-v1:0": {
"input_cost_per_token": 1.5e-05,