Nilanjan De
93037ea4d3
fix: correct the cost for 'gemini/gemini-2.5-pro-preview-03-25' ( #9896 )
...
* fix: Typo in the cost 'gemini/gemini-2.5-pro-preview-03-25', closes #9854
* chore: update in backup file as well
2025-04-12 08:20:04 -07:00
Ishaan Jaff
f9ce754817
[Feat] Add litellm.supports_reasoning() util to track if an llm supports reasoning ( #9923 )
...
* add supports_reasoning for xai models
* add "supports_reasoning": true for o1 series models
* add supports_reasoning util
* add litellm.supports_reasoning
* add supports reasoning for claude 3-7 models
* add deepseek as supports reasoning
* test_supports_reasoning
* add supports reasoning to model group info
* add supports_reasoning
* docs supports reasoning
* fix supports_reasoning test
* "supports_reasoning": false,
* fix test
* supports_reasoning
2025-04-11 17:56:04 -07:00
Ishaan Jaff
2d6ad534bc
[Feat - PR1] Add xAI grok-3 models to LiteLLM ( #9920 )
...
* add xai/grok-3-mini-beta, xai/grok-3-beta
* add grok-3-fast-latest models
* supports_response_schema
* fix pricing
* docs xai
2025-04-11 15:12:12 -07:00
Krish Dholakia
78879c68a9
Revert avglogprobs change + Add azure/gpt-4o-realtime-audio cost tracking ( #9893 )
...
* test: initial commit fixing gemini logprobs
Fixes https://github.com/BerriAI/litellm/issues/9888
* fix(vertex_and_google_ai_studio.py): Revert avglogprobs change
Fixes https://github.com/BerriAI/litellm/issues/8890
* build(model_prices_and_context_window.json): add gpt-4o-realtime-preview cost to model cost map
Fixes https://github.com/BerriAI/litellm/issues/9814
* test: add cost calculation unit testing
* test: fix test
* test: update test
2025-04-10 21:23:55 -07:00
Krish Dholakia
ac4f32fb1e
Cost tracking for gemini-2.5-pro ( #9837 )
...
* build(model_prices_and_context_window.json): add google/gemini-2.0-flash-lite-001 versioned pricing
Closes https://github.com/BerriAI/litellm/issues/9829
* build(model_prices_and_context_window.json): add initial support for 'supported_output_modalities' param
* build(model_prices_and_context_window.json): add initial support for 'supported_output_modalities' param
* build(model_prices_and_context_window.json): add supported endpoints to gemini-2.5-pro
* build(model_prices_and_context_window.json): add gemini 200k+ pricing
* feat(utils.py): support cost calculation for gemini-2.5-pro above 200k tokens
Fixes https://github.com/BerriAI/litellm/issues/9807
* build: test dockerfile change
* build: revert apk change
* ci(config.yml): pip install wheel
* ci: test problematic package first
* ci(config.yml): pip install only binary
* ci: try more things
* ci: test different ml_dtypes version
* ci(config.yml): check ml_dtypes==0.4.0
* ci: test
* ci: cleanup config.yml
* ci: specify ml dtypes in requirements.txt
* ci: remove redisvl depedency (temporary)
* fix: fix linting errors
* test: update test
* test: fix test
2025-04-09 18:48:43 -07:00
Emerson Gomes
d5e362459c
Update Azure Phi-4 pricing ( #9862 )
...
Updates Phi-4 family model prices with recently published info
2025-04-09 13:17:00 -07:00
Li Yang
11389535d5
chore: fix haiku cache read pricing per token ( #9834 )
2025-04-08 16:43:09 -07:00
Krrish Dholakia
367f48004d
build(model_prices_and_context_window.json): consistent params
2025-04-08 12:45:33 -07:00
Krish Dholakia
ac9f03beae
Allow passing thinking param to litellm proxy via client sdk + Code QA Refactor on get_optional_params (get correct values) ( #9386 )
...
* fix(litellm_proxy/chat/transformation.py): support 'thinking' param
Fixes https://github.com/BerriAI/litellm/issues/9380
* feat(azure/gpt_transformation.py): add azure audio model support
Closes https://github.com/BerriAI/litellm/issues/6305
* fix(utils.py): use provider_config in common functions
* fix(utils.py): add missing provider configs to get_chat_provider_config
* test: fix test
* fix: fix path
* feat(utils.py): make bedrock invoke nova config baseconfig compatible
* fix: fix linting errors
* fix(azure_ai/transformation.py): remove buggy optional param filtering for azure ai
Removes incorrect check for support tool choice when calling azure ai - prevented calling models with response_format unless on litell model cost map
* fix(amazon_cohere_transformation.py): fix bedrock invoke cohere transformation to inherit from coherechatconfig
* test: fix azure ai tool choice mapping
* fix: fix model cost map to add 'supports_tool_choice' to cohere models
* fix(get_supported_openai_params.py): check if custom llm provider in llm providers
* fix(get_supported_openai_params.py): fix llm provider in list check
* fix: fix ruff check errors
* fix: support defs when calling bedrock nova
* fix(factory.py): fix test
2025-04-07 21:04:11 -07:00
Michael Clark
cd0a1e6000
Update model_prices ( #9768 )
2025-04-05 09:20:01 -07:00
Ishaan Jaff
220fa23d2b
watsonx/ibm/granite-3-8b-instruct
2025-04-04 21:46:02 -07:00
Ishaan Jaff
e2bb203075
update watsonx/ibm/granite-3-8b-instruct"
2025-04-04 21:45:04 -07:00
Krrish Dholakia
7cd7bdbd0f
build: fix model cost map
2025-04-04 20:48:29 -07:00
caramulrooney
3e9066e91d
Update model_prices_and_context_window.json ( #9620 )
...
Add watsonx/ibm/granite-3-8b-instruct
2025-04-04 20:44:06 -07:00
Hugo Liu
08f9e1447b
fix(asr-groq): add groq whisper models to model cost map ( #9648 )
...
Co-authored-by: liuhu <liuhu@huami.com>
2025-04-04 20:43:46 -07:00
Tobias Hermann
5785600c4e
[Feat] Add VertexAI gemini-2.0-flash ( #9723 )
2025-04-02 22:33:23 -07:00
superpoussin22
136f1d60b3
Update model_prices_and_context_window.json add gemini-2.5-pro-exp-03-25 ( #9650 )
...
* Update model_prices_and_context_window.json
add gemini-2.5-pro-exp-03-25
* Update model_prices_and_context_window.json
correct tokens limit
2025-03-31 21:31:30 -07:00
Krish Dholakia
ef88792ad3
Revert "Revert "Correct Databricks llama3.3-70b endpoint and add databricks c…" ( #9676 )
...
This reverts commit 1e26c594cb
2025-03-31 21:30:50 -07:00
Krish Dholakia
1e26c594cb
Revert "Correct Databricks llama3.3-70b endpoint and add databricks claude 3.…" ( #9668 )
...
This reverts commit dfb838eaff
2025-03-31 17:02:21 -07:00
Anton Abilov
dfb838eaff
Correct Databricks llama3.3-70b endpoint and add databricks claude 3.7 sonnet endpoint ( #9661 )
2025-03-31 15:22:12 -07:00
Krish Dholakia
5c107c64dd
Add gemini audio input support + handle special tokens in sagemaker response ( #9640 )
...
* fix(internal_user_endpoints.py): cleanup unused variables on beta endpoint
no team/org split on daily user endpoint
* build(model_prices_and_context_window.json): gemini-2.0-flash supports audio input
* feat(gemini/transformation.py): support passing audio input to gemini
* test: fix test
* fix(gemini/transformation.py): support audio input as a url
enables passing google cloud bucket urls
* fix(gemini/transformation.py): support explicitly passing format of file
* fix(gemini/transformation.py): expand support for inferred file types from url
* fix(sagemaker/completion/transformation.py): fix special token error when counting sagemaker tokens
* test: fix import
2025-03-29 19:23:09 -07:00
Krish Dholakia
5ac61a7572
Add bedrock latency optimized inference support ( #9623 )
...
* fix(converse_transformation.py): add performanceConfig param support on bedrock
Closes https://github.com/BerriAI/litellm/issues/7606
* fix(converse_transformation.py): refactor to use more flexible single getter for params which are separate config blocks
* test(test_main.py): add e2e mock test for bedrock performance config
* build(model_prices_and_context_window.json): add versioned multimodal embedding
* refactor(multimodal_embeddings/): migrate to config pattern
* feat(vertex_ai/multimodalembeddings): calculate usage for multimodal embedding calls
Enables cost calculation for multimodal embeddings
* feat(vertex_ai/multimodalembeddings): get usage object for embedding calls
ensures accurate cost tracking for vertexai multimodal embedding calls
* fix(embedding_handler.py): remove unused imports
* fix: fix linting errors
* fix: handle response api usage calculation
* test(test_vertex_ai_multimodal_embedding_transformation.py): update tests
* test: mark flaky test
* feat(vertex_ai/multimodal_embeddings/transformation.py): support text+image+video input
* docs(vertex.md): document sending text + image to vertex multimodal embeddings
* test: remove incorrect file
* fix(multimodal_embeddings/transformation.py): fix linting error
* style: remove unused import
2025-03-29 00:23:09 -07:00
Krish Dholakia
c0845fec1f
Add OpenAI gpt-4o-transcribe support ( #9517 )
...
* refactor: introduce new transformation config for gpt-4o-transcribe models
* refactor: expose new transformation configs for audio transcription
* ci: fix config yml
* feat(openai/transcriptions): support provider config transformation on openai audio transcriptions
allows gpt-4o and whisper audio transformation to work as expected
* refactor: migrate fireworks ai + deepgram to new transform request pattern
* feat(openai/): working support for gpt-4o-audio-transcribe
* build(model_prices_and_context_window.json): add gpt-4o-transcribe to model cost map
* build(model_prices_and_context_window.json): specify what endpoints are supported for `/audio/transcriptions`
* fix(get_supported_openai_params.py): fix return
* refactor(deepgram/): migrate unit test to deepgram handler
* refactor: cleanup unused imports
* fix(get_supported_openai_params.py): fix linting error
* test: update test
2025-03-26 23:10:25 -07:00
Krrish Dholakia
109add7946
build(model_prices_and_context_window.json): add gemini multimodal embedding cost
2025-03-26 23:04:24 -07:00
Krrish Dholakia
a97d0563b4
build(model_prices_and_context_window.json): add commercial rate limits for gemini 2.0 flash lite
2025-03-26 08:58:35 -07:00
Ishaan Jaff
8657816477
fix gemini/gemini-2.0-flash-lite on model cost map
2025-03-25 23:20:43 -07:00
Ishaan Jaff
0af9a5e8d0
add gemini/gemini-2.0-flash-lite
2025-03-25 07:51:42 -07:00
Ishaan Jaff
62bb7d6605
add vertex gemini-2.0-flash-lite
2025-03-25 07:48:33 -07:00
superpoussin22
12fdd25841
Update model_prices_and_context_window.json ( #9459 )
...
add mistral-small for vertex_ai
2025-03-24 22:44:00 -07:00
Krrish Dholakia
9fea7cec00
build: add new vertex text embedding model
2025-03-22 21:50:21 -07:00
Ishaan Jaff
d3cad97ebb
add gpt-4o-2024-08-06 pricing for web tools
2025-03-22 18:48:33 -07:00
Ishaan Jaff
b0e61152da
fix model cost map
2025-03-22 16:58:48 -07:00
Ishaan Jaff
1f1f79d7cf
gpt-4o-mini-search-preview-2025-03-11
2025-03-22 14:31:04 -07:00
Ishaan Jaff
647bc314de
add gpt-4o-search-preview-2025-03-11 to model cost map
2025-03-22 14:29:57 -07:00
Ishaan Jaff
ac292f4cbc
fix supports_web_search
2025-03-22 14:02:00 -07:00
Ishaan Jaff
cae75fe46b
fix supports_web_search
2025-03-22 13:44:44 -07:00
Ishaan Jaff
373d59720b
search_context_cost_per_query
2025-03-22 13:07:17 -07:00
Ishaan Jaff
df6901f39e
search_context_cost_per_1k_calls
2025-03-22 13:04:24 -07:00
Ishaan Jaff
baa2bdb762
add supports_web_search
2025-03-22 12:59:50 -07:00
Ishaan Jaff
d2e36d8bed
search_context_cost_per_1k_calls
2025-03-22 12:57:00 -07:00
Ishaan Jaff
4683b8ea70
add search_context_cost_per_1k_calls
2025-03-22 10:24:08 -07:00
Ishaan Jaff
7e1cd7cbeb
bug fix azure/gpt-4.5-preview was added as litellm_provider=openai, should be azure
2025-03-21 20:50:13 -07:00
Emerson Gomes
8c5d57b84c
Add Azure GPT-4.5-Preview
2025-03-21 19:02:55 -05:00
Emerson Gomes
a5128ce4fd
Add Azure Mistral Small 3.1
2025-03-21 19:02:38 -05:00
Krrish Dholakia
056d34742f
build(model_prices_and_context_window.json): fix native streaming flag
2025-03-19 19:53:19 -07:00
Krrish Dholakia
78781a0a55
build(model_prices_and_context_window.json): add o1-pro pricing
2025-03-19 19:35:35 -07:00
Krrish Dholakia
0194c18820
build(model_prices_and_context_window.json): fix azure gpt-4o pricing
...
fix default to use latest global pricing
2025-03-18 22:34:58 -07:00
Sunny Wan
f9a5109203
Merge branch 'BerriAI:main' into main
2025-03-13 19:37:22 -04:00
Krrish Dholakia
86ed6be85e
fix: fix learnlm test
2025-03-13 10:54:09 -07:00
Krish Dholakia
cff1c1f7d8
Merge branch 'main' into litellm_dev_03_12_2025_p1
2025-03-12 22:14:02 -07:00
