Commit graph

1163 commits

Author SHA1 Message Date
cantalupo555
9b1c5f7e36
feat(zai): Add GLM-4.7 model with reasoning support (#18476)
Add support for Z.AI GLM-4.7, latest flagship model with enhanced reasoning capabilities.

Changes:
- Add zai/glm-4.7 to model pricing with /bin/bash.60/M input, .20/M output
- Add cached input pricing (/bin/bash.11/M) for GLM-4.7
- Add supports_reasoning flag to enable thinking parameter
- Update ZAIChatConfig to support thinking parameter for models with reasoning
- Update documentation with GLM-4.7 as latest flagship model
- Add cached input column to pricing table (GLM-4.7 only)
- Add tests for GLM-4.7 reasoning support and cost calculation
- Update all examples to use GLM-4.7

Model specifications:
- Context: 200K input, 128K output
- Supports: reasoning, function calling, tool choice, prompt caching
- Pricing: Same as GLM-4.6 with cache support

See: https://docs.z.ai/guides/llm/glm-4.7
2026-01-04 00:44:19 +05:30
Daniel Yudelevich
af27c7d7ff
fix: add deprecation_date for discontinued Google models (#18550)
Add deprecation dates for Google models that have been discontinued
per https://ai.google.dev/gemini-api/docs/changelog:

- Gemini 1.5 Flash/Pro models: 2025-09-29
- imagen-3.0-generate-002: 2025-11-10
- veo-3.0 preview models: 2025-11-12
- gemini-2.0-flash image generation: 2025-11-14
- gemini-2.5-flash preview models: 2025-11-18
- gemini-2.0-flash-thinking-exp, pro previews: 2025-12-02
- gemini-2.0-flash-live-001: 2025-12-09
- text-embedding-004: 2026-01-14
- gemini-2.5-flash-image-preview: 2026-01-15

Co-authored-by: Daniel Yudelevich <yudelevi@users.noreply.github.com>
2026-01-03 00:12:58 +05:30
Cesar Garcia
c8950a5ba2
fix(cost_calculator): correct gpt-image-1 cost calculation using token-based pricing (#17906)
* fix(cost_calculator): correct gpt-image-1 cost calculation using token-based pricing (#13847)

gpt-image-1 uses token-based pricing (like chat models), not pixel-based pricing
like DALL-E. The old code was calculating incorrect costs by treating it as DALL-E.

Changes:
- Update model pricing JSON with correct token-based costs for gpt-image-1
- Add dedicated cost calculator for OpenAI gpt-image models
- Route gpt-image-1 to token-based calculator in cost router
- Add comprehensive tests for the new calculator

* refactor: simplify gpt-image-1 cost calculator using responses API helper

Reuse _transform_response_api_usage_to_chat_usage and generic_cost_per_token
for gpt-image-1 cost calculation since ImageUsage has the same spec as
ResponseAPIUsage.
2026-01-02 23:08:52 +05:30
Sameer Kankute
ecbc678771
Merge pull request #18586 from BerriAI/litellm_fix_image_cost_track
Add all resolution for gpt-image-1.5
2026-01-02 20:58:59 +05:30
Sameer Kankute
bbb883ffa9
Merge pull request #18483 from yurekami/fix/deepseek-v3p2-pricing
fix: correct deepseek-v3p2 pricing for Fireworks AI
2026-01-02 17:09:12 +05:30
Sameer Kankute
6e91364004 Add all sizes and resolution for gpt-image-1.5 to model map 2026-01-02 15:40:52 +05:30
Alexsander Hamir
825c12149f
[Fix] CI/CD - litellm_utils_testing (#18565) 2026-01-01 12:48:49 -08:00
yurekami
f5024624d7 fix: correct deepseek-v3p2 pricing for Fireworks AI
Updated pricing for fireworks_ai/accounts/fireworks/models/deepseek-v3p2:
- input_cost_per_token: 1.2e-06 -> 5.6e-07 ($0.56/1M tokens)
- output_cost_per_token: 1.2e-06 -> 1.68e-06 ($1.68/1M tokens)

Pricing verified from https://fireworks.ai/models/fireworks/deepseek-v3p2

Fixes #17998

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2025-12-29 03:44:03 +09:00
mubashir1osmani
861b103dc0
added google image gen models
added google image gen models
2025-12-27 19:55:27 -05:00
mubashir1osmani
043d968c5a added google image gen models 2025-12-27 19:54:39 -05:00
Mihidum
73af18ba20
Add azure/gpt-5.2-chat (#18361)
Add missing azure gpt-5.2-chat to match existing naming schemes
2025-12-25 11:09:05 +05:30
Sameer Kankute
c7e0366925 Add support for minmax tts 2025-12-23 21:53:53 +05:30
Sameer Kankute
d0fa01d13c
Merge pull request #18377 from BerriAI/litellm_minmax_anthropic_spec
Add anthropic native endpoint support for Minimax
2025-12-23 21:49:27 +05:30
Sameer Kankute
fa14a9931f
Merge pull request #18368 from BerriAI/litellm_together_ai_models_update
Add supports_response_schema to all supported together ai models
2025-12-23 17:27:11 +05:30
Sameer Kankute
7559869359
Merge branch 'main' into litellm_minmax_anthropic_spec 2025-12-23 16:13:47 +05:30
Sameer Kankute
743960ad0a Add pricing for minmax models in model map 2025-12-23 16:10:06 +05:30
Emin Askerov
73b64e53ff
Add azure_ai/gpt-oss-120b model pricing details (#18317)
Added pricing and configuration details for the azure_ai/gpt-oss-120b model, including costs and capabilities.
2025-12-23 15:51:57 +05:30
Cesar Garcia
c4b2c570f0
feat(pricing): add Azure gpt-image-1.5 pricing to cost map (#18347)
Add missing pricing entries for azure/gpt-image-1.5 and azure/gpt-image-1.5-2025-12-16 to model_prices_and_context_window.json.

These models use token-based pricing (same as OpenAI):
- Text input: $5.00/1M tokens
- Image input: $8.00/1M tokens
- Image output: $32.00/1M tokens
- Cached text: $1.25/1M tokens
- Cached image: $2.00/1M tokens
2025-12-23 15:49:14 +05:30
Sameer Kankute
c47079ba3a
Merge pull request #18062 from Chesars/fix/groq-deprecated-models
fix: remove deprecated Groq models and update model registry
2025-12-23 12:06:27 +05:30
Sameer Kankute
ca635a5e38 Add supports_response_schema to all supported together ai models 2025-12-23 11:15:38 +05:30
Ishaan Jaff
2677d9d30d
[Feat] New provider TTS - Add AWS polly API for TTS (#18326)
* add aws_polly as new provider

* init AWSPollyTextToSpeechConfig

* test_aws_polly_tts_with_native_voice

* init aws_polly + AWS polly dispatch

* init AWSPollyTextToSpeechConfig

* fix transform

* add aws_polly as a new provider for TTS API

* add to sidebar

* docs aws polly

* code qa fix

* add AWS Polly Text-to-Speech

* add cost tracking for AWS polly

* docs fix
2025-12-22 18:19:34 +05:30
Marty Sullivan
b7fbf3cd7e
add vertexai and gemini veo 3.1 ga models (#18303) 2025-12-22 12:04:44 +05:30
Sameer Kankute
3761f38e43
Merge pull request #18254 from BerriAI/litellm_add_stability_model_edit_1
Add support for stability model and bedrock stability model
2025-12-20 00:23:15 +05:30
Sameer Kankute
d29f4cab59
Merge pull request #17971 from BerriAI/litellm_ocr_deepseek
Add support for ocr for vertex ai deepseek model
2025-12-20 00:13:57 +05:30
Sameer Kankute
b849f51e58 Add support for stability model in image edit 2025-12-19 23:03:17 +05:30
Sameer Kankute
b09ea08424 Add stability models for image edit 2025-12-19 23:03:17 +05:30
Will Chen
3f686521ed
Fix Gemini 3 Flash pricing for Vertex AI (#18202) 2025-12-19 01:13:04 +05:30
Alexsander Hamir
f353bb6dba
[Fix] CI/CD - litellm_mapped_tests_llms | litellm_mapped_tests_core | caching_unit_tests (#18197) 2025-12-18 08:49:23 -08:00
Alexsander Hamir
28821427ce
[Fix] CI/CD #1 - mypy | check_code_and_doc_quality | guardrails_testing (#18195) 2025-12-18 06:31:01 -08:00
Leon
1c401ecf71
Add reasoning support for vertex_ai/gemini-3-flash-preview in model prices and context window (#18175) 2025-12-18 14:53:36 +05:30
Ishaan Jaff
274d996a87
[Feat] New Search API Provider - LinkUp Search (#18174)
* add linkup search provider

* add Linkup Search docs

* add get_provider_search_config

* get_provider_search_config

* add linkup/search provider

* fix mypy linting
2025-12-18 14:27:36 +05:30
Cesar Garcia
d131b7138d
feat(pricing): add output_cost_per_image_token for gemini-2.5-flash-image models (#18156)
Add output_cost_per_image_token ($30/1M = 3e-05) to enable correct
image output cost calculation for gemini-2.5-flash-image models.

Affected models:
- gemini-2.5-flash-image
- gemini-2.5-flash-image-preview
- gemini/gemini-2.5-flash-image
- gemini/gemini-2.5-flash-image-preview
- vertex_ai/gemini-2.5-flash-image
2025-12-18 14:08:45 +05:30
Sameer Kankute
39e16b38c8 Add vertex ai gemini 3 flash in model map 2025-12-18 08:47:02 +05:30
superpoussin22
1d54c4502d
Add diarize model for openai (#18117)
* Add pricing and configuration for gpt-4o-transcribe-diarize

* Add GPT-4o transcription pricing and settings
2025-12-18 02:25:42 +05:30
Sameer Kankute
e3cf0110bb Rename: gemini-3-flash-preview 2025-12-17 21:48:15 +05:30
Sameer Kankute
ba90985300 Add reasoning effort mapping 2025-12-17 18:03:48 +05:30
Sameer Kankute
9e3f946a2e Add support for new flash model 2025-12-17 18:02:14 +05:30
Sameer Kankute
8f7ea945f1 add cached token pricing 2025-12-17 11:20:00 +05:30
Sameer Kankute
fabd832a39 Add gpt-image-1.5-2025-12-16 in model cost map 2025-12-17 11:16:22 +05:30
codgician
58e081b6e0
feat: add github_copilot model info (#17858) 2025-12-17 02:15:13 +04:00
Emerson Gomes
8df713b887
Add Azure DeepSeek V3.2 versions (#18019) 2025-12-17 01:01:57 +04:00
Chesars
7b6a00d3df fix: remove deprecated Groq models and update model registry
- Remove 20 deprecated/unavailable Groq models from registry
- Add groq/meta-llama/llama-guard-4-12b (new safety model)
- Add supports_vision to Llama 4 models (maverick, scout)
- Update Groq documentation with current model list
- Clean up test file references to deprecated models

Fixes #18043
2025-12-16 13:06:33 -03:00
Shivam Rawat
c754794bc3
[fix] add qwen3-embedding-8b input per token price (#18018)
* added embedding input token price

* added embedding input token price
2025-12-16 07:38:21 +05:30
Cesar Garcia
4fdbbdfe6d
fix(anthropic): correct claude-3-7-sonnet max_tokens to 64K default (#17979)
Claude 3.7 Sonnet's default max_output_tokens is 64000, not 128000.
The 128K output limit requires the beta header 'output-128k-2025-02-19'.

This fixes the integration test failure where requests with max_tokens=128000
were being rejected by the Anthropic API.

Fixes test_multiturn_tool_calls in test_anthropic_responses_api.py
2025-12-16 07:27:40 +05:30
Sameer Kankute
174ab1fc66
Merge pull request #17967 from BerriAI/litellm_fireworks_ai_reasoning_param_support
Add support for reasoning param for fireworks AI models
2025-12-15 22:04:04 +05:30
Sameer Kankute
8a6f6385ed
Merge pull request #17966 from BerriAI/litellm_fix_gpt-1_image_cost_1
fix: cost calculation of gpt-image 1 model
2025-12-15 22:03:58 +05:30
Sameer Kankute
57bf6f74e8
Merge pull request #17844 from SamAcctX/patch-2
OpenRouter GPT 5.2, Mistral 3, and Devstral 2
2025-12-15 18:32:50 +05:30
Sameer Kankute
858879919c Add support for ocr for vertex ai deepseek model 2025-12-15 11:45:04 +05:30
Sameer Kankute
57e75a3082 Add support for reasoning param 2025-12-15 09:12:35 +05:30
Sameer Kankute
4f82147746 fix: cost calculation of gpt-image 1 model 2025-12-15 08:16:23 +05:30