Commit graph

2708 commits

Author SHA1 Message Date
Ishaan Jaffer
58d9531869 test_is_bge_model_detection 2025-12-02 21:59:02 +05:30
Ishaan Jaffer
0abf450b7e tes BGE 2025-12-02 21:59:02 +05:30
Ishaan Jaffer
8957770e68 test_vertex_ai_bge_embedding_with_custom_api_base 2025-12-02 21:59:02 +05:30
Ishaan Jaffer
f2befcf657 test_vertex_ai_bge_embedding_with_custom_api_base 2025-12-02 21:59:02 +05:30
Sameer Kankute
bf1308e86b Support for Custom Vertex AI Models via PSC Endpoint with api_base (#15953)
* Support for Custom Vertex AI Models via PSC Endpoint with api_base

* Add docs related psc

* remove not needed files

* remove print statemnt

* fix mypy errors
2025-12-02 21:58:58 +05:30
Sameer Kankute
831ad45c4d Add ragflow support 2025-12-02 18:18:08 +05:30
Korbinian Koch
6e8e3b30f9
Update Databricks model pricing and add new models (including databricks pricing test). (#17277)
* update databricks pricing and add DBU<>USD test

* Refactor test_databricks_pricing.py

Removed unnecessary sys.path modification and cleaned up comments.
2025-12-01 20:06:47 -08:00
codgician
e09e309371
feat(github-copilot): Add Embedding API support (#17278) 2025-12-01 20:05:28 -08:00
Cesar Garcia
965406c643
feat(provider): add Z.AI (Zhipu AI) as built-in provider (#17307)
* feat(provider): add Z.AI (Zhipu AI) as built-in provider

Add support for Z.AI GLM models as a native OpenAI-compatible provider.

- Add "zai" to openai_compatible_providers list
- Add ZAI enum to LlmProviders
- Add provider URL resolution for https://api.z.ai/api/paas/v4
- Add 8 GLM models with pricing to model cost maps:
  - glm-4.6 (200K context, $0.6/$2.2 per 1M tokens)
  - glm-4.5, glm-4.5v, glm-4.5-x, glm-4.5-air, glm-4.5-airx
  - glm-4-32b-0414-128k
  - glm-4.5-flash (free tier)
- Add unit tests for provider integration

Closes #17289

* docs: add Z.AI provider documentation

- Add zai.md with usage examples, model list, and pricing
- Add to sidebars.js navigation
2025-12-01 19:56:47 -08:00
Sameer Kankute
289c13ca5d
Merge pull request #17260 from abi-jey/main
fix: GA path for azure openai realtime models
2025-12-02 08:34:10 +05:30
Sameer Kankute
dbf1cd591d
Merge pull request #17271 from colinlin-stripe/cherry-pick-invoke-headers
[fix] extra_headers in messages api bedrock invoke
2025-12-02 08:26:54 +05:30
Ishaan Jaff
860cdc81d3
[Fix] Fix Watsonx Audio Transcription API (#17326)
* """
add

* fix transform_audio_transcription_request

* fix tests

* test_watsonx_transcription_request_body
2025-12-01 18:26:56 -08:00
Elias
37ecb03d4f
Add support of audio transcription for OVHcloud (#17305) 2025-12-01 18:26:39 -08:00
Ishaan Jaff
ce0dc0c8b9
[Feat] WatsonX - allow passing zen_api_key dynamically (#16655)
* test_watsonx_zen_api_key_from_client

* zen api key

* docs using zen api key
2025-12-01 12:55:47 -08:00
Colin Lin
661bccbc39 fixed flaky test by sorting list 2025-12-01 14:26:14 -05:00
Colin Lin
e420b633a1 add tests 2025-12-01 14:25:37 -05:00
Chesars
8f6822a642 Fix: Allow reasoning_effort='none' for Azure gpt-5.1 models
PR #17071 drops or errors on reasoning_effort='none' for all GPT models.
It doesn't actually allow 'none' to be sent to Azure for gpt-5.1 which
supports it according to Azure documentation.

See: https://learn.microsoft.com/en-us/azure/ai-foundry/openai/how-to/reasoning
"none is only supported for gpt-5.1"
2025-12-01 12:55:01 -03:00
Sameer Kankute
983ba7aa0f Remove not compatible beta header from claude code 2025-12-01 17:22:04 +05:30
Sameer Kankute
7f42b9b987
Merge pull request #17193 from BerriAI/litellm_twelvelabs_int
Added support for twelvelabs pegasus
2025-11-28 22:09:00 +05:30
Sameer Kankute
9d058398df Fix pegasus response and add doc 2025-11-28 21:41:25 +05:30
abbas jafari
23b737d2a4
Merge branch 'BerriAI:main' into main 2025-11-28 15:28:52 +01:00
abi_jey
4cf7a74e60 fix: Azure OpenAI GA path relies soley on model paramter as deployment 2025-11-28 14:27:57 +00:00
Andy Forest
8aa4f3d476
fix(bedrock): handle cohere v4 embed response dictionary format (#17220) 2025-11-27 21:50:35 -08:00
Wei-Chiet Ku
d43c077653
Fix/issue 16759 streaming error validation (#17242)
* Enhance error handling in OpenAIResponsesAPIConfig to coalesce null error codes into a default string, preventing validation errors and improving stability during streaming iterations.

* Add test for coalescing null error codes in streaming responses

This test ensures that when a streaming error event has error.code set to None, the system correctly transforms it to 'unknown_error' and returns an ErrorEvent instance without raising a ValidationError.

---------

Co-authored-by: Ku Wei Chiet <chietkuw@fpt.com>
2025-11-27 21:24:04 -08:00
Sameer Kankute
71f41352fa
Merge pull request #17202 from BerriAI/litellm_azure_ai_anthropic_support
(Bug)Migrate Anthropic provider to azure ai
2025-11-28 08:14:14 +05:30
Ishaan Jaff
edfc35ddac
[Feature]: Add Provider publicai.co (#17230)
* init PublicAIChatConfig

* add publicai

* init public ai

* add publicai

* add publicai/swiss-ai models etc
2025-11-27 13:08:03 -08:00
Sameer Kankute
9669f33b39 fix tests/test_litellm/llms/azure_ai/claude/test_azure_anthropic_handler.py 2025-11-27 22:59:29 +05:30
Sameer Kankute
5fc950ec05 migrate anthropic provider to azure ai provider 2025-11-27 19:47:54 +05:30
abbas jafari
af5f31eb9f
Merge branch 'BerriAI:main' into main 2025-11-27 14:46:15 +01:00
Sameer Kankute
247160277e Added support for twelvelabs pegasus 2025-11-27 15:46:04 +05:30
Ishaan Jaffer
ce60453855 test_gemini_get_complete_url 2025-11-26 14:35:03 -08:00
Ishaan Jaff
d987593855
[Feat] Add audio transcriptions for WatsonX (#17160)
* feat: add IBMWatsonXAudioTranscriptionConfig

* init IBMWatsonXAudioTranscriptionConfig

* add inits

* test_watsonx_transcription_url_and_headers

* docs watsox audio

* docs watsonx audi

* docs
2025-11-26 14:15:49 -08:00
Ishaan Jaffer
44e3133827 test_imagen_get_complete_url 2025-11-26 12:26:49 -08:00
Chesars
8c128edb5d test: add unit tests for BaseModelResponseIterator empty SSE line filtering
Tests verify that empty lines between SSE events are properly filtered
and don't produce extra empty chunks in streaming responses.
2025-11-26 17:05:40 -03:00
Sameer Kankute
9a85ffceff Fix tests related to mediaResolution 2025-11-26 21:45:50 +05:30
Sameer Kankute
e49f21c918 Make sure that media resolution is only for gemini 3 model 2025-11-26 18:57:57 +05:30
abi_jey
98344417ab fix: tested e2e implementation and added sample config. 2025-11-26 12:37:13 +00:00
abbas jafari
fdee1e2946
Merge branch 'BerriAI:main' into main 2025-11-26 10:22:13 +01:00
Sameer Kankute
86a9b74fc8 Fix Thinking may not be enabled when tool_choice forces tool use 2025-11-26 13:32:13 +05:30
Sameer Kankute
67622fb040
Add day 0 support for anthropic new feat (#17091)
* Added tool search support for anthropic

* Add programtic tool calling support

* Add tool use input examples support

* Add anthropic effort param support

* Add anthropic effort param support

* Add blog for new features

* fix mypy and lint errors

* fix mypy and lint errors

* fix mypy and lint errors

* fix mypy and lint errors

* Add better handling

* Add better handling
2025-11-25 11:28:47 -08:00
abi_jey
aec0ab777b feat: add GA protocol as litellm_params for realtime api on azure provider 2025-11-25 19:18:41 +00:00
Sameer Kankute
3249f6dd2d
Merge pull request #17070 from BerriAI/litellm_add_vertex_ai_image_support
Add vertex ai image gen support for both gemini and imagen models
2025-11-26 00:04:03 +05:30
Sameer Kankute
83a9dcd2d2
Merge pull request #16886 from BerriAI/litellm_anthopic_azure_support
Added support for azure anthopic models via chat completion
2025-11-26 00:03:52 +05:30
Sameer Kankute
e0396e5fa7
Merge pull request #17082 from BerriAI/main
merge main
2025-11-25 18:49:52 +05:30
Sameer Kankute
e2f2ccd913 Add tests related messages api 2025-11-25 18:45:51 +05:30
Sameer Kankute
c149ade6a8 Add tests related to reasoning param none 2025-11-25 13:57:15 +05:30
Sameer Kankute
a50083a87b Remove none support from reasoning param 2025-11-25 13:56:30 +05:30
Sameer Kankute
883cfaeeaf Add tests 2025-11-25 13:32:13 +05:30
wcyat
6dcb5425a5
fix(vertex): fix CreateCachedContentRequest enum error (#16965)
* feat: add _fix_enum_types function to remove enums from non-string fields in schema

* test: add test for _fix_enum_types function to validate enum removal from non-string fields
2025-11-24 21:24:29 -08:00
Cesar Garcia
650b18974f
fix(gemini): skip thinking config for image models (#17027)
* fix(gemini): exclude image models from automatic thinking_level parameter (#17013)

- gemini-3-pro-image-preview does not support thinking_level parameter
- Added check to skip adding thinkingConfig for models containing "image"
- Fixes BadRequestError: "Thinking level is not supported for this model"
- Only affects automatic default behavior, user can still pass reasoning_effort explicitly

Fixes #17013

* test: add tests for gemini-3 image models thinking_level exclusion

* update docs
2025-11-24 20:54:12 -08:00