Krish Dholakia
324cfe8bdc
fix(streaming_handler.py): include cost in streaming usage object ( #13319 )
...
Fixes https://github.com/BerriAI/litellm/issues/12689
2025-08-05 18:38:31 -07:00
Krrish Dholakia
2e3f564a39
fix: fix map
2025-08-05 18:33:36 -07:00
Ishaan Jaff
50c4a32c7d
docs claude-opus-4-1-20250805
2025-08-05 18:02:22 -07:00
Ishaan Jaff
4c1adeaf67
bump: version 1.75.1 → 1.75.2
2025-08-05 17:53:15 -07:00
Krrish Dholakia
352b7ae913
build(model_prices_and_context_window.json): add vertex ai claude-opus-4.1
...
Add claude opus 4.1
2025-08-05 17:52:35 -07:00
Ishaan Jaff
da40b5ec47
bump litellm enterprise
2025-08-05 17:50:40 -07:00
Ishaan Jaff
0308a835b8
bump: version 0.1.17 → 0.1.18
2025-08-05 17:47:16 -07:00
Jugal D. Bhatt
b6fcda2f8a
[LLM Translation] Fix model group on clientside auth with API calls ( #13314 )
...
* fix unsupported operand type(s) for +=: 'NoneType' and 'str' on clientside auth creds for responses
* fix the client side auth to use correct metadata
* add more tests
* fix tests
2025-08-05 17:46:47 -07:00
Ishaan Jaff
b455ada161
[Bug Fix] [Bug]: New Databricks Foundation Models databricks-gpt-oss-20b and databricks-gpt-oss-120b failed with error: litellm.APIConnectionError: 'signature' ( #13318 )
...
* test_transform_choices_without_signature
* fix ChatCompletionThinkingBlock
* extract_reasoning_content
2025-08-05 17:46:40 -07:00
Ishaan Jaff
dab8ba03e3
[Feat] - When using custom tags on prometheus allow using wildcard patterns ( #13316 )
...
* _tag_matches_wildcard_configured_pattern
* test_get_custom_labels_from_tags_wildcard_patterns
* docs Custom Tags
* docs how custom tags work
* fix
2025-08-05 17:46:13 -07:00
Ishaan Jaff
0ccc493455
[Bug]: Fix Mimetype Resolution Error in Bedrock Document Understanding ( #13309 )
...
* fix _validate_format for BedrockImageProcessor
* add test
* fix _validate_format for bedrock
* _get_document_format
* test_bedrock_get_document_format_fallback_mimes
* fix: add fallback method for mime type detection
2025-08-05 17:07:10 -07:00
Jugal D. Bhatt
b2146713e5
refactor mcp guardrails ( #13238 )
2025-08-05 16:26:36 -07:00
tanjiro
2399fd49ab
fix for baseurl ending with / ( #13289 )
2025-08-05 16:14:59 -07:00
Jugal D. Bhatt
8b2478e7d6
[Proxy server] Add apscheduler log suppress ( #13299 )
...
* Add log suppress
* Add log suppress
2025-08-05 15:04:51 -07:00
Jugal D. Bhatt
7524aa386c
[Redis IAM] Change documentation ( #13306 )
...
* change docs
* addde note
2025-08-05 15:04:46 -07:00
Ishaan Jaff
475aa06117
anthropic.claude-opus-4
2025-08-05 14:08:21 -07:00
Jugal D. Bhatt
32501c85f5
fix unsupported operand type(s) for +=: 'NoneType' and 'str' on clientside auth creds for responses ( #13293 )
2025-08-05 13:16:16 -07:00
tanjiro
fd92f3eaf1
team req for service acc ( #13302 )
2025-08-05 13:01:54 -07:00
Ishaan Jaff
2eef77d960
add fireworks gpt-oss-20b ( #13303 )
2025-08-05 12:30:09 -07:00
Ishaan Jaff
0db13acdc7
New models - add fireworks_ai/glm-4p5 model family ( #13297 )
...
* add fireworks_ai/glm-4p5
* fix max output tokens
2025-08-05 12:08:42 -07:00
Ishaan Jaff
cc5c7aba03
[New model] add bedrock/us.anthropic.claude-opus-4-1-20250805-v1:0 ( #13295 )
...
* add us.anthropic.claude-opus-4-1-20250805-v1:0 bedrock model
* fix BEDROCK_CONVERSE_MODELS
2025-08-05 11:56:47 -07:00
Jugal D. Bhatt
1b9dd9daee
claude opus 4.1 support for anthropic provider ( #13296 )
2025-08-05 11:56:10 -07:00
Jugal D. Bhatt
609fa9f5ca
[LLM Translation + Coding tools] Added litellm claude code count tokens support ( #13261 )
...
* Added litellm claude code count tokens support
* fix mypy
* create helper
* Revert construct
* revert construct
* fix return
* Add reutrn none
* change to factory approach
* refactor to BaseModelInfo
* enum fix
2025-08-05 10:57:24 -07:00
Jugal D. Bhatt
29a8c583c2
added redis iam auth ( #13275 )
2025-08-05 10:56:34 -07:00
Ishaan Jaff
7c42659a98
Revert "Fix: Langfuse reporting "client closed" error due to httpx client TTL…" ( #13291 )
...
This reverts commit 1c6be9bdad
2025-08-05 09:58:57 -07:00
Ishaan Jaff
5a02eb473b
test_function_calling_with_tool_response
2025-08-05 09:55:47 -07:00
Krish Dholakia
416da066eb
fix(main.py): handle tool being a pydantic object ( #13274 )
...
* fix(main.py): handle tool being a pydantic object
Fixes https://github.com/BerriAI/litellm/issues/13064
* fix(prompt_templates/common_utils.py): fix unpack defs deepcopy issue
Fixes https://github.com/BerriAI/litellm/issues/13151
* fix(utils.py): handle tools is none
2025-08-04 23:44:02 -07:00
Krish Dholakia
eb49f987de
Ensure disable_llm_api_endpoints works + Add wildcard model support for 'team-byok' model ( #13278 )
...
* fix(route_checks.py): ensure disable llm api endpoints is correctly set
* fix(route_checks.py): raise httpexception
raise expected exceptions
* fix(router.py): handle team only wildcard models
fixes issue where team only wildcard models were not considered during auth checks
* fix(router.py): handle team only wildcard models
fixes issue where team only wildcard models were not considered during auth checks
2025-08-04 23:19:51 -07:00
Krish Dholakia
af67c3576f
fix OCI linting errors ( #13279 )
...
* fix(types/llms/oci.py): fix linting errors
* fix(oci.py): fix linting error
* fix(oci.py): fix linting errors
* fix: fix linting error
* fix: fix linting error
2025-08-04 23:10:46 -07:00
Ishaan Jaff
ec205fec35
[UI] - Add ability to set model alias per key/team ( #13276 )
...
* update model alias on keys
* team model aliases
* fix model aliases
* fixes for teams
2025-08-04 21:47:39 -07:00
Jugal D. Bhatt
efd34966dc
[LLM Translation] Support /v1/models/{model_id} retrieval ( #13268 )
...
* added model id endpoint
* fix test
* add route to internal users
* make the functions reusable
* fixed mypy
2025-08-04 18:03:59 -07:00
Jugal D. Bhatt
de7108b5f8
input cost per token higher than 1 test ( #13270 )
2025-08-04 18:02:03 -07:00
Ishaan Jaff
ad26cba8b6
add litellm-enterprise==0.1.17
2025-08-04 17:26:50 -07:00
Ishaan Jaff
8314227a60
bump: version 1.75.0 → 1.75.1
2025-08-04 17:24:40 -07:00
Ishaan Jaff
d948b47dba
bump: version 1.74.15 → 1.75.0
2025-08-04 17:23:55 -07:00
Ishaan Jaff
ba1882fdd5
[Bug Fix] Prometheus - fix for litellm_input_tokens_metric, litellm_output_tokens_metric - Note this updates the metric name ( #13271 )
...
* fixes for litellm_tokens_metric
* test_prometheus_token_metrics_with_prometheus_config
2025-08-04 17:22:21 -07:00
Krrish Dholakia
37cb443010
refactor(oci/chat/transformation.py): lazy load package imports
2025-08-04 17:12:36 -07:00
Jugal D. Bhatt
368c9b75b9
add correct pricing ( #13269 )
2025-08-04 17:00:16 -07:00
Perling
1c6be9bdad
Fix: Langfuse reporting "client closed" error due to httpx client TTL ( #13045 )
...
* Fix: Langfuse reporting "client closed" error due to httpx client TTL
* remove log
2025-08-04 16:12:51 -07:00
Pascal Bro
a17d483c89
Add GCS bucket caching support ( #13122 )
2025-08-04 16:09:33 -07:00
breno-aumo
056b60a9fa
Support OCI provider ( #13206 )
...
* create OCI required files
* request and response conversion for non-streaming chat
* support tool calling with OCI generic API without streaming
* adaptation of api call for generic and cohere format
* include tool calls and responses in generic api and dropping support for cohere
* fix invalid content-length error
* support streaming for generic api
* fix auth error when using acompletion with streaming
* refactor: use base_llm_http_handler and include API type definitions
* update types and add type safety in different methods
* fix OCIFunction format
* create custom stream wrapper for decoding OCI stream
* remove unused files
* create unit tests for OCI
* lint the code
* remove manual test
* docs: update the docs to include OCI
2025-08-04 15:59:25 -07:00
Ishaan Jaff
849f5e0ba0
[Bug Fix] Fix Server root path regression on UI when using "Login" ( #13267 )
...
* bug fix serve_login_page
* test_serve_login_page_server_root_path
2025-08-04 15:58:28 -07:00
Benjamin Bartels
779579a604
Update model_prices_and_context_window.json ( #13244 )
2025-08-04 15:56:36 -07:00
Krrish Dholakia
747467c819
docs(user_keys.md): add litellm python sdk tab
2025-08-04 15:14:13 -07:00
Krrish Dholakia
bfecab2cc5
docs(index.md): cleanup tag
2025-08-04 14:18:04 -07:00
Ishaan Jaff
f3749709b8
Bug Fix - Responses API raises error with Gemini Tool Calls in input ( #13260 )
...
* add _transform_responses_api_function_call_to_chat_completion_message
* test_responses_api_with_tool_calls
* TestFunctionCallTransformation
* fixes for responses API testing google ai studio
* TestGoogleAIStudioResponsesAPITest
* test_responses_api_with_tool_calls
* test_responses_api_with_tool_calls
* test_basic_openai_responses_streaming_delete_endpoint
2025-08-04 12:01:33 -07:00
Ishaan Jaff
dae72003a7
[Bug Fix] OpenAI / Azure Responses API - Add service_tier , safety_identifier supported params ( #13258 )
...
* test_aresponses_service_tier_and_safety_identifier
* add service_tier + safety_identifier
* fix get_supported_openai_params
* add safety_identifier + service_tier for responses()
2025-08-04 10:51:53 -07:00
Jugal D. Bhatt
b318f55faa
[UI] Add team deletion check for teams with keys ( #12953 )
...
* added check option
* Add underline
* make less verbosE
2025-08-04 08:42:06 -07:00
Jugal D. Bhatt
36229dc69f
[LLM Translation] Fix Model Usage not having text tokens ( #13234 )
...
* fix + test
* remove test comments
* fix mypy
* fix mypy
* fix tests
2025-08-04 21:06:49 +05:30
Krrish Dholakia
98102e2804
docs(index.md): cleanup
2025-08-02 23:06:46 -07:00
