Commit graph

8758 commits

Author SHA1 Message Date
Ishaan Jaff
f4ecf3ca72
[Feat] Fixes for LiteLLM Proxy CLI to Auth to Gateway (#14836)
* fix: error msg from updating key

* fix _create_new_cli_key

* fix validate_key_team_change

* fix interface for chat

* ruff fix

* fix auth for keys

* get_litellm_gateway_api_key

* fix chat

* test fix

* linting fix

* fix mypy

* test_validate_key_team_change_with_member_permissions
2025-09-23 19:43:32 -07:00
Ishaan Jaffer
e1b342604d test vertex test_get_token_url 2025-09-23 19:34:50 -07:00
Alex Shoop
c919996470
Merge branch 'main' into akshoop/fastuuid-dep-make-optional 2025-09-24 10:31:09 +09:00
Krish Dholakia
64a305f9dd
Merge pull request #14721 from dharamendrak/reuse-aiohttp-session-http-handler
feat: Add shared_session parameter for aiohttp ClientSession reuse
2025-09-23 18:07:32 -07:00
Ishaan Jaffer
a48273740d test fix 2025-09-23 17:46:09 -07:00
Ishaan Jaffer
79a6feb7ac generate_mock_mcp_server_config_record 2025-09-23 17:33:11 -07:00
Ishaan Jaffer
eb72990aa6 test_get_valid_models_with_cli_pattern 2025-09-23 16:46:40 -07:00
Ishaan Jaffer
aaebd83f31 test fixes 2025-09-23 16:07:01 -07:00
Ishaan Jaffer
5fc70396ad test fix 2025-09-23 15:50:11 -07:00
Ishaan Jaffer
7e64df92a5 test_cli_sso_callback_regenerate_existing_key 2025-09-23 15:42:07 -07:00
Ishaan Jaffer
8016bcb1b9 test fix 2025-09-23 14:41:30 -07:00
Ishaan Jaffer
bb6fb445c0 ui test fix 2025-09-23 14:34:08 -07:00
Ishaan Jaffer
f8c1f519c9 test_aaamodel_prices_and_context_window_json_is_valid 2025-09-23 14:26:38 -07:00
Ishaan Jaffer
a88d774f94 Revert "Merge pull request #14720 from uc4w6c/feat/remove-servername-prefix-mcp_tools"
This reverts commit 7216983f48, reversing
changes made to e377e30e95.
2025-09-23 14:14:43 -07:00
Ishaan Jaffer
426c6fea9f Revert "Merge pull request #14761 from uzaxirr/feat/sdk-additional-headers"
This reverts commit 8628c265b9, reversing
changes made to be193fbffd.
2025-09-23 13:59:54 -07:00
Jack Temple
1585a1ba8e fix: SSO clear button now properly clears settings instead of creating empty encrypted values 2025-09-23 14:35:53 -05:00
hazyone
96aed6a4d4 test added 2025-09-23 20:16:05 +02:00
Dharamendra Kumar
34f51a20eb Merge branch 'main' into reuse-aiohttp-session-http-handler 2025-09-23 10:36:35 -07:00
Dharamendra Kumar
04acd4b739 Update var name for consistency 2025-09-23 10:28:40 -07:00
Alex Shoop
c659b7e587
Merge branch 'main' into akshoop/fastuuid-dep-make-optional 2025-09-24 01:45:38 +09:00
Alex Shoop
bfd6fb8981 uncomment fastuuid requirements.txt, move test module 2025-09-24 01:12:02 +09:00
tyler-liner
47800757fd feat(opentelemetry): use generation_name for span naming in logging method 2025-09-23 15:53:41 +09:00
Krish Dholakia
e912b89549
Merge branch 'main' into feat/remove-servername-prefix-mcp_tools 2025-09-22 22:43:12 -07:00
Krish Dholakia
b7803bcbb0
Merge pull request #14778 from otaviofbrito/chore/fix-vllm-pasthrough
fix vllm passthrough
2025-09-22 22:40:15 -07:00
Krish Dholakia
88f9cad886
Merge pull request #14796 from BerriAI/litellm_anthopic_token_count_issue
Add service_tier based pricing support for openai[ BOTH Service & Priority Support]
2025-09-22 22:38:59 -07:00
Krish Dholakia
66f7e4a832
Merge pull request #14790 from eycjur/support_flux_image_edit
[Feat] Support flux image edit
2025-09-22 22:38:45 -07:00
Sameerlite
d2208023d2 Add service_tier based pricing support for openai 2025-09-23 10:48:27 +05:30
Ishaan Jaff
b9ffa98c55
[Feat] Proxy CLI: Create a python method to login using litellm proxy (#14782)
* fix: cli auth with SSO okta

* fix: add LITTELM_CLI_SERVICE_ACCOUNT_NAME

* fix: get_litellm_cli_user_api_key_auth

* use existing_key CLI

* fix: use existing key

* test auth commands

* test_cli_sso_callback_regenerate_vs_create_flow

* feat: add CLI Token Utilities

* fix: get_stored_api_key

* move file

* fix: get_valid_models

* fix config.yaml

* TestCLITokenUtils

* TestGetValidModelsWithCLI

* fix: tie user id to keys created through CLI

* fix: add teams interface to CLI

* add /keys/update to the list client commands

* fix /sso/cli/poll to return the user_id

* fix: working TeamsManagementClient

* fix CLI Login command

* fixes for auth

* Potential fix for code scanning alert no. 3400: Clear-text logging of sensitive information

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

* ruff fix

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-09-22 21:28:38 -07:00
Uzair Ali
3e9540f589
feat: enable custom fields in mcp_info configuration (#14794)
Allow proxy admins to add arbitrary metadata fields to MCP servers
in config.yaml under mcp_servers.<server>.mcp_info, similar to how
model_info already works.

Changes:
- Changed MCPInfo from TypedDict to Dict[str, Any] for flexibility
- Updated load_servers_from_config to preserve all custom fields
- Updated add_update_server to handle arbitrary fields from database
- Added comprehensive unit tests covering all scenarios
2025-09-22 21:15:35 -07:00
eycjur
00b36554b3 add unit test 2025-09-23 01:57:50 +00:00
Krish Dholakia
0a1c1a27a7
Merge pull request #14787 from BerriAI/litellm_dev_09_22_2025_p1
docs(provider_specific_params.md): fix docs
2025-09-22 17:45:57 -07:00
Krrish Dholakia
70cd9d3d4e test: fix unit test to work on github action 2025-09-22 17:38:11 -07:00
Anubhav Singh
fde4dcb0b8
Merge branch 'main' into wandb-inference 2025-09-23 00:14:11 +05:30
Fabrício Ceschin
c854e8a9d0
Merge branch 'BerriAI:main' into LangfuseUsageDetails 2025-09-22 13:21:35 -04:00
Ishaan Jaff
fa20abfe48
[Feat] Proxy CLI Auth - Allow re-using cli auth token (#14780)
* fix: cli auth with SSO okta

* fix: add LITTELM_CLI_SERVICE_ACCOUNT_NAME

* fix: get_litellm_cli_user_api_key_auth

* use existing_key CLI

* fix: use existing key

* test auth commands

* test_cli_sso_callback_regenerate_vs_create_flow
2025-09-22 10:07:16 -07:00
Otavio Brito
ffd9117357 fix failing test 2025-09-22 11:06:11 -03:00
Fabrício Ceschin
8e15cc18ff
Merge branch 'BerriAI:main' into LangfuseUsageDetails 2025-09-22 09:43:33 -04:00
Otavio Brito
33a11c4b07 fix vllm passthrough 2025-09-22 10:09:02 -03:00
Krish Dholakia
9096d9cb25
Merge branch 'main' into feat/issue-14562-bedrock-converse-request-metadata 2025-09-21 21:26:37 -07:00
uzaxirr
d8d5581f29 Resolve merge conflicts with main branch
- Accept main branch's consolidation of Cohere providers
- Preserve header implementation with proper three-tier merging
- Replace outdated header handling in Cohere sections with consolidated approach
- Maintain backward compatibility and functionality
2025-09-22 05:59:28 +05:30
uzaxirr
50d717cde0 Apply Black formatting and fix Ruff issues
- Format code with Black to meet style requirements
- Fix auto-fixable Ruff linting issues
- Maintain header implementation functionality
2025-09-22 04:46:08 +05:30
uzaxirr
3986b073c9 feat: Add SDK support for additional headers 2025-09-21 14:58:14 +05:30
Ishaan Jaffer
59d2f0f465 test_string_cost_values 2025-09-20 13:34:57 -07:00
Ishaan Jaffer
4b876ea9ca test_sanitize_request_body_for_spend_logs_payload_mixed_types 2025-09-20 12:33:37 -07:00
Ishaan Jaffer
ed5c9f1c69 test fixes for mapped tests 2025-09-19 18:01:36 -07:00
Krish Dholakia
6142c3ac3d
Merge pull request #14738 from BerriAI/litellm_dev_09_19_2025_p1
UI SSO - consider token info endpoint on generic SSO route for access control groups
2025-09-19 17:58:37 -07:00
Ishaan Jaffer
c3f150b13d mcp test fix 2025-09-19 17:41:15 -07:00
Krrish Dholakia
7694e9f6a9 test: refactoring + testing 2025-09-19 17:20:15 -07:00
Ishaan Jaff
90ee9e4587
[Feat] Dynamic Rate Limiter v3 - fixes to ensure priority routing works as expected (#14734)
* fix: dynamic limiter v3

* fix: dynamic limiter v3

* feat: add dynamic limiter v3

* feat: add dynamic limiter v3

* feat: add dynamic limiter v3 in init litellm_logging

* feat: add dynamic limiter v3 in init litellm_logging

* fix: priority rate limiting

* Potential fix for code scanning alert no. 3397: Clear-text logging of sensitive information

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

* fix: priority rate limiting

* fix: ruff

* fix: mypy lint

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-09-19 16:04:45 -07:00
Felipe Garé
a696ffe4a6
Litellm gemini batch (#14733)
* feat: add Vertex AI support for file content retrieval

- Extended `custom_llm_provider` to include "vertex_ai" in `afile_content` function.
- Implemented file content retrieval logic for Vertex AI in `VertexAIFilesHandler`.
- Added helper method to extract bucket and object from URL-encoded file_id.
- Created comprehensive unit and integration tests for Vertex AI file handling.
- Updated transformation logic to ensure compatibility with Vertex AI file responses.

* fix: update Vertex AI file transformation logic

- Modified the transformation logic in `VertexAIFilesConfig` to return a newline-separated JSON string for batch JSONL files instead of a array if JSON strings.

* fix: enhance Vertex AI output handling in transformation logic

- Updated the transformation logic in `VertexAIBatchTransformation` to utilize the new `OutputInfo` TypedDict for retrieving the GCS output directory.
- Added `OutputInfo` class to type definitions for better structure and clarity in Vertex AI responses.
2025-09-19 15:22:52 -07:00