mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-05 08:07:05 +00:00
d7985f36d7
* Correctly delete team model alias when team only model is deleted (#10933) * fix(model_management_endpoints.py): if team model deleted - remove the alias routing Fixes issue where alias would cause incorrect routing to occur * fix(model_management_endpoints.py): remove model name from team on team model delete prevents misrouting * fix(vertex_llm_base.py): remove quota_project_id parameter from credential refresh request (#10915) Fixes https://github.com/BerriAI/litellm/issues/9863 * Enable structured JSON schema outputs in LM Studio (for validated responses) (#10929) - docs/my-website/docs/providers/lm_studio.md: add Structured Output section with JSON schema and Pydantic examples - litellm/llms/lm_studio/chat/transformation.py: extend map_openai_params to handle `response_format` mappings (`json_schema`, `json_object`) and move them to optional_params - litellm/utils.py: include `LM_STUDIO` in `supports_response_schema` list - tests/litellm/llms/lm_studio/test_lm_studio_chat_transformation.py: add tests for Pydantic model and dict-based JSON schema handling Co-authored-by: Earl St Sauver <estasuver@gmail.com> * update sambanova models and parameters (#10900) * add sambanova to completion input params table * update sambanova supported args * update sambanova supported models * minor changes * fix sambanova model list * update sambanova models * update sambanova models * update sambanova docs * minor chnage sambanova url * update type to match OpenAIGPTConfig * minor change * fix cohere rerank provider (#10822) * add skip server startup flag to cli (#10665) * add flag * fix ruff linting * add unit test * fix ruff errors * fix lintings issues * fix linting errors * add global noqa for print * Allow passed in vertex_ai credentials to be authorized_user type (#10899) * fix: handle DB_USER, DB_PASSWORD, DB_HOST problem I faced, since this… (#10842) * fix: handle DB_USER, DB_PASSWORD, DB_HOST problem I faced, since this could be with special character, so better be url encoded, similar problem also happen in DATABASE_URL * test: added the test cases * add: test case of url with sepcial character * add keys and members (#10950) * Update github.md (#10946) Updated clarification in the use of the models form github. (Github uses the model name: <company>/<model-Name> while litellm wants github/<model-Name> Updated the example to a model that is actually supported / available on github right now * Add new documentation files for LiteLLM (#10961) - Created `llms-full.txt` with comprehensive details on LiteLLM features, usage, and supported models. - Added `llms.txt` for quick access to key links and resources related to LiteLLM, including guides, release notes, and integration documentation. * [Fix] Invitation Email does not include the invitation link (#10958) * fix: email invites should link to the invitation * fix: email invites should link to the invitation * fix: email invites should link to the invitation * bump: litellm proxy extras * refactor(vertex_llm_base.py): remove check on credential project id - allow for cross credential calling * test: update test due to cohere ssl issues * fix: fix model param mapping * fix: update test to reflect change * Enable key reassignment on UI + Show 'updated at' column for key in all keys table (#10960) * feat(key_edit_view.tsx): initial commit enabling reassigning keys to teams * style(key_edit_view.tsx): cleaner implementation with teams in dropdown * fix(all_keys_table.tsx): set max width to keys column * feat(all_keys_table.tsx): show last updated at column for key * test: update tests * Litellm dev 05 19 2025 p3 (#10965) * feat(model_info_view.tsx): enable updating model info for existing models on UI Fixes LIT-154 * fix(model_info_view.tsx): instantly show model info updates on UI * feat(proxy_server.py): enable flag on `/models` to include model access groups This enables admin to assign model access groups to keys/teams on UI * feat(ui/): add model access groups on ui dropdown when creating teams + keys * refactor(parallel_request_limiter_v2.py): Migrate multi instance rate limiting to OSS Closes https://github.com/BerriAI/litellm/issues/10052 * Validate migrating keys to teams + Fix mistral image url on async translation (#10966) * feat(key_management_endpoints.py): add validation checks for migrating key to team Ensures requests with migrated key can actually succeed Prevent migrated keys from failing in prod due to team missing required permissions * fix(mistral/): fix image url handling for mistral on async call * fix(key_management_endpoints.py): improve check for running team validation on key update * bump: version 1.70.1 → 1.70.2 * test: update test * build(ui/): new ui build * add cla to docs (#10963) * add cla to docs * cla docs clarity * build: ui/ new build * [Fix] List Guardrails - Show config.yaml guardrails on litellm ui (#10959) * fix: listing guardrails defined on litellm config * fix: list guardrails on litellm config * fix: list guardrails on litellm config * test: list guardrails on litellm config * fix: linting * Update litellm/proxy/guardrails/guardrail_endpoints.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * fix: GuardrailInfoLiteLLMParamsResponse --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * fix: vertex show clear exception on failed refresh (#10969) * fix: vertex show clear exception on failed refresh * fix: show clear debug log * docs: cleanup * test: update tests * test: skip test - model EOL * [Feature] Add supports_computer_use to the model list (#10881) * Add support for supports_computer_use in model info * Corrected list of supports_computer_use models * Further fix computer use compatible claude models, fix existing test that predated supports_computer_use in the model list * Move computer use test case into existing test_utils file * Moved tests in to test_utils.py * [Feat] - Add Support for Showing Passthrough endpoint Error Logs on LiteLLM UI (#10990) * fix: add error logging for passthrough endpoints * feat: add error logging for passthrough endpoints * fix: post_call_failure_hook track errors on pt * fix: use constant for MAXIMUM_TRACEBACK_LINES_TO_LOG * docs MAXIMUM_TRACEBACK_LINES_TO_LOG * test: ensure failure callback triggered * fix: move _init_kwargs_for_pass_through_endpoint * added support to credential delete to support slashes in the curl (#10987) * added support to credential delete to support slashes in the curl * add support for get and update too * Add new gemini preview models + Fix cohere v2 embedding 'embedding_types' param mapping (#10991) * build(model_prices_and_context_window.json): add new gemini preview models Fixes https://github.com/BerriAI/litellm/issues/10985 * fix(cohere/embed): Fix encoding format <-> embedding types param mapping Fixes https://github.com/BerriAI/litellm/issues/10939 * fix(aim.py): fix syntax error * Litellm add new gemini models (#10998) * build(model_prices_and_context_window.json): add new gemini image gen model * build(model_prices_and_context_window.json): add more gemini models * [Feat] Prometheus - Track `route` on proxy_* metrics (#10992) * fix: trace route on prometheus metrics * fix: show route on prometheus metrics for total fails * test: trace route on metrics * fix: tests for route in prom metrics * test: fix test metrics * test: fix test_proxy_failure_metrics * fix: default role for JWT authentication (#10995) * fix: get_user_object * test: test_default_internal_user_params_with_get_user_object * Update litellm/proxy/auth/auth_checks.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * fix(internal_user_endpoints.py): allow resetting spend/max budget on … (#10993) * fix(internal_user_endpoints.py): allow resetting spend/max budget on user update Fixes https://github.com/BerriAI/litellm/issues/10495 * fix(internal_user_endpoints.py): correctly return set spend for user on /user/new * fix(auth_checks.py): check redis for key object before checking in-memory allows for quicker updates * feat(internal_user_endpoints.py): update cache object when user is updated + check redis on user values being updated * fix(auth_checks.py): use redis cache when user updated * fix: set default value of 'expires' to None * bump: version 1.70.2 → 1.70.3 * Improve response_id propagation logic and add tests for valid/empty ID handling in streaming. (#11006) * support vertex_ai global endpoints for chat (#10658) * fix(internal_user_endpoints.py): fix check * Ollama wildcard support (#10982) * Add Ollama wildcard support * Add Ollama-chatas well. * Fix missing methods. * Improve logs a bit. * Add tests * Add tests * spend rounded to 4 (#11013) * fix: fix linting error * fix(streaming_handler.py): fix check when response id already set * put organization and team buttons at the top (#10948) * feat: add xai/grok-3 pricing (#11028) * [Feat] Add Image Edits Support to LiteLLM (#11020) * refactor: use 1 file for image methods * refactor: use 1 file for image methods * feat: add stubs for image edits * fix: types for image edits * feat: add async image edits * feat: add base config for image edits * feat: add basic structure for image edits * feat: add ImageEditRequestUtils * feat: complete instrumentation of image edits * tes: test_openai_image_edit_litellm_sdk * tets: test_openai_image_edit_litellm_sdk * feat: get_provider_image_edit_config * feat: add OpenAIImageEditConfig * feat: working image edits * fixes: working image edits * fix: code qa * fix: using image edits * fix: linting errors * Updating the available VoyageAI models in the docs (#11003) * Refresh VoyageAI models and prices and context * Refresh VoyageAI models and prices and context * Refresh VoyageAI models and prices and context * Updating the available VoyageAI models in the docs * Updating the available VoyageAI models in the docs * fix(ui): call tool when no arguments needed (#11012) Co-authored-by: wagnerjt <wagnerjt@github.com> * Verbose error on admin add (#10978) * Spend rounded to 4 for Organizations and Users page (#11023) * spend rounded to 4 * fixed for organization and users table * Fix: Handle dict objects in Anthropic streaming response (#11032) * fix: handle dict objects in Anthropic streaming response Fix issue where dictionary objects in Anthropic streaming responses were not properly converted to SSE format strings before being yielded, causing AttributeError: 'dict' object has no attribute 'encode' * fix: refactor Anthropic streaming response handling - Added STREAM_SSE_DATA_PREFIX constant in constants.py - Created return_anthropic_chunk helper function for better maintainability - Using safe_dumps from safe_json_dumps.py for improved JSON serialization - Added unit test for dictionary object handling in streaming response * fix: correct patch path in anthropic_endpoints test * feat: add Databricks Llama 4 Maverick model cost (#11008) Co-authored-by: Tommy PLANEL <tommy.planel2@ubisoft.com> * test: mark flaky test * Litellm dev 05 21 2025 p2 (#11039) * feat: initial commit adding managed file support to fine tuning endpoints * feat(fine_tuning/endpoints.py): working call to openai finetuning route Uses litellm managed files for finetuning api support * feat(fine-tuning/main.py): refactor to use LiteLLMFineTuningJob pydantic object includes 'hidden_params' * fix: initial commit adding unified finetuning id support return a unified finetuning id we can use to understand which deployment to route the ft request to * test: fix test * feat(managed_files.py): return unified finetuning job id on create finetuning job enables retrieve, delete to work with litellm managed files * test: update test * fix: fix linting error * fix: fix ruff linting error * test: fix check * Fixes the InvitationLink Prisma find_many query (#11031) Related: |
||
|---|---|---|
| .. | ||
| basic_proxy_startup_tests | ||
| batches_tests | ||
| code_coverage_tests | ||
| documentation_tests | ||
| enterprise | ||
| guardrails_tests | ||
| image_gen_tests | ||
| litellm | ||
| litellm-proxy-extras | ||
| litellm_utils_tests | ||
| llm_responses_api_testing | ||
| llm_translation | ||
| load_tests | ||
| local_testing | ||
| logging_callback_tests | ||
| mcp_tests | ||
| multi_instance_e2e_tests | ||
| old_proxy_tests/tests | ||
| openai_endpoints_tests | ||
| otel_tests | ||
| pass_through_tests | ||
| pass_through_unit_tests | ||
| proxy_admin_ui_tests | ||
| proxy_security_tests | ||
| proxy_unit_tests | ||
| router_unit_tests | ||
| scim_tests | ||
| spend_tracking_tests | ||
| store_model_in_db_tests | ||
| windows_tests | ||
| gettysburg.wav | ||
| large_text.py | ||
| openai_batch_completions.jsonl | ||
| README.MD | ||
| test_callbacks_on_proxy.py | ||
| test_config.py | ||
| test_debug_warning.py | ||
| test_end_users.py | ||
| test_entrypoint.py | ||
| test_fallbacks.py | ||
| test_health.py | ||
| test_keys.py | ||
| test_logging.conf | ||
| test_models.py | ||
| test_openai_endpoints.py | ||
| test_organizations.py | ||
| test_passthrough_endpoints.py | ||
| test_ratelimit.py | ||
| test_spend_logs.py | ||
| test_team.py | ||
| test_team_logging.py | ||
| test_team_members.py | ||
| test_users.py | ||
In total litellm runs 1000+ tests
[02/20/2025] Update:
To make it easier to contribute and map what behavior is tested,
we've started mapping the litellm directory in tests/litellm
This folder can only run mock tests.