scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-07 08:26:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 36
litellm/litellm
History
Exact
Tin Chi Lo 84dd96b2e4 feat(auto-router): reasoning effort for the LLM classifier call 
classifier_llm_config gains reasoning_effort, sent on the classifier's own
acompletion and mirrored into the logged request body. Classification runs on
every request and is short, so a reasoning classifier model is usually worth
holding at a cheap level. Setting the effort on the deployment instead moves it
for every request that deployment serves, which is wrong whenever the classifier
model also serves normal traffic.

The level is filtered through the Router's existing target capability filter
before either consumer is built, so a level the classifier model refuses reaches
neither the provider call nor the spend-log request body. That filter is now
public as params_the_target_accepts, since the classifier path is a third caller
alongside the two tier-overlay sites, and it already owns the fail-open rules and
the guard against capability lookups that authenticate.

The dashboard carries the field through both payload builders, since each
rebuilds classifier_llm_config from named keys and would otherwise wipe a
value set in config.yaml on the next edit.
2026-09-02 19:36:32 -07:00
..
a2a_protocol feat(agentcore-a2a): derive runtime session id from A2A message.contextId (#39371) 2026-09-02 12:40:24 -07:00
anthropic_interface chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
assistants chore(lint): clear grandfathered over-limit lint drift and ratchet budgets down 2026-08-05 12:18:13 -07:00
batch_completion feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
batches refactor(batches): make count_error_file_failed_requests public for the poller import 2026-08-29 14:09:18 -07:00
caching refactor(types): replace Any with precise types across 73 modules 2026-09-01 11:05:02 +00:00
completion_extras refactor(types): replace Any with precise types across 73 modules 2026-09-01 11:05:02 +00:00
compression chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
containers fix(proxy): route container create and list through model_list deployments 2026-09-01 23:26:23 +00:00
endpoints/speech/speech_to_completion_bridge refactor(speech): freeze httpx response header dicts (LIT002) 2026-08-31 21:12:53 -07:00
evals chore(typing): remove 914 basedpyright Any errors across 16 hotspot files 2026-08-10 01:24:40 -07:00
experimental_mcp_client fix(mcp): follow tools/list pagination from upstream servers (#39172) 2026-09-01 14:34:14 -07:00
files fix(batches): accept litellm_proxy in files and batches provider type literals 2026-08-18 13:28:06 -07:00
fine_tuning Merge branch 'litellm_internal_staging' into litellm_remove_types_ruff_exclusion 2026-08-05 11:05:33 -07:00
google_genai refactor(types): replace Any with precise types across 73 modules 2026-09-01 11:05:02 +00:00
images Merge pull request #39104 from BerriAI/litellm_decrease_anys_opus5_r3 2026-09-01 12:26:52 -07:00
integrations Merge pull request #38936 from BerriAI/litellm_fix_vector_store_request_embedding_resolution 2026-09-02 17:22:56 -07:00
interactions feat(vertex_ai): add native Vertex AI Interactions API support 2026-08-25 09:55:13 -07:00
litellm_core_utils fix(proxy): stop leaking internal exception details to clients (#39380) 2026-09-02 17:32:00 -07:00
llms fix(http_handler): honor HTTP(S)_PROXY / NO_PROXY when force_ipv4 uses the httpx transport (#39443) 2026-09-02 17:30:46 -07:00
models feat(scim): add placeholder listing and merge so a shadowed account can be healed (#39231) 2026-09-02 01:04:53 +00:00
ocr Merge pull request #39334 from BerriAI/litellm_rust_opt_in_configuration 2026-09-02 16:26:36 -07:00
passthrough Merge origin/litellm_internal_staging into litellm_techdebt_20260901 2026-09-01 19:38:19 +00:00
proxy fix(proxy): stop leaking internal exception details to clients (#39380) 2026-09-02 17:32:00 -07:00
proxy_auth feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
rag fix(rag): store-wins merge, single lookup, allowlisted search params 2026-09-01 12:52:45 -07:00
realtime_api fix(health): probe Azure GA realtime path for transcription-only models 2026-08-26 12:14:52 -07:00
repositories feat(scim): add placeholder listing and merge so a shadowed account can be healed (#39231) 2026-09-02 01:04:53 +00:00
rerank_api fix(rerank): adopt declared authenticating providers in arerank instead of resolving them 2026-09-01 14:47:59 -07:00
responses Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_responses_guardrail_namespace_tools 2026-09-02 16:29:34 -07:00
router_strategy feat(auto-router): reasoning effort for the LLM classifier call 2026-09-02 19:36:32 -07:00
router_utils fix(router): preserve bound router fallbacks for subagents 2026-09-02 16:01:15 -07:00
rust_bridge Merge pull request #39334 from BerriAI/litellm_rust_opt_in_configuration 2026-09-02 16:26:36 -07:00
sandbox feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
search fix(search): forward search-tool params through the router, complete Parallel AI v1 param mapping (#37883) 2026-09-01 21:46:46 -07:00
secret_managers refactor(types): replace Any with precise types across 73 modules 2026-09-01 11:05:02 +00:00
skills chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
types feat(router): add a hybrid classifier that defers near tier boundaries (#39403) 2026-09-02 23:51:43 +00:00
vector_store_files chore(lint): clear grandfathered over-limit lint drift and ratchet budgets down 2026-08-05 12:18:13 -07:00
vector_stores fix(vector-store): carry request metadata into the Router executor built from the router kwarg 2026-09-02 16:53:05 -07:00
videos refactor(videos): make video upload param keyword-only on public edit fns 2026-08-24 15:55:07 -07:00
__init__.py Merge pull request #39334 from BerriAI/litellm_rust_opt_in_configuration 2026-09-02 16:26:36 -07:00
_internal_context.py feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
_lazy_imports.py Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5 2026-08-29 06:37:10 -07:00
_lazy_imports_registry.py feat(dashscope): add qwencloud and qwen_ai_platform provider aliases 2026-09-01 11:20:36 -07:00
_logging.py fix(proxy): stop leaking internal exception details to clients (#39380) 2026-09-02 17:32:00 -07:00
_redis.py fix(redis): coerce env var string types and fix param discovery through decorator wrappers (#30644) 2026-08-31 20:51:31 -07:00
_redis_credential_provider.py chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
_service_logger.py chore(lint): clear grandfathered over-limit lint drift and ratchet budgets down 2026-08-05 12:18:13 -07:00
_uuid.py chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
_version.py
anthropic_beta_headers_config.json
anthropic_beta_headers_manager.py feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
blog_posts.json
budget_manager.py feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
constants.py feat(mcp): semantic tool search for the native MCP Gateway (#39404) 2026-09-02 15:09:44 -07:00
cost.json
cost_calculator.py Merge pull request #39149 from BerriAI/litellm_qwencloud_provider_aliases 2026-09-01 12:18:05 -07:00
exceptions.py feat(proxy): redact or drop individual batch records instead of rejecting the file (#37561) 2026-08-20 13:12:55 -07:00
main.py refactor(utils): remove the dead get_api_key provider-key resolver (#39260) 2026-09-02 15:06:36 -07:00
model_prices_and_context_window_backup.json feat(model_prices): add meta/muse-spark-1.3 and its contributor tier 2026-09-02 22:05:17 +00:00
policy_templates_backup.json
provider_endpoints_support_backup.json feat(dashscope): add qwencloud and qwen_ai_platform provider aliases 2026-09-01 11:20:36 -07:00
py.typed
router.py feat(auto-router): reasoning effort for the LLM classifier call 2026-09-02 19:36:32 -07:00
scheduler.py feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
setup_wizard.py feat(models): add Claude Fable 5.1 across Anthropic, Bedrock, Vertex AI, and Azure AI 2026-09-01 18:07:06 +00:00
timeout.py feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
utils.py refactor(utils): remove the dead get_api_key provider-key resolver (#39260) 2026-09-02 15:06:36 -07:00