scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-08-28 05:25:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 36
litellm/litellm/types
History
tin-berri 09b23742e7
feat(proxy): dry-run a real request body on /auto_router/test_routing (#38590) 
The endpoint built messages=[{"role": "user", "content": prompt}], so a dry run
could not carry prior turns, the caller's system prompt, or the tool definitions
a request advertises. A real agentic turn reduced to its last sentence classified
as trivial, which is why a config sweep reported savings for every configuration.

Accept messages, system and tools, and forward them to the same pre-routing hook
untranslated, with the raw-body snapshot built by the serving path's own owner,
refresh_proxy_server_request_body_snapshot. Loose types are deliberate: the hook
reads whatever dialect the surface produced, so validating against one surface's
schema would reject the others.

prompt stays as the single-ask shorthand, normalized into one user turn inside the
request model so the handler carries no mode branch.
2026-08-28 01:35:10 +00:00
..
containers Merge branch 'litellm_internal_staging' into litellm_remove_types_ruff_exclusion 2026-08-05 11:05:33 -07:00
google_genai Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_daily_any_cleanup_08_04_2026 2026-08-05 12:43:11 -07:00
images chore(lint): remove litellm/types from the ruff lint exclusion 2026-08-05 01:10:15 -07:00
integrations feat(newrelic): per-team cost and usage metrics via team callbacks (#37610) 2026-08-26 23:42:02 -07:00
interactions chore(lint): remove litellm/types from the ruff lint exclusion 2026-08-05 01:10:15 -07:00
litellm_core_utils fix(gemini): bill Google Maps grounding as its own SKU 2026-08-26 15:31:27 -07:00
llms Merge pull request #38465 from BerriAI/litellm_lit6103_tool_reference_passthrough 2026-08-27 15:23:51 -07:00
management_endpoints feat(proxy): dry-run a real request body on /auto_router/test_routing (#38590) 2026-08-28 01:35:10 +00:00
mcp_server feat(mcp): let a resolved OAuth token target a custom upstream header (#38456) 2026-08-27 14:32:01 -07:00
passthrough_endpoints Merge remote-tracking branch 'origin/litellm_internal_staging' into devin_ai_fix_gemini_stream_billing_36042 2026-08-26 16:44:11 -07:00
prompts chore(lint): remove litellm/types from the ruff lint exclusion 2026-08-05 01:10:15 -07:00
proxy fix(guardrails): add fail-open mode to CrowdStrike AIDR guardrail (#38568) 2026-08-27 17:57:35 -07:00
responses Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_daily_any_cleanup_08_04_2026 2026-08-05 12:43:11 -07:00
secret_managers chore(lint): remove litellm/types from the ruff lint exclusion 2026-08-05 01:10:15 -07:00
videos Merge branch 'litellm_internal_staging' into litellm_remove_types_ruff_exclusion 2026-08-05 11:05:33 -07:00
access_group.py chore(lint): remove litellm/types from the ruff lint exclusion 2026-08-05 01:10:15 -07:00
adapter.py fix(lint): bring basedpyright rule counts back under their budget limits 2026-08-05 10:23:02 -07:00
agents.py fix(a2a): accept the whole JSON-RPC id union the spec defines (#37704) 2026-08-20 14:41:22 -07:00
caching.py Merge pull request #34581 from BerriAI/litellm_anthropic_messages_response_cache 2026-08-14 17:34:08 -07:00
completion.py chore(typing): clear 1.6k basedpyright Any errors across 56 files 2026-08-11 06:47:39 -07:00
compression.py chore(lint): remove litellm/types from the ruff lint exclusion 2026-08-05 01:10:15 -07:00
embedding.py chore(lint): remove litellm/types from the ruff lint exclusion 2026-08-05 01:10:15 -07:00
files.py fix(types): resolve the four type-discipline additions surfaced by the staging merge 2026-08-05 11:05:53 -07:00
fine_tuning.py (feat) POST /fine_tuning/jobs support passing vertex specific hyper params (#7490) 2025-01-01 07:44:48 -08:00
guardrails.py fix(guardrails): add fail-open mode to CrowdStrike AIDR guardrail (#38568) 2026-08-27 17:57:35 -07:00
lar1.py chore: litellm oss staging (#31185) 2026-06-26 09:17:44 -07:00
mcp.py feat(mcp): let a resolved OAuth token target a custom upstream header (#38456) 2026-08-27 14:32:01 -07:00
memory_management.py chore(typing): remove 914 basedpyright Any errors across 16 hotspot files 2026-08-10 01:24:40 -07:00
object_permission.py chore(lint): remove litellm/types from the ruff lint exclusion 2026-08-05 01:10:15 -07:00
policy_engine.py chore(lint): remove litellm/types from the ruff lint exclusion 2026-08-05 01:10:15 -07:00
rag.py chore(lint): remove litellm/types from the ruff lint exclusion 2026-08-05 01:10:15 -07:00
realtime.py fix(gemini): bill transcribe-live sessions from streamed audio duration 2026-08-27 11:03:41 -07:00
rerank.py chore(lint): remove litellm/types from the ruff lint exclusion 2026-08-05 01:10:15 -07:00
router.py fix(router): authorize config-level fallback targets against the calling key 2026-08-27 14:08:51 -07:00
scheduler.py Squashed commit of the following: (#9709) 2025-04-02 21:24:54 -07:00
search.py chore(lint): remove litellm/types from the ruff lint exclusion 2026-08-05 01:10:15 -07:00
services.py chore(lint): remove litellm/types from the ruff lint exclusion 2026-08-05 01:10:15 -07:00
tag_management.py chore(lint): remove litellm/types from the ruff lint exclusion 2026-08-05 01:10:15 -07:00
tool_management.py chore(lint): remove litellm/types from the ruff lint exclusion 2026-08-05 01:10:15 -07:00
utils.py feat(model_prices): let a map entry declare its exact reasoning_effort levels (#38481) 2026-08-27 15:38:01 -07:00
vector_store_files.py chore(lint): remove litellm/types from the ruff lint exclusion 2026-08-05 01:10:15 -07:00
vector_stores.py feat(proxy): add GET /v1/indexes to list vector store indexes (#36289) 2026-08-10 15:09:59 -07:00