scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-23 00:41:40 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 81
litellm/litellm
History
Yujong Lee b204dec9f9 feat(python-bridge): run deployment hooks through the native cursor 
async_pre_call_deployment_hook, async_post_call_success_deployment_hook and
async_post_call_failure_deployment_hook run on every SDK call, not only on
the proxy, and the native OCR path still delegated them to the Python chain
in litellm.utils. DeploymentBody now iterates litellm.callbacks through
CallbackFamily::Deployment* with Delivery::Await, chaining the replaced
kwargs or response through each CustomLogger and containing failure-hook
errors per target while pre and post hook errors propagate.

Runner::invoke returns an error when an awaited leaf yields a non-awaitable
instead of guessing from is_none. The legacy-disabled test registers a
deployment hook and forbids the three utils entry points.
2026-09-16 17:50:11 +00:00
..
a2a_protocol Merge pull request #40262 from BerriAI/litellm_lit_7190_inline_token_counts 2026-09-15 13:38:00 -07:00
anthropic_interface fix(anthropic_endpoints): return Anthropic type:error envelope for /v1/messages errors 2026-08-31 16:23:36 -07:00
assistants refactor(typing): replace Any with proven types in 89 more backend files 2026-09-02 23:08:42 +00:00
batch_completion
batches refactor(vertex): move batch usage modality parsing under llms 2026-09-15 02:03:32 +00:00
caching Merge pull request #41171 from BerriAI/litellm_converted_stream_spend_tracking 2026-09-15 15:34:13 -07:00
completion_extras fix(router): classify encrypted delegated tasks with native Responses 2026-09-10 12:32:09 -07:00
compression merge: main into litellm_headroom_protect_cached_prefix 2026-09-15 04:12:28 +00:00
containers Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5_r4 2026-09-02 23:32:10 +00:00
endpoints/speech/speech_to_completion_bridge refactor(speech): freeze httpx response header dicts (LIT002) 2026-08-31 21:12:53 -07:00
evals
experimental_mcp_client fix(mcp): bind discovery caching to credentials and active callers 2026-09-11 14:49:00 -07:00
files merge: bring litellm_internal_staging into the Bedrock files delete and list fix 2026-09-09 19:27:40 -07:00
fine_tuning refactor(typing): replace Any with proven types in 89 more backend files 2026-09-02 23:08:42 +00:00
google_genai refactor(types): replace Any with precise types across 73 modules 2026-09-01 11:05:02 +00:00
images refactor(typing): replace Any with proven types in 89 more backend files 2026-09-02 23:08:42 +00:00
integrations Merge pull request #41288 from BerriAI/litellm_langsmith_preserve_events_during_flush 2026-09-15 15:06:36 -07:00
interactions refactor(typing): replace Any with proven types in 42 more backend files 2026-09-02 15:35:01 +00:00
litellm_core_utils refactor(python-bridge): drop OCR callback fast path and body re-aliasing 2026-09-16 17:50:11 +00:00
llms Merge pull request #41268 from BerriAI/litellm_outbound_http2_opt_in 2026-09-16 10:05:37 -07:00
models Merge pull request #40997 from BerriAI/litellm_batch_tpd_limit 2026-09-15 13:39:45 -07:00
ocr style(rust_bridge): satisfy strict lint gates in the callback leaves 2026-09-16 17:50:11 +00:00
passthrough fix(passthrough): parse Bedrock stream spend incrementally instead of buffering the whole response (#40724) 2026-09-11 09:53:37 -07:00
proxy refactor callback 2026-09-16 17:50:11 +00:00
proxy_auth
rag chore: merge origin/litellm_internal_staging into litellm_decrease_anys_opus5_r4 2026-09-04 18:59:35 -07:00
realtime_api fix(realtime): send openai and xai health check keys as bearer tokens 2026-09-15 02:20:09 -07:00
repositories fix(proxy): always decrement on spend reset and reseed counters from the DB 2026-09-15 19:52:37 +00:00
rerank_api fix(rerank): adopt declared authenticating providers in arerank instead of resolving them 2026-09-01 14:47:59 -07:00
responses refactor(responses): copy the terminal event instead of mutating stubbed chunks 2026-09-16 03:54:04 +00:00
router_strategy fix(router): accept fenced Fuse classifier verdicts 2026-09-15 13:11:56 -07:00
router_utils feat(router): apply entitlement limits to forecast classifiers 2026-09-15 16:17:00 -07:00
rust_bridge feat(python-bridge): run deployment hooks through the native cursor 2026-09-16 17:50:11 +00:00
sandbox
search fix(search): forward search-tool params through the router, complete Parallel AI v1 param mapping (#37883) 2026-09-01 21:46:46 -07:00
secret_managers feat(secret_managers): support customer-managed KMS key for virtual keys stored in AWS Secrets Manager (#40475) 2026-09-11 09:54:08 -07:00
skills feat(skills): semantic search over the LiteLLM-hosted skill registry (#39401) 2026-09-07 12:28:38 -07:00
types Merge pull request #41336 from BerriAI/litellm_fix_anthropic_stream_absent_usage 2026-09-15 20:23:01 -07:00
vector_store_files refactor(typing): replace Any with proven types in 42 more backend files 2026-09-02 15:35:01 +00:00
vector_stores Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_python_version_ci 2026-09-03 00:16:19 -07:00
videos
__init__.py Merge pull request #41268 from BerriAI/litellm_outbound_http2_opt_in 2026-09-16 10:05:37 -07:00
_internal_context.py fix(proxy): price one cost estimate at one moment 2026-09-07 18:38:12 -07:00
_lazy_imports.py fix(lazy_imports): type import_map as Mapping to stay under the LIT001 budget 2026-09-05 16:12:45 -07:00
_lazy_imports_registry.py Revert "perf: lazy-load SDK symbols so import litellm stays under 60 MB RSS (…" 2026-09-05 16:07:09 -07:00
_logging.py fix(proxy): resolve LITELLM_LOG for uvicorn at startup and restore logger state in tests 2026-09-15 22:27:24 +00:00
_redis.py fix(redis): accept every truthy flag and sign serverless ElastiCache caches 2026-09-10 10:13:03 -04:00
_redis_credential_provider.py fix(redis): accept every truthy flag and sign serverless ElastiCache caches 2026-09-10 10:13:03 -04:00
_service_logger.py chore: merge origin/litellm_internal_staging into litellm_decrease_anys_opus5_r4 2026-09-04 18:59:35 -07:00
_uuid.py
_version.py
anthropic_beta_headers_config.json fix(anthropic): add the per-turn-control beta when a message carries output_config 2026-09-14 22:01:47 -07:00
anthropic_beta_headers_manager.py
blog_posts.json
budget_manager.py
constants.py perf(content_filter): scan a bounded window per streamed chunk 2026-09-16 09:59:53 +00:00
cost.json
cost_calculator.py Merge pull request #41318 from BerriAI/litellm_ws_responses_service_tier_pricing 2026-09-15 17:23:35 -07:00
exceptions.py fix(sdk): carry a litellm_proxy error's headers on e.response, not e.headers 2026-09-14 22:22:26 -07:00
main.py Merge pull request #41268 from BerriAI/litellm_outbound_http2_opt_in 2026-09-16 10:05:37 -07:00
model_prices_and_context_window_backup.json fix(prices): add tpm and rpm to gemini 3.8 live rows 2026-09-16 16:49:17 +00:00
policy_templates_backup.json
provider_endpoints_support_backup.json fix(ocr): send each provider a health-check document it accepts 2026-09-04 22:52:12 -07:00
py.typed
router.py fix(router): snapshot shadow kwargs per target so concurrent shadows never share metadata 2026-09-16 04:31:43 +00:00
scheduler.py
setup_wizard.py feat(models): add Claude Fable 5.1 across Anthropic, Bedrock, Vertex AI, and Azure AI 2026-09-01 18:07:06 +00:00
timeout.py
utils.py Merge pull request #41316 from BerriAI/litellm_nvidia_nim_infer_passthrough 2026-09-15 17:28:25 -07:00