scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-16 23:41:43 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 103
litellm/litellm
History
yucheng-berriai 6a94613ccf refactor(otel/v2): route gen-AI spans from the server-only ContextVar, remove the request-data carrier (Y6) 
The gen-AI LLM-call span previously took its per-tenant destinations from
data['litellm_metadata']['otel_destinations'] -> standard_callback_dynamic_params,
a request-data carrier. Remove that carrier entirely: the proxy no longer writes
destinations into request data, initialize_dynamic_callback_params no longer reads
them, and LLMCallEvent reads them from the same server-only request_destinations()
ContextVar the proxy-internal fan-out already uses. Destinations now never travel
through request or provider-facing data on any path.

Validated that the ContextVar survives the streaming close: the proxy closes the
gen-AI span via asyncio.create_task (streaming_handler __anext__) and awaits the
async logger in dispatch_success_handlers, both of which copy the request task's
context; only a fresh-thread asyncio.run (sync-SDK __next__) loses it, and admin
destinations never exist in SDK mode. Regression tests anchor destinations on the
ContextVar; the dynamic-params reader is asserted to never surface them.
2026-07-02 01:23:17 -07:00
..
a2a_protocol feat(a2a): support a2a-sdk 1.x proxy routing for 0.3 and 1.0 agents (#30950) 2026-06-29 09:32:39 +05:30
anthropic_interface style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
assistants style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
batch_completion style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
batches style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
caching style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
completion_extras style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
compression style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
containers style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
endpoints/speech/speech_to_completion_bridge style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
evals style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
experimental_mcp_client style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
files style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
fine_tuning style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
google_genai style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
images style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
integrations refactor(otel/v2): route gen-AI spans from the server-only ContextVar, remove the request-data carrier (Y6) 2026-07-02 01:23:17 -07:00
interactions style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
litellm_core_utils refactor(otel/v2): route gen-AI spans from the server-only ContextVar, remove the request-data carrier (Y6) 2026-07-02 01:23:17 -07:00
llms feat: declarative fallback generalizations for unknown models (#29718) 2026-06-27 21:01:19 -07:00
models feat(otel/v2): store logging-exporter assignments in typed columns, not metadata 2026-07-02 00:12:16 -07:00
ocr style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
passthrough style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
proxy refactor(otel/v2): route gen-AI spans from the server-only ContextVar, remove the request-data carrier (Y6) 2026-07-02 01:23:17 -07:00
proxy_auth style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
rag style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
realtime_api style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
repositories style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
rerank_api style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
responses style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
router_strategy style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
router_utils style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
rust_bridge feat(ocr): thin Rust OCR Python bridge (#31368) 2026-06-25 18:42:59 -07:00
sandbox style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
search style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
secret_managers style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
skills style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
types feat(otel/v2): admin-owned, identity-scoped trace destinations (LIT-3850) 2026-06-29 11:11:14 -07:00
vector_store_files style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
vector_stores style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
videos style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
__init__.py feat(otel/v2): admin-owned, identity-scoped trace destinations (LIT-3850) 2026-06-29 11:11:14 -07:00
_internal_context.py fix(proxy): harden request parameter handling 2026-04-16 01:38:12 +00:00
_lazy_imports.py style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
_lazy_imports_registry.py chore: litellm oss staging (#30968) 2026-06-23 07:31:44 -07:00
_logging.py style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
_redis.py style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
_redis_credential_provider.py style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
_service_logger.py style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
_uuid.py build(deps-dev): bump black to 26.3.1 and apply formatting (#28525) 2026-05-21 17:24:18 -07:00
_version.py
anthropic_beta_headers_config.json chore(oss): litellm oss staging 120626 (#30292) 2026-06-12 09:49:25 -07:00
anthropic_beta_headers_manager.py style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
blog_posts.json docs(blog): add WebRTC blog post link 2026-03-13 17:54:33 +05:30
budget_manager.py style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
constants.py feat(otel/v2): admin-owned, identity-scoped trace destinations (LIT-3850) 2026-06-29 11:11:14 -07:00
cost.json
cost_calculator.py style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
exceptions.py style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
main.py style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
model_prices_and_context_window_backup.json feat: declarative fallback generalizations for unknown models (#29718) 2026-06-27 21:01:19 -07:00
policy_templates_backup.json feat(add-new-block_code_execution-guardrail): prevent agent from executing code (#22154) 2026-02-25 22:02:14 -08:00
provider_endpoints_support_backup.json chore: litellm oss staging (#30968) 2026-06-23 07:31:44 -07:00
py.typed
router.py fix(router): persist global retry_policy via /config/update (#29540) 2026-06-28 00:20:20 +00:00
scheduler.py style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
setup_wizard.py style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
timeout.py style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
utils.py feat: declarative fallback generalizations for unknown models (#29718) 2026-06-27 21:01:19 -07:00