scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-05 02:41:56 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 48

docs(otel/v2): correct stale _MAX_CACHED_PROVIDERS comment on eviction

Browse source 
The comment still described flushing and shutting down evicted providers; the
eviction now drops the reference without a synchronous shutdown. Greptile nit
on the current head.
This commit is contained in:
Yucheng Zhu 2026-07-27 12:30:06 -07:00
parent e1da5a7e6c
commit e05a7a3655
1 changed files with 3 additions and 3 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
litellm/integrations/otel/plumbing/routing.py
View file

@ -44,9 +44,9 @@ _NON_OTLP_KINDS = ("console", "in_memory", "inmemory", "memory")
# Cap on distinct destination-scoped providers held at once. Destinations are
# admin-owned (one per key/team), so this is resource hygiene rather than an
# anti-abuse bound: it keeps the working set of active tenants resident while
# flushing and shutting down evicted providers so their exporter threads are
# reclaimed.
# anti-abuse bound: it keeps the working set of active tenants resident. Evicted
# providers are dropped without a synchronous shutdown (see _evict_if_full); their
# exporter threads drain on their own and are reclaimed at process exit.
_MAX_CACHED_PROVIDERS = 256