user 6194028f79 perf(proxy): cache container/skill ownership reads on the hot path ... Container ownership and skill rows are looked up on every retrieve / delete / list / file-content / chat-completion-with-skill call. The new stores wrapped raw Prisma queries with no cache, putting one DB round-trip on each request. Add an in-process TTL'd cache mirroring the _byok_cred_cache pattern in mcp_server/server.py: per-key (value, monotonic_timestamp), 60s TTL, 10000-entry cap with full-clear on overflow, invalidated by every write. Negative results (`None`) are cached too so untracked-resource checks also skip the DB. Tests cover: cache-after-first-hit, negative caching, write invalidation, no-caching-on-DB-error, TTL expiry, capacity eviction. 56 tests pass. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>		2026-05-02 03:26:58 +00:00
..
a2a_protocol	feat(guardrails): LLM-as-a-Judge guardrail (#26360)	2026-04-24 17:15:32 -07:00
anthropic_interface	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
assistants
batch_completion
batches	fix(batches): count non-chat tokens, validate batch-file model access (VERIA-39) (#27015)	2026-05-01 17:36:12 -07:00
caching	Merge pull request #26202 from BerriAI/litellm_token_verification_query_opt	2026-05-01 10:10:07 -07:00
completion_extras	Revert "Merge pull request #24417 from Chesars/refactor/shared-format-mapping"	2026-04-25 15:03:24 -03:00
compression	Prompt Compression - add it to the proxy (#25729)	2026-04-20 15:08:00 -07:00
containers	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
endpoints/speech/speech_to_completion_bridge
evals	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
experimental_mcp_client	refactor(mcp): reuse existing sessions for initialize instructions	2026-04-14 14:46:06 +03:00
files	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
fine_tuning	address greptile review feedback (greploop iteration 1)	2026-03-27 20:04:41 +05:30
google_genai	feat(proxy): LiteLLM headers on Google native generateContent routes (#25500)	2026-04-29 12:34:14 -07:00
images	Feat(dashscope): add image generation support for qwen-image-2.0 and qwen-image-2.0-pro (#25672)	2026-04-22 20:03:46 -07:00
integrations	Merge pull request #26825 from stuxf/fix/oauth2-proxy-header-forgery	2026-05-01 18:47:58 -07:00
interactions	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
litellm_core_utils	Merge pull request #27024 from BerriAI/litellm_yj_may1	2026-05-01 16:36:24 -07:00
llms	perf(proxy): cache container/skill ownership reads on the hot path	2026-05-02 03:26:58 +00:00
ocr	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
passthrough	fix(passthrough): log when streaming spend-tracking flush fails to schedule	2026-04-30 02:39:29 +00:00
proxy	perf(proxy): cache container/skill ownership reads on the hot path	2026-05-02 03:26:58 +00:00
proxy_auth
rag	style: black formatting	2026-04-25 14:47:54 -07:00
realtime_api
rerank_api	Fix review	2026-04-30 09:10:24 +05:30
responses	Fix lint and ruff	2026-05-01 12:14:53 +05:30
router_strategy	add test(tag-routing): prevent header regex bypass for strict plain tags.	2026-04-29 20:14:30 +00:00
router_utils	Fix add_model_file_id_mappings when router returns single deployment dict	2026-04-30 18:04:47 -07:00
search	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
secret_managers	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
skills	chore(proxy): scope skills and container resources	2026-04-30 18:23:58 -07:00
types	Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_clean_litellm_oss_staging_04_01_2026	2026-05-01 15:54:10 -07:00
vector_store_files
vector_stores	chore(vector stores): tighten managed store access	2026-04-30 15:04:25 -07:00
videos	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
__init__.py	refactor(crusoe): simplify to JSON-based provider registration	2026-05-01 17:27:52 +05:30
_internal_context.py	fix(proxy): harden request parameter handling	2026-04-16 01:38:12 +00:00
_lazy_imports.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
_lazy_imports_registry.py	refactor(crusoe): simplify to JSON-based provider registration	2026-05-01 17:27:52 +05:30
_logging.py	Unify secret redaction patterns	2026-05-01 17:24:21 +00:00
_redis.py	Litellm ishaan march23 - MCP Toolsets + GCP Caching fix (#25146) (#25155)	2026-04-04 16:23:21 -07:00
_redis_credential_provider.py	fix(redis): cache GCP IAM token to prevent async event loop blocking (#26441)	2026-04-25 23:13:39 -07:00
_service_logger.py
_uuid.py
_version.py
anthropic_beta_headers_config.json	Merge pull request #25867 from BerriAI/litellm_day_0_opus_4.7_support	2026-04-16 22:49:51 +05:30
anthropic_beta_headers_manager.py
blog_posts.json
budget_manager.py
constants.py	refactor(crusoe): simplify to JSON-based provider registration	2026-05-01 17:27:52 +05:30
cost.json
cost_calculator.py	Fix black	2026-05-01 17:33:50 +05:30
exceptions.py	fix(proxy): invoke post-call guardrails on pass-through endpoint responses (#20270) (#26262)	2026-04-27 08:58:22 +05:30
main.py	fix(embeddings): allow omitting encoding_format via env sentinel none	2026-05-01 23:03:13 +05:30
model_prices_and_context_window_backup.json	Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_clean_litellm_oss_staging_04_01_2026	2026-05-01 15:54:10 -07:00
mypy.ini
policy_templates_backup.json
provider_endpoints_support_backup.json	Feature/add audio support for scaleway (#26110)	2026-04-20 14:49:41 -07:00
py.typed
router.py	Merge pull request #26984 from BerriAI/litellm_internal_staging	2026-05-01 19:03:59 +05:30
scheduler.py
setup_wizard.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
timeout.py
utils.py	Add gpt-image-2 support (#26644) (#26705)	2026-04-28 20:10:42 -07:00