scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-15 04:19:08 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 121
litellm/litellm
History
Yassin Kortam aa49568059
perf(caching): memoize _get_all_llm_api_params, rebuilt per request (#31430) 
ModelParamHelper._get_all_llm_api_params() introspects six sets of supported
kwargs from static OpenAI type annotations and fixed sets and unions them. The
result is constant for the process lifetime, but it was recomputed on every
request through both Cache.get_cache_key (caching path) and
_get_relevant_args_to_use_for_logging -> get_standard_logging_model_parameters
(spend-logging / callback path). Memoize it with lru_cache(maxsize=1); the
function takes no arguments, its result is process-static, and both callers
treat it as read-only. ~4.7 us/call to ~0.02 us/call.
2026-06-26 16:46:18 +00:00
..
a2a_protocol chore(lint): remove PLR0915 too-many-statements ruff rule (#30574) 2026-06-16 16:52:49 -07:00
anthropic_interface feat(context_management): compact_20260112 polyfill for non-Anthropic providers (#28868) 2026-05-30 09:20:05 -07:00
assistants chore: migrate Python formatter from black to ruff format (#31317) 2026-06-25 11:27:43 -07:00
batch_completion fix: prompt registry 2026-02-18 00:34:54 +05:30
batches chore: migrate Python formatter from black to ruff format (#31317) 2026-06-25 11:27:43 -07:00
caching chore: litellm oss staging 250626 (#31305) 2026-06-25 21:00:28 -07:00
completion_extras chore: migrate Python formatter from black to ruff format (#31317) 2026-06-25 11:27:43 -07:00
compression build(deps-dev): bump black to 26.3.1 and apply formatting (#28525) 2026-05-21 17:24:18 -07:00
containers style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
endpoints/speech/speech_to_completion_bridge
evals style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
experimental_mcp_client feat(mcp): graft v2 resolver onto _create_mcp_client (none + api_key static family) (#31058) 2026-06-24 14:53:33 -07:00
files chore: migrate Python formatter from black to ruff format (#31317) 2026-06-25 11:27:43 -07:00
fine_tuning chore: migrate Python formatter from black to ruff format (#31317) 2026-06-25 11:27:43 -07:00
google_genai chore: litellm oss staging 250626 (#31305) 2026-06-25 21:00:28 -07:00
images chore: migrate Python formatter from black to ruff format (#31317) 2026-06-25 11:27:43 -07:00
integrations chore: litellm oss staging (#31185) 2026-06-26 09:17:44 -07:00
interactions chore: litellm oss staging (#30968) 2026-06-23 07:31:44 -07:00
litellm_core_utils perf(caching): memoize _get_all_llm_api_params, rebuilt per request (#31430) 2026-06-26 16:46:18 +00:00
llms test: add realtime proxy e2e suite across providers (#30960) 2026-06-26 09:36:49 -07:00
models feat(litellm): add models and repository layers (#29686) 2026-06-06 20:59:33 -07:00
ocr feat(ocr): thin Rust OCR Python bridge (#31368) 2026-06-25 18:42:59 -07:00
passthrough chore: migrate Python formatter from black to ruff format (#31317) 2026-06-25 11:27:43 -07:00
proxy chore: litellm oss staging (#31185) 2026-06-26 09:17:44 -07:00
proxy_auth fix: prompt registry 2026-02-18 00:34:54 +05:30
rag chore: migrate Python formatter from black to ruff format (#31317) 2026-06-25 11:27:43 -07:00
realtime_api chore(lint): remove PLR0915 too-many-statements ruff rule (#30574) 2026-06-16 16:52:49 -07:00
repositories feat(litellm): add models and repository layers (#29686) 2026-06-06 20:59:33 -07:00
rerank_api chore: litellm oss staging (#31185) 2026-06-26 09:17:44 -07:00
responses chore: litellm oss staging 250626 (#31305) 2026-06-25 21:00:28 -07:00
router_strategy chore: litellm oss staging (#31185) 2026-06-26 09:17:44 -07:00
router_utils chore: litellm oss staging (#31185) 2026-06-26 09:17:44 -07:00
rust_bridge feat(ocr): thin Rust OCR Python bridge (#31368) 2026-06-25 18:42:59 -07:00
sandbox chore: migrate Python formatter from black to ruff format (#31317) 2026-06-25 11:27:43 -07:00
search Litellm oss staging 050626 (#29774) 2026-06-05 13:51:51 -07:00
secret_managers ci: drop mypy entirely, standardize type checking on basedpyright (#30648) 2026-06-17 09:42:00 -07:00
skills chore(proxy): scope skills and container resources 2026-04-30 18:23:58 -07:00
types fix(cost): restore per-query Gemini 3.x web search billing (#31363) 2026-06-26 09:25:35 -07:00
vector_store_files build(deps-dev): bump black to 26.3.1 and apply formatting (#28525) 2026-05-21 17:24:18 -07:00
vector_stores feat(litellm): add models and repository layers (#29686) 2026-06-06 20:59:33 -07:00
videos ci(lint): add blanket-noqa, dataclass-default, and unused-noqa Ruff rules (#30516) 2026-06-16 12:07:22 -07:00
__init__.py feat(ocr): thin Rust OCR Python bridge (#31368) 2026-06-25 18:42:59 -07:00
_internal_context.py fix(proxy): harden request parameter handling 2026-04-16 01:38:12 +00:00
_lazy_imports.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
_lazy_imports_registry.py chore: litellm oss staging (#30968) 2026-06-23 07:31:44 -07:00
_logging.py ci(lint): add blanket-noqa, dataclass-default, and unused-noqa Ruff rules (#30516) 2026-06-16 12:07:22 -07:00
_redis.py chore: migrate Python formatter from black to ruff format (#31317) 2026-06-25 11:27:43 -07:00
_redis_credential_provider.py feat: add ability to auth to azure with token (#27556) 2026-05-09 22:34:09 +00:00
_service_logger.py fix: missing span for guardrail passthrough (#29552) 2026-06-03 01:25:15 +00:00
_uuid.py build(deps-dev): bump black to 26.3.1 and apply formatting (#28525) 2026-05-21 17:24:18 -07:00
_version.py
anthropic_beta_headers_config.json chore(oss): litellm oss staging 120626 (#30292) 2026-06-12 09:49:25 -07:00
anthropic_beta_headers_manager.py Refactor: Filtering beta header after transformation 2026-03-16 10:47:15 +05:30
blog_posts.json docs(blog): add WebRTC blog post link 2026-03-13 17:54:33 +05:30
budget_manager.py chore: migrate Python formatter from black to ruff format (#31317) 2026-06-25 11:27:43 -07:00
constants.py fix(cli): mint per-session agent credential on lite login (#31072) 2026-06-26 09:05:15 -07:00
cost.json
cost_calculator.py chore: migrate Python formatter from black to ruff format (#31317) 2026-06-25 11:27:43 -07:00
exceptions.py feat: standardize rate limit errors with category, rate_limit_type, model, and llm_provider fields (#27687) 2026-06-06 17:50:29 -07:00
main.py chore: litellm oss staging 250626 (#31305) 2026-06-25 21:00:28 -07:00
model_prices_and_context_window_backup.json test: add realtime proxy e2e suite across providers (#30960) 2026-06-26 09:36:49 -07:00
policy_templates_backup.json feat(add-new-block_code_execution-guardrail): prevent agent from executing code (#22154) 2026-02-25 22:02:14 -08:00
provider_endpoints_support_backup.json chore: litellm oss staging (#30968) 2026-06-23 07:31:44 -07:00
py.typed
router.py chore: litellm oss staging (#31185) 2026-06-26 09:17:44 -07:00
scheduler.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
setup_wizard.py Add Claude Fable 5 across Anthropic, Bedrock, Vertex AI, and Azure AI (#30064) 2026-06-10 08:50:15 +05:30
timeout.py docs: add class docstring to _LoopWrapper (#27870) 2026-05-13 13:54:00 -07:00
utils.py fix(cost): restore per-query Gemini 3.x web search billing (#31363) 2026-06-26 09:25:35 -07:00