litellm/litellm/litellm_core_utils
Yuneng Jiang 7503f14f3f
fix: harden /model/info redaction to cover plural credential field names
Mirrors the existing vertex_credentials handling for the newer
vertex_ai_credentials field, and extends the dynamic masker's sensitive
pattern set to recognize the plural form so other plural-named credential
fields are also covered.
2026-04-25 12:59:12 -07:00
..
audio_utils style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
llm_cost_calc [Fix] Apply black formatting to fix CI lint failures 2026-04-20 15:53:12 -07:00
llm_response_utils style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
prompt_templates Merge branch 'litellm_internal_staging' into litellm_staging_03_22_2026 2026-04-24 13:12:19 -03:00
specialty_caches style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
tokenizers Code Quality Improvement - remove tokenizers/ from /llms (#7163) 2024-12-10 23:50:15 -08:00
api_route_to_call_types.py Agent Guardrails - on streaming output (#21206) 2026-02-14 11:36:52 -08:00
app_crypto.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
asyncify.py (core sdk fix) - fix fallbacks stuck in infinite loop (#7751) 2025-01-13 19:34:34 -08:00
cached_imports.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
cli_token_utils.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
completion_timeout.py Litellm ishaan april15 2 (#25828) 2026-04-15 18:42:23 -07:00
core_helpers.py Merge pull request #26283 from BerriAI/litellm_internal_staging 2026-04-22 19:55:27 -03:00
coroutine_checker.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
credential_accessor.py fix(router.py): support reusable credentials via passthrough router (#9758) 2025-04-04 18:40:14 -07:00
custom_logger_registry.py Add Vantage integration for FOCUS CSV export 2026-03-11 13:51:36 +05:30
dd_tracing.py _add_dd_apm_tags_for_litellm_call_id (#22219) 2026-02-26 16:42:23 -08:00
default_encoding.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
dot_notation_indexing.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
duration_parser.py Reapply "feat: add model_cost aliases expansion support" 2026-03-12 13:36:57 -03:00
env_utils.py fix(callbacks): allow MAX_CALLBACKS override via env var (#20781) 2026-02-09 12:11:32 -08:00
exception_mapping_utils.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
fallback_utils.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
get_blog_posts.py fix: remove unused Any import from get_blog_posts 2026-03-16 16:23:06 -07:00
get_litellm_params.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
get_llm_provider_logic.py Litellm ishaan march30 (#24887) (#25151) 2026-04-04 14:44:07 -07:00
get_model_cost_map.py style: run black formatter on 52 non-enterprise files 2026-03-12 14:23:50 -03:00
get_provider_specific_headers.py [Fix] Forward anthropic-beta headers to Bedrock, VertexAI (#15700) 2025-10-18 16:26:32 -07:00
get_supported_openai_params.py Feature/add audio support for scaleway (#26110) 2026-04-20 14:49:41 -07:00
health_check_helpers.py add docs and formatting 2026-02-28 14:08:09 +05:30
health_check_utils.py (Refactor) - Re use litellm.completion/litellm.embedding etc for health checks (#7455) 2024-12-28 18:38:54 -08:00
initialize_dynamic_callback_params.py fix: merge team metadata in admin helper, remove turn_off_message_logging from dynamic params 2026-04-16 21:06:59 +00:00
json_validation_rule.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
litellm_logging.py Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_yj_apr23 2026-04-25 09:47:47 -07:00
llm_request_utils.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
logging_callback_manager.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
logging_utils.py fix(types): resolve MyPy assignment type errors in logging_utils and vertex transformation 2026-02-20 13:46:51 -03:00
logging_worker.py fix: make LoggingWorker.flush() wait for in-flight callbacks 2026-04-23 15:06:33 -07:00
mock_functions.py Support returning virtual key in custom auth + Handle provider-specific optional params for embedding calls (#11346) 2025-06-03 07:24:13 -07:00
model_param_helper.py style: black format model_param_helper.py 2026-04-15 18:18:45 -07:00
model_response_utils.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
README.md Guardrails API - add streaming support (#17400) 2025-12-02 22:52:09 -08:00
realtime_streaming.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
redact_messages.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
response_header_helpers.py fix(utils.py): guarantee openai-compatible headers always exist in response 2024-09-28 21:08:15 -07:00
rules.py fix: remove slow string operation (#14955) 2025-09-26 13:25:59 -07:00
safe_json_dumps.py fix: shared health check serialization (#21119) 2026-02-13 09:15:43 -08:00
safe_json_loads.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
sensitive_data_masker.py fix: harden /model/info redaction to cover plural credential field names 2026-04-25 12:59:12 -07:00
streaming_chunk_builder_utils.py style: apply black formatting 2026-04-22 20:09:53 -03:00
streaming_handler.py style: apply black formatting 2026-04-22 20:09:53 -03:00
thread_pool_executor.py (Fixes) OpenAI Streaming Token Counting + Fixes usage track when litellm.turn_off_message_logging=True (#8156) 2025-01-31 15:06:37 -08:00
token_counter.py fix: correct image size limit enforcement and vertex_location None passthrough 2026-04-23 11:20:20 -07:00
url_utils.py fix: address three CI failures from recent security PR merges 2026-04-17 15:11:45 -07:00

Folder Contents

This folder contains general-purpose utilities that are used in multiple places in the codebase.

Core files:

  • streaming_handler.py: The core streaming logic + streaming related helper utils
  • core_helpers.py: code used in types/ - e.g. map_finish_reason.
  • exception_mapping_utils.py: utils for mapping exceptions to openai-compatible error types.
  • default_encoding.py: code for loading the default encoding (tiktoken)
  • get_llm_provider_logic.py: code for inferring the LLM provider from a given model name.
  • duration_parser.py: code for parsing durations - e.g. "1d", "1mo", "10s"
  • api_route_to_call_types.py: mapping of API routes to their corresponding CallTypes (e.g., /chat/completions -> [acompletion, completion])