litellm/litellm/litellm_core_utils
ishaan-berri e2fc7d64e8
Merge pull request #25396 from BerriAI/litellm_bedrock-normalize-custom-tool-schema
feat(bedrock): normalize custom tool JSON schema for Invoke and Converse
2026-04-14 10:21:15 -07:00
..
audio_utils style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
llm_cost_calc Litellm oss staging 04 02 2026 p1 (#25055) 2026-04-08 21:37:10 -07:00
llm_response_utils style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
prompt_templates Merge pull request #25396 from BerriAI/litellm_bedrock-normalize-custom-tool-schema 2026-04-14 10:21:15 -07:00
specialty_caches [Bug]: Performance Fix Max langfuse clients reached: 20 is greater than 20 (#11285) 2025-05-30 22:34:39 -07:00
tokenizers Code Quality Improvement - remove tokenizers/ from /llms (#7163) 2024-12-10 23:50:15 -08:00
api_route_to_call_types.py Agent Guardrails - on streaming output (#21206) 2026-02-14 11:36:52 -08:00
app_crypto.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
asyncify.py (core sdk fix) - fix fallbacks stuck in infinite loop (#7751) 2025-01-13 19:34:34 -08:00
cached_imports.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
cli_token_utils.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
core_helpers.py Merge pull request #23899 from Chesars/fix/map-anthropic-refusal-finish-reason 2026-03-17 18:49:03 -03:00
coroutine_checker.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
credential_accessor.py fix(router.py): support reusable credentials via passthrough router (#9758) 2025-04-04 18:40:14 -07:00
custom_logger_registry.py Add Vantage integration for FOCUS CSV export 2026-03-11 13:51:36 +05:30
dd_tracing.py _add_dd_apm_tags_for_litellm_call_id (#22219) 2026-02-26 16:42:23 -08:00
default_encoding.py [Staging] - Ishaan March 17th (#23903) 2026-03-18 15:09:01 -07:00
dot_notation_indexing.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
duration_parser.py Reapply "feat: add model_cost aliases expansion support" 2026-03-12 13:36:57 -03:00
env_utils.py fix(callbacks): allow MAX_CALLBACKS override via env var (#20781) 2026-02-09 12:11:32 -08:00
exception_mapping_utils.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
fallback_utils.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
get_blog_posts.py fix: remove unused Any import from get_blog_posts 2026-03-16 16:23:06 -07:00
get_litellm_params.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
get_llm_provider_logic.py Litellm ishaan march30 (#24887) (#25151) 2026-04-04 14:44:07 -07:00
get_model_cost_map.py style: run black formatter on 52 non-enterprise files 2026-03-12 14:23:50 -03:00
get_provider_specific_headers.py [Fix] Forward anthropic-beta headers to Bedrock, VertexAI (#15700) 2025-10-18 16:26:32 -07:00
get_supported_openai_params.py merge: resolve conflicts between main and litellm_oss_staging_03_11_2026 2026-03-12 09:38:31 -03:00
health_check_helpers.py add docs and formatting 2026-02-28 14:08:09 +05:30
health_check_utils.py (Refactor) - Re use litellm.completion/litellm.embedding etc for health checks (#7455) 2024-12-28 18:38:54 -08:00
initialize_dynamic_callback_params.py raise ValueError on os.environ/ references in request-supplied callback params 2026-04-13 12:00:25 -07:00
json_validation_rule.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
litellm_logging.py fix(logging): preserve proxy key-auth metadata on /v1/messages Langfuse traces (#25448) 2026-04-11 09:29:34 -07:00
llm_request_utils.py [Test Fix] fix gov pricing tests (#25022) 2026-04-02 15:55:55 -07:00
logging_callback_manager.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
logging_utils.py fix(types): resolve MyPy assignment type errors in logging_utils and vertex transformation 2026-02-20 13:46:51 -03:00
logging_worker.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
mock_functions.py Support returning virtual key in custom auth + Handle provider-specific optional params for embedding calls (#11346) 2025-06-03 07:24:13 -07:00
model_param_helper.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
model_response_utils.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
README.md Guardrails API - add streaming support (#17400) 2025-12-02 22:52:09 -08:00
realtime_streaming.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
redact_messages.py Reapply "feat: add model_cost aliases expansion support" 2026-03-12 13:36:57 -03:00
response_header_helpers.py fix(utils.py): guarantee openai-compatible headers always exist in response 2024-09-28 21:08:15 -07:00
rules.py fix: remove slow string operation (#14955) 2025-09-26 13:25:59 -07:00
safe_json_dumps.py fix: shared health check serialization (#21119) 2026-02-13 09:15:43 -08:00
safe_json_loads.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
sensitive_data_masker.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
streaming_chunk_builder_utils.py fix(responses): map refusal stop_reason to incomplete status in streaming (#25498) 2026-04-11 08:48:15 -07:00
streaming_handler.py Merge pull request #25616 from BerriAI/main 2026-04-13 08:43:43 +05:30
thread_pool_executor.py (Fixes) OpenAI Streaming Token Counting + Fixes usage track when litellm.turn_off_message_logging=True (#8156) 2025-01-31 15:06:37 -08:00
token_counter.py style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00

Folder Contents

This folder contains general-purpose utilities that are used in multiple places in the codebase.

Core files:

  • streaming_handler.py: The core streaming logic + streaming related helper utils
  • core_helpers.py: code used in types/ - e.g. map_finish_reason.
  • exception_mapping_utils.py: utils for mapping exceptions to openai-compatible error types.
  • default_encoding.py: code for loading the default encoding (tiktoken)
  • get_llm_provider_logic.py: code for inferring the LLM provider from a given model name.
  • duration_parser.py: code for parsing durations - e.g. "1d", "1mo", "10s"
  • api_route_to_call_types.py: mapping of API routes to their corresponding CallTypes (e.g., /chat/completions -> [acompletion, completion])