..
a2a_protocol
refactor(typing): clear about 1,100 basedpyright Any errors across 303 files ( #49986 )
2026-11-06 13:31:15 -08:00
accounting
feat(proxy): enforce customer org, team and member budgets and limits on the request path ( #51489 )
2026-11-12 20:43:44 -08:00
anthropic_interface
feat(anthropic): forward message threads on native /v1/messages ( #50976 )
2026-11-10 18:33:54 -08:00
batch_completion
batches
feat(gemini): file-backed batch jobs on /v1/batches with output download and spend tracking ( #51032 )
2026-11-11 12:00:32 -08:00
caching
refactor(redis): delete the Python RedisBatch now that every request op is native ( #51383 )
2026-11-13 03:22:28 +00:00
completion_extras
fix(tool_choice): accept the Responses API's flat allowed_tools layout on chat completions ( #50467 )
2026-11-10 13:04:06 -08:00
compression
containers
refactor(router): delete the python router core, the rust core is the only core ( #50178 )
2026-11-05 10:40:46 -08:00
db_scripts
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
decisions
feat(nace): add Drex Max decisions and inline images ( #48426 )
2026-11-12 21:27:37 -08:00
endpoints
enterprise
fix(files): match every spelling of a provider file id in the ownership check ( #51498 )
2026-11-13 05:43:43 +00:00
expected_fine_tuning_api
expected_responses_api_request
experimental_mcp_client
fix(mcp): load deprecated package aliases on demand ( #48615 )
2026-10-27 19:46:19 +00:00
extraction
files
fix(hosted_vllm): accept the vLLM production-stack router's file and batch objects ( #49068 )
2026-10-30 23:11:34 -07:00
fine_tuning
fixtures
gateway
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
google_genai
fix(google_genai): read one-object and null spellings of repeated fields in countTokens and generateContent ( #48771 )
2026-10-28 21:46:06 -07:00
harness
images
feat(dashscope): add image edits and text-to-speech ( #48998 )
2026-10-29 17:48:38 -07:00
integration_support
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
integrations
fix(langfuse): reserve span capacity for failure usage attributes ( #51538 )
2026-11-12 21:14:14 -08:00
interactions
refactor(typing): clear about 1,100 basedpyright Any errors across 303 files ( #49986 )
2026-11-06 13:31:15 -08:00
litellm_core_utils
feat(budgets): support annual calendar reset periods ( #51508 )
2026-11-12 19:40:40 -08:00
litellm_proxy_extras
refactor(proxy): name customer member budget columns budget_id and budget_override_id ( #51490 )
2026-11-12 17:33:22 -08:00
llms
fix(bedrock): send max_tokens and priority in Cohere embedding requests ( #51435 )
2026-11-12 23:44:08 +00:00
mcp_client
feat(mcp): cache upstream tool lists with an admin-set lifetime ( #51160 )
2026-11-12 08:48:04 -08:00
models
fix(alerts): stop detecting traffic drops ( #51338 )
2026-11-11 20:22:24 -08:00
ocr
passthrough
fix(bedrock): forward x-pass- headers on the /bedrock/model pass-through routes ( #50728 )
2026-11-10 21:28:49 +00:00
proxy
feat(db): add the SQLx pool foundation with the writer pool
2026-11-13 16:50:02 +09:00
rag
realtime_api
refactor(typing): clear 1141 basedpyright Any errors across 182 files ( #50711 )
2026-11-11 22:11:47 +00:00
redis
refactor(redis): delete the Python RedisBatch now that every request op is native ( #51383 )
2026-11-13 03:22:28 +00:00
repositories
feat(db): add the SQLx pool foundation with the writer pool
2026-11-13 16:50:02 +09:00
rerank_api
responses
refactor(router): count the whole router_usage family on the native store ( #50862 )
2026-11-13 03:22:28 +00:00
router_rust
feat(redis): serve the health checks' deployment states from a native store ( #50357 )
2026-11-13 03:22:28 +00:00
router_strategy
feat(redis): serve the router's session pins from a native store ( #50870 )
2026-11-13 03:22:28 +00:00
router_utils
refactor(redis): delete the Python RedisBatch now that every request op is native ( #51383 )
2026-11-13 03:22:28 +00:00
rust_bridge
refactor(router): count the whole router_usage family on the native store ( #50862 )
2026-11-13 03:22:28 +00:00
sandbox
fix(streaming): keep merged think tags balanced and split SSE lines only on CR/LF ( #48755 )
2026-10-28 17:00:29 -07:00
search
feat(search): add Microsoft Web IQ provider ( #50883 )
2026-11-10 22:43:36 +00:00
secret_managers
chore: move workspace packages under litellm ( #51000 )
2026-11-12 04:19:57 +00:00
skills
feat(skills): add a litellm-setup agent skill ( #47731 )
2026-10-28 15:44:43 -07:00
systemone
fix(databricks): reuse base OAuth for decisions ( #48395 ) ( #48527 )
2026-10-26 20:18:16 -07:00
telemetry
test_router
feat(redis): serve the router's session pins from a native store ( #50870 )
2026-11-13 03:22:28 +00:00
text_completions
fix(proxy): name the deployment in stream error alerts on chat, completions, responses and messages ( #51034 )
2026-11-11 22:50:23 +00:00
tracing
types
feat(proxy): register unknown customer members in the aliased organization's default team ( #51546 )
2026-11-13 05:15:45 +00:00
vector_stores
feat(bedrock): search knowledge bases by image and return image hits ( #51063 )
2026-11-12 00:19:34 +00:00
videos
refactor(typing): clear 1141 basedpyright Any errors across 182 files ( #50711 )
2026-11-11 22:11:47 +00:00
__init__.py
AGENTS.md
feat(vector_stores): add OpenSearch k-NN search as a vector store provider ( #47759 )
2026-10-29 08:15:05 -07:00
conftest.py
refactor(rust_bridge): route every Rust-to-Python call through host modules ( #50822 )
2026-11-11 01:57:54 +00:00
create_mock_standard_logging_payload.py
test_a2a_registry_lookup.py
test_acompletion_session_reuse_e2e.py
test_add_deployment_no_master_key.py
test_aembedding_session_reuse_e2e.py
test_anthropic_beta_gated_fields.py
fix(anthropic)!: drop beta-gated body fields under drop_params ( #48793 )
2026-10-29 06:25:31 -07:00
test_anthropic_beta_headers_filtering.py
fix(bedrock): forward the compact-2026-09-04 compaction param on Invoke /v1/messages ( #51223 )
2026-11-11 15:10:32 -08:00
test_anthropic_skills_transformation.py
test_assert_ci_coverage.py
ci(unit): split proxy-infra-root in two, isolate subprocess tests, make its file exclusions take effect ( #51316 )
2026-11-11 17:39:10 -08:00
test_assert_secret_absent.py
ci: run the integration groups on GitHub Actions ( #48985 )
2026-10-29 12:50:08 -07:00
test_assert_workflow_dir_hygiene.py
test_audio_transcription_rust_bridge.py
fix(bedrock): omit system prompt from audio transcription and report its token usage ( #41565 )
2026-10-28 19:23:15 -07:00
test_azure_ad_token_credential_resolution.py
feat(proxy)!: only let clients pick S3 buckets the admin allowed ( #47496 )
2026-11-06 02:50:15 +00:00
test_azure_ai_grok_4_3_model_metadata.py
test_azure_ai_grok_4_6_model_metadata.py
test_baseten_glm_5_3_model_metadata.py
test_batch_completion_models_all_responses.py
test_bedrock_marengo_embed_3_model_metadata.py
test_build_core_distribution.py
chore: move workspace packages under litellm ( #51000 )
2026-11-12 04:19:57 +00:00
test_cerebras_llama_model_metadata.py
chore(cost-map): remove the 52 rows whose provider retired them before 2026 ( #49974 )
2026-11-03 16:23:06 -08:00
test_chat_ui_responses_session.py
test_check_licenses.py
test_check_mcp_operation_boundary.py
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
test_check_migrations_lock_timeout.py
test_check_migrations_no_data_rewrites.py
test_check_openapi_docs.py
feat(proxy): customer org, team and member hierarchy with budget templates ( #51459 )
2026-11-12 15:11:51 -08:00
test_check_py310_typing_imports.py
test_check_test_quality.py
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
test_check_type_discipline.py
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
test_check_unbounded_in_lists.py
test_check_windows_wheel_install.py
test_ci_path_filter.py
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
test_claude_fable_5_config.py
feat: add claude mythos 5.2 to vertex ai cost map ( #50940 )
2026-11-10 09:35:37 -08:00
test_claude_haiku_5_5_config.py
test_claude_opus_4_6_config.py
test_claude_opus_4_8_config.py
test_claude_opus_5_config.py
test_claude_sonnet_5_config.py
test_cli_package.py
chore: move workspace packages under litellm ( #51000 )
2026-11-12 04:19:57 +00:00
test_cloudflare_workers_ai_model_metadata.py
test_completion_timeout_resolution.py
test_compression.py
test_conftest_isolation.py
refactor(model-cost): move the cost map inputs, fetch and register_model overlay into Rust ( #50501 )
2026-11-10 02:37:35 +00:00
test_constants.py
fix(router): cap the default OTPM reservation and reconcile token counters after each call ( #49054 )
2026-10-29 20:32:04 -07:00
test_container_router.py
test_cost_calculation_log_level.py
test_cost_calculator.py
fix(cost): preserve Bedrock cross-region pricing for Messages ( #51479 )
2026-11-12 15:54:56 -08:00
test_cost_map_guard.py
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
test_count_tokens_public_api.py
chore(cost-map): remove the 52 rows whose provider retired them before 2026 ( #49974 )
2026-11-03 16:23:06 -08:00
test_dashscope_image_generation.py
feat(dashscope): add image edits and text-to-speech ( #48998 )
2026-10-29 17:48:38 -07:00
test_daybreak_model_metadata.py
test_deepseek_model_metadata.py
test_default_branch.py
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
test_detect_changes.py
chore: move ui and vscode-extension under litellm and delete docs ( #50992 )
2026-11-12 04:19:57 +00:00
test_docker_entrypoint.py
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
test_docker_no_network_on_deploy.py
chore: move deployment sources under litellm/deploy ( #50981 )
2026-11-12 04:19:56 +00:00
test_dockerfile_apk_repository.py
chore: move deployment sources under litellm/deploy ( #50981 )
2026-11-12 04:19:56 +00:00
test_dockerfile_bedrock_realtime_extra.py
chore: move deployment sources under litellm/deploy ( #50981 )
2026-11-12 04:19:56 +00:00
test_dockerfile_non_root.py
chore: move deployment sources under litellm/deploy ( #50981 )
2026-11-12 04:19:56 +00:00
test_drop_params_env_var.py
test_e2e_egress_sentinel.py
test_eager_tiktoken_load.py
test_elevenlabs_tts_pricing.py
test_empty_mock_response.py
fix: honor empty mock completion responses ( #48162 ) ( #48266 )
2026-10-28 00:56:45 +00:00
test_env_key_doc_gate.py
chore: move workspace packages under litellm ( #51000 )
2026-11-12 04:19:57 +00:00
test_exception_exports.py
test_exception_header_preservation.py
fix(openai): keep the upstream error body on e.response for OpenAI and Azure errors ( #49079 )
2026-10-29 23:30:02 -07:00
test_exception_mapping_request_attribute.py
test_fake_openai_endpoint.py
test_filter_out_litellm_params.py
test_fireworks_serverless_model_costs.py
test_gate_slot_lock.py
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
test_gemini_3_1_flash_lite_image_pricing.py
test_gemini_4_argon_model_metadata.py
test_gemini_tts_native_audio_pricing.py
test_get_blog_posts.py
chore(blog): refresh the bundled blog posts backup with the latest 50 posts from the docs RSS feed ( #49971 )
2026-11-03 23:41:15 +00:00
test_git_hooks.py
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
test_gpt_5_4_model_metadata.py
test_gpt_5_5_model_metadata.py
test_gpt_image_cost_calculator.py
test_gpt_realtime_mode.py
chore(cost-map): remove the 52 rows whose provider retired them before 2026 ( #49974 )
2026-11-03 16:23:06 -08:00
test_groq_streaming_encoding.py
fix(streaming): keep merged think tags balanced and split SSE lines only on CR/LF ( #48755 )
2026-10-28 17:00:29 -07:00
test_guardrail_exception_status_codes.py
test_guardrails.py
Add guardrails.apply SDK helper ( #49217 ) ( #49469 )
2026-10-31 23:37:45 +00:00
test_integration_run.py
test_internal_context.py
refactor(redis): delete the Python RedisBatch now that every request op is native ( #51383 )
2026-11-13 03:22:28 +00:00
test_lazy_imports.py
refactor: declare each lazy litellm attribute once and resolve them through one function ( #50523 )
2026-11-07 09:50:01 -08:00
test_lint_base_counts.py
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
test_lint_workflow_diff_gates.py
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
test_litellm_cli.py
chore: move workspace packages under litellm ( #51000 )
2026-11-12 04:19:57 +00:00
test_litellm_overhead.py
test_litellm_params_reserved_keys.py
test_logging.py
chore: move workspace packages under litellm ( #51000 )
2026-11-12 04:19:57 +00:00
test_lowest_latency_zero_tokens.py
test_main.py
fix(health): log Test Connection spend with the mode's call type and model id ( #50987 )
2026-11-11 16:07:33 -08:00
test_main_module_header.py
test_mistral_large_4_model_metadata.py
fix(cost-map): price Mistral Large 4 at its list price now that the launch sale ended ( #48825 )
2026-10-28 18:12:55 +00:00
test_mistral_medium_3_5_model_metadata.py
test_mistral_small_4_0_model_metadata.py
test_mistral_zai_glm_5_2_model_metadata.py
test_model_block_unblock.py
refactor(router): move router callers onto the entry points and invert the proxy imports ( #48847 )
2026-10-29 17:26:33 +00:00
test_model_cost_aliases.py
refactor(rust_bridge): route every Rust-to-Python call through host modules ( #50822 )
2026-11-11 01:57:54 +00:00
test_model_param_helper.py
test_model_prices_and_context_window.py
feat(nace): add Drex Max decisions and inline images ( #48426 )
2026-11-12 21:27:37 -08:00
test_model_response_normalization.py
test_muse_ember_1_0_model_metadata.py
feat(cost-map): add meta/muse-ember-1.0 with long-context rates from the Meta pricing page ( #50847 )
2026-11-10 06:36:06 +00:00
test_muse_spark_1_1_model_metadata.py
test_muse_spark_1_2_model_metadata.py
test_muse_spark_1_3_model_metadata.py
refactor(router): route the router family through RoutingContext and close the outside surface ( #49118 )
2026-10-30 19:18:54 -07:00
test_mutation_report.py
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
test_nested_drop_params.py
test_no_top_level_test_invocations.py
refactor(rust_bridge): route every Rust-to-Python call through host modules ( #50822 )
2026-11-11 01:57:54 +00:00
test_non_chat_routes_open_llm_spans.py
test_openai_embedding_encoding_format_default.py
test_openai_record_replay_proxy.py
test_openai_service_tier_long_context_pricing.py
test_openapi_docs_gate.py
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
test_package_layout.py
test_package_metadata.py
fix(proxy): add tzdata to the proxy extra so a legacy TZ doesn't stop startup ( #49914 )
2026-11-10 23:09:43 -08:00
test_pre_commit_lint.py
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
test_prisma_generate_if_needed.py
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
test_private_usage_aliases.py
chore: move workspace packages under litellm ( #51000 )
2026-11-12 04:19:57 +00:00
test_process_helpers.py
test_project_alias_tracking.py
test_project_tags_pydantic.py
test_proxy_auth.py
test_pydantic_namespaces.py
refactor(rust_bridge): route every Rust-to-Python call through host modules ( #50822 )
2026-11-11 01:57:54 +00:00
test_rag_openai_ingestion.py
test_rate_limit_error_unification.py
feat(redis): serve the proxy's common Redis call with Rust stores ( #50170 )
2026-11-06 06:01:11 +00:00
test_read_rc_version.py
test_recursive_detector.py
chore: move workspace packages under litellm ( #51000 )
2026-11-12 04:19:57 +00:00
test_redact_string_in_error_paths.py
refactor(router): delete the python router core, the rust core is the only core ( #50178 )
2026-11-05 10:40:46 -08:00
test_redis.py
chore: move workspace packages under litellm ( #51000 )
2026-11-12 04:19:57 +00:00
test_redis_credential_provider.py
test_register_model_custom_pricing.py
fix(utils): register ollama deployment prices from the built-in catalog without calling the provider ( #51561 )
2026-11-13 06:50:44 +00:00
test_register_model_zero_cost_persistence.py
test_replicate_model_key_format.py
test_responses_api_bridge_non_stream.py
test_responses_id_security.py
fix(responses)!: authorize and decode comparison response IDs ( #49402 )
2026-11-03 03:40:46 +00:00
test_responses_streaming_container_ownership.py
refactor(router): delete the python router core, the rust core is the only core ( #50178 )
2026-11-05 10:40:46 -08:00
test_retrieve_batch_bedrock_dispatch.py
test_router_block_helpers.py
refactor(router): delete the python router core, the rust core is the only core ( #50178 )
2026-11-05 10:40:46 -08:00
test_router_exception_redaction.py
test_router_get_settings.py
test_router_google_genai.py
test_router_model_cost_isolation.py
refactor(rust_bridge): route every Rust-to-Python call through host modules ( #50822 )
2026-11-11 01:57:54 +00:00
test_router_order_fallback.py
refactor(router): delete the python router core, the rust core is the only core ( #50178 )
2026-11-05 10:40:46 -08:00
test_router_per_deployment_num_retries.py
refactor(router): delete the python router core, the rust core is the only core ( #50178 )
2026-11-05 10:40:46 -08:00
test_router_redis_init.py
test_router_retry_backoff_headers.py
refactor(router): delete the python router core, the rust core is the only core ( #50178 )
2026-11-05 10:40:46 -08:00
test_router_retry_non_retryable_errors.py
refactor(router): delete the python router core, the rust core is the only core ( #50178 )
2026-11-05 10:40:46 -08:00
test_router_retry_policy_update.py
refactor(router): delete the python router core, the rust core is the only core ( #50178 )
2026-11-05 10:40:46 -08:00
test_router_silent_experiment.py
refactor(router): delete the python router core, the rust core is the only core ( #50178 )
2026-11-05 10:40:46 -08:00
test_router_streaming_fallback_metadata.py
refactor(router): delete the python router core, the rust core is the only core ( #50178 )
2026-11-05 10:40:46 -08:00
test_router_weighted_failover.py
refactor(router): delete the python router core, the rust core is the only core ( #50178 )
2026-11-05 10:40:46 -08:00
test_ruff_strict_gate.py
chore: move config and docs off the repo root ( #50966 )
2026-11-11 18:29:35 -08:00
test_sambanova_model_metadata.py
test_scaledown_model_prices.py
test_scheduler.py
refactor(rust_bridge): route every Rust-to-Python call through host modules ( #50822 )
2026-11-11 01:57:54 +00:00
test_secret_redaction.py
fix(spend-logs): mask token-shaped secrets in stored request and resp… ( #48968 )
2026-11-12 18:45:06 +00:00
test_seed_tracing_fixtures.py
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
test_select_ui_test_scope.py
fix(ci): measure PR gates from the target branch's current tip ( #49078 )
2026-10-29 18:28:16 -07:00
test_service_logger.py
test_setup_wizard.py
test_shared_session_integration.py
test_socket_policy.py
test_spend_logs_guard.py
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
test_ssl_verify_unit.py
test_stream_chunk_builder_annotations.py
fix(anthropic)!: send /v1/messages PDF documents to OpenAI-shaped providers as file parts ( #47166 )
2026-10-29 08:06:12 -07:00
test_stream_chunk_builder_citations.py
test_stream_chunk_builder_images.py
test_streaming_connection_cleanup.py
refactor(router): delete the python router core, the rust core is the only core ( #50178 )
2026-11-05 10:40:46 -08:00
test_system_message_format_bug.py
test_test_quality_gate.py
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
test_thinking_enabled.py
test_together_ai_model_metadata.py
chore(cost-map): remove the 52 rows whose provider retired them before 2026 ( #49974 )
2026-11-03 16:23:06 -08:00
test_tool_loop.py
fix(tool_choice): accept the Responses API's flat allowed_tools layout on chat completions ( #50467 )
2026-11-10 13:04:06 -08:00
test_type_check_gate.py
chore: move config and docs off the repo root ( #50966 )
2026-11-11 18:29:35 -08:00
test_type_discipline_gate.py
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
test_typesafe_model_metadata.py
test_unit_shard_missing_paths.py
test_unit_shard_per_test_timeout.py
test_utils.py
feat(fal_ai): bill flat per-video fal.ai models with output_cost_per_video ( #51225 )
2026-11-12 15:13:49 -08:00
test_utils_get_model_info.py
chore: move config and docs off the repo root ( #50966 )
2026-11-11 18:29:35 -08:00
test_utils_get_optional_params.py
fix(openai): warn when the GPT-5 reasoning effort gate drops a level under drop_params ( #47761 )
2026-10-29 04:46:29 -07:00
test_utils_module_docstring.py
test_uuid_helper.py
fix: support Python 3.15 ( #48359 )
2026-10-26 16:00:11 +00:00
test_vcr_classification.py
test_vcr_conftest_common_banner.py
ci: remove CircleCI ( #50950 )
2026-11-11 15:38:27 -08:00
test_vcr_filters.py
test_vcr_leak_guard.py
test_vcr_redis_persister.py
test_vcr_safe_body_matcher.py
test_version.py
test_vertex_ai_xai_grok_prompt_caching_metadata.py
test_video_generation.py
feat(fal_ai): bill flat per-video fal.ai models with output_cost_per_video ( #51225 )
2026-11-12 15:13:49 -08:00
test_with_dashboard_node.py
chore: move scripts and runtime sources under litellm ( #51006 )
2026-11-12 04:19:57 +00:00
test_ws_vcr.py
test_xai_grok_4_3_model_metadata.py
test_xai_responses_auto_routing.py
whitelisted_bedrock_models.txt
chore: move config and docs off the repo root ( #50966 )
2026-11-11 18:29:35 -08:00