scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-17 23:51:30 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 67
litellm/litellm/llms
History
Mateo Wang c2c2a623c0
Some checks are pending
ai-gateway image / ai-gateway release image (push) Waiting to run
Details
CI Coverage / assert-ci-coverage (push) Waiting to run
Details
CodSpeed Benchmarks / benchmarks (push) Waiting to run
Details
Publish basedpyright base counts / publish (push) Waiting to run
Details
Code Quality Checks / code-quality (push) Waiting to run
Details
Code Quality Checks / python-310-import-smoke (push) Waiting to run
Details
Unit Tests: Proxy DB Operations / auth-checks (push) Blocked by required conditions
Details
Unit Tests: Proxy DB Operations / budgets (push) Blocked by required conditions
Details
Unit Tests: Proxy DB Operations / custom-logging (push) Blocked by required conditions
Details
Unit Tests: Proxy DB Operations / db-and-spend (push) Blocked by required conditions
Details
Unit Tests: Proxy DB Operations / endpoints-and-responses (push) Blocked by required conditions
Details
Unit Tests: Proxy DB Operations / guardrails-hooks (push) Blocked by required conditions
Details
Unit Tests: Proxy DB Operations / jwt-and-keys (push) Blocked by required conditions
Details
Unit Tests: Proxy DB Operations / key-generation (push) Blocked by required conditions
Details
Unit Tests: Proxy DB Operations / logging-misc (push) Blocked by required conditions
Details
Unit Tests: Proxy DB Operations / proxy-runtime (push) Blocked by required conditions
Details
Unit Tests: Proxy DB Operations / proxy-server-core (push) Blocked by required conditions
Details
Unit Tests: Proxy DB Operations / proxy-utils (push) Blocked by required conditions
Details
Unit Tests / proxy-endpoints (push) Waiting to run
Details
Unit Tests / proxy-extras (push) Waiting to run
Details
Unit Tests / caching-local (push) Waiting to run
Details
Unit Tests / core-utils (push) Waiting to run
Details
Unit Tests / enterprise-package (push) Waiting to run
Details
Unit Tests / enterprise-routing (push) Waiting to run
Details
Unit Tests / integrations (push) Waiting to run
Details
Unit Tests / All Other Providers (push) Waiting to run
Details
Unit Tests / Vertex AI (push) Waiting to run
Details
Unit Tests / proxy-infra (push) Waiting to run
Details
Unit Tests / proxy-server (push) Waiting to run
Details
GitHub Actions Security Analysis / zizmor (push) Waiting to run
Details
UI Unit Tests / ui-unit-tests (push) Waiting to run
Details
Postgres Tests / proxy-security (push) Waiting to run
Details
Postgres Tests / schema-migration (push) Waiting to run
Details
Postgres Tests / proxy-behavior (push) Waiting to run
Details
LiteLLM Rust / rust-lint (push) Waiting to run
Details
LiteLLM Rust / rust-test (push) Waiting to run
Details
Unit Tests: Documentation Validation / documentation (push) Waiting to run
Details
Unit Tests: Proxy DB Operations / assert-shard-coverage (push) Waiting to run
Details
Unit Tests / misc (push) Waiting to run
Details
Unit Tests / proxy-auth (push) Waiting to run
Details
Unit Tests / responses-caching-types (push) Waiting to run
Details
Merge pull request #39846 from BerriAI/litellm_bedrock_mantle_govcloud_cost_row 
fix(bedrock_mantle): price GovCloud regions from the regional cost row and accept region-prefixed model names
2026-09-12 21:13:58 -07:00
..
a2a Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5_r4 2026-09-03 01:27:33 +00:00
ai21/chat feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
aiml refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
aiohttp_openai/chat refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
amazon_nova refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
anthropic fix(anthropic-adapter): surface mid-stream provider errors as Anthropic error events (#33352) 2026-09-12 21:13:35 -07:00
apiserpent feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
aws_polly refactor(typing): replace Any with proven types in 89 more backend files 2026-09-02 23:08:42 +00:00
azure Merge pull request #40769 from BerriAI/litellm_azure_realtime_ga_default 2026-09-11 18:34:20 -07:00
azure_ai refactor(ocr): complete native lifecycle and preserve Azure auth (#40734) 2026-09-12 11:56:49 -07:00
base_llm Merge pull request #39836 from BerriAI/litellm_lit_6975_bedrock_files_delete_list 2026-09-12 21:13:27 -07:00
baseten feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
bedrock Merge pull request #39836 from BerriAI/litellm_lit_6975_bedrock_files_delete_list 2026-09-12 21:13:27 -07:00
bedrock_mantle Merge pull request #39846 from BerriAI/litellm_bedrock_mantle_govcloud_cost_row 2026-09-12 21:13:58 -07:00
black_forest_labs Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_async_remote_image_fetch 2026-09-05 00:37:19 -07:00
brave/search chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
bytez refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
cerebras fix(cerebras): add max_retries and extra_headers to get_supported_openai_params (#36601) 2026-08-25 14:10:56 -07:00
chatgpt Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5 2026-08-29 06:37:10 -07:00
clarifai/chat refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
cloudflare/chat feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
codestral/completion refactor(types): replace Any with precise types across 73 modules 2026-09-01 11:05:02 +00:00
cohere refactor(ocr): complete native lifecycle and preserve Azure auth (#40734) 2026-09-12 11:56:49 -07:00
cometapi refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
compactifai Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5 2026-08-29 06:37:10 -07:00
custom_httpx Merge pull request #39836 from BerriAI/litellm_lit_6975_bedrock_files_delete_list 2026-09-12 21:13:27 -07:00
dashscope Merge pull request #39237 from BerriAI/litellm_fix_dashscope_rerank_endpoint 2026-09-10 10:31:48 -07:00
databricks fix(databricks): keep the Claude fallback when gating the anthropic thinking payload 2026-09-12 13:13:38 -07:00
dataforseo/search refactor(typing): replace Any with proven types in 42 more backend files 2026-09-02 15:35:01 +00:00
datarobot/chat chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
deepgram feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
deepinfra refactor(types): replace Any with precise types across 73 modules 2026-09-01 11:05:02 +00:00
deepseek fix: collapse image_url blocks whose payload lacks a url instead of forwarding them 2026-08-26 13:19:06 -07:00
deprecated_providers chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
docker_model_runner/chat chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
duckduckgo/search feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
e2b Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5 2026-08-29 06:03:33 -07:00
elevenlabs refactor(typing): replace Any with proven types in 42 more backend files 2026-09-02 15:35:01 +00:00
empower/chat
exa_ai/search feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
fal_ai refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
fastcrw feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
featherless_ai/chat feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
firecrawl feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
fireworks_ai refactor(fireworks): resolve cost map key through a provider config hook 2026-09-13 03:29:11 +00:00
friendliai/chat
galadriel/chat
gdc chore(typing): clear 1.5k basedpyright Any errors across 54 files 2026-08-21 05:25:22 +00:00
gemini Merge pull request #38869 from BerriAI/litellm_fix_guardrail_route_call_types 2026-09-07 15:15:51 -07:00
gigachat Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5_r4 2026-09-03 01:27:33 +00:00
github/chat
github_copilot refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
google_pse/search feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
gradient_ai/chat feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
groq refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
heroku/chat refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
hosted_vllm fix(hosted_vllm): reject image edit params vLLM-Omni ignores 2026-09-08 20:11:01 -07:00
huggingface refactor(typing): replace Any with proven types in 42 more backend files 2026-09-02 15:35:01 +00:00
hyperbolic chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
inception chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
infinity Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5 2026-08-29 06:03:33 -07:00
jina_ai test(cost): assert jina rerank spend at the registry rate 2026-09-10 07:04:19 -07:00
lambda_ai chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
langflow feat(agentcore-a2a): derive runtime session id from A2A message.contextId (#39371) 2026-09-02 12:40:24 -07:00
langgraph refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
lemonade refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
linkup feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
litellm_proxy feat(skills): semantic search over the LiteLLM-hosted skill registry (#39401) 2026-09-07 12:28:38 -07:00
llamafile/chat chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
lm_studio chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
manus feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
meta/realtime fix(realtime): keep a Muse turn active for turnless partials after speechEnd 2026-09-12 15:13:44 -07:00
meta_llama/chat feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
milvus/vector_stores refactor(s3_vectors): embed search queries through the shared vector store executor 2026-09-02 19:26:31 -07:00
minimax refactor(typing): replace Any with proven types in 42 more backend files 2026-09-02 15:35:01 +00:00
mistral fix(mistral): keep the deployment voice default and drop the unreachable api base fallback 2026-09-03 00:30:07 -07:00
modelscope chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
mongodb merge: resolve MongoDB sidecar staging conflicts 2026-09-08 13:59:56 -07:00
moonshot/chat fix(moonshot, together_ai): send the reasoning effort Kimi K3 accepts (#38611) 2026-08-27 20:46:46 -07:00
morph feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
nebius feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
nimble feat(search): add Nimble as a search provider (#36347) 2026-08-14 17:09:58 -07:00
nlp_cloud refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
novita/chat refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
nscale/chat feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
nvidia_nim Merge origin/litellm_internal_staging into litellm_azure_ai_entra_auth 2026-08-24 11:33:18 -07:00
nvidia_riva refactor(types): replace Any with real types across 54 more backend files 2026-08-29 19:00:43 +00:00
oci Merge pull request #39507 from BerriAI/litellm_fix_oci_streaming_chunk_ids 2026-09-11 11:46:35 -07:00
ollama perf: move Anthropic, Vertex Anthropic, Ollama and HF template fetches off the event loop (#40311) 2026-09-08 15:53:43 -07:00
oobabooga refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
openai fix(guardrails): stop 500s on POST /responses when a guardrail rewrites input 2026-09-11 01:21:20 -07:00
openai_like feat(realtime): add Meta Muse Voice transcription 2026-09-11 20:10:53 -07:00
openrouter refactor(typing): replace Any with proven types in 65 backend files 2026-09-02 09:11:36 +00:00
opensandbox Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5 2026-08-29 06:03:33 -07:00
ovhcloud feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
parallel_ai/search fix(search): forward search-tool params through the router, complete Parallel AI v1 param mapping (#37883) 2026-09-01 21:46:46 -07:00
pass_through refactor(typing): replace Any with proven types in 42 more backend files 2026-09-02 15:35:01 +00:00
perplexity chore: merge origin/litellm_internal_staging into litellm_decrease_anys_opus5_r4 2026-09-04 18:59:35 -07:00
petals refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
pg_vector/vector_stores refactor(s3_vectors): embed search queries through the shared vector store executor 2026-09-02 19:26:31 -07:00
predibase refactor(typing): drop the dead self guard in Predibase init and use a plain list factory 2026-09-04 19:42:37 -07:00
ragflow Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5_r4 2026-09-03 06:44:40 +00:00
recraft refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
reducto refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
replicate refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
runwayml refactor(types): replace Any with precise types across 73 modules 2026-09-01 11:05:02 +00:00
s3_vectors refactor(s3_vectors): embed search queries through the shared vector store executor 2026-09-02 19:26:31 -07:00
sagemaker feat(bedrock): thread aws_session_tags into STS AssumeRole 2026-09-09 12:37:36 -07:00
sambanova feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
sap refactor(types): replace Any with precise types across 73 modules 2026-09-01 11:05:02 +00:00
scaleway/audio_transcription feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
searchapi feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
searxng feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
serper/search feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
snowflake fix(async): move remote image fetches off the event loop for Snowflake, Bedrock invoke Claude, Mantle and Gemini 2026-09-04 17:48:56 -07:00
soniox refactor(typing): replace Any with proven types in 89 more backend files 2026-09-02 23:08:42 +00:00
stability refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
tavily/search feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
tencent fix(tencent): satisfy basedpyright budget in thinking mapping 2026-08-24 18:41:50 -03:00
tinyfish/search fix(search): propagate GET provider HTTP errors (#40779) 2026-09-11 14:07:32 -07:00
together_ai fix(moonshot, together_ai): send the reasoning effort Kimi K3 accepts (#38611) 2026-08-27 20:46:46 -07:00
topaz refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
triton refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
v0 chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
valkey fix(vector-store): route embeddings through router 2026-09-01 15:33:18 -07:00
vercel_ai_gateway feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
vertex_ai fix(vertex_ai): return 400 for invalid reasoning_effort instead of 500 2026-09-11 10:00:35 -07:00
vllm chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
volcengine chore(lint): remove litellm/types from the ruff lint exclusion 2026-08-05 01:10:15 -07:00
voyage Merge remote-tracking branch 'origin/litellm_internal_staging' into HEAD 2026-09-10 13:55:11 -07:00
wandb fix(wandb): gate reasoning effort on model capabilities 2026-09-10 20:47:13 +02:00
watsonx perf: move Anthropic, Vertex Anthropic, Ollama and HF template fetches off the event loop (#40311) 2026-09-08 15:53:43 -07:00
xai Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5_r4 2026-09-03 06:44:40 +00:00
xinference/image_generation feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
you_com feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
zai feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
__init__.py fix(gemini): bill Google Maps grounding as its own SKU 2026-08-26 15:31:27 -07:00
base.py refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
custom_llm.py refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
maritalk.py feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
README.md

README.md

File Structure

August 27th, 2024

To make it easy to see how calls are transformed for each model/provider:

we are working on moving all supported litellm providers to a folder structure, where folder name is the supported litellm provider name.

Each folder will contain a *_transformation.py file, which has all the request/response transformation logic, making it easy to see how calls are modified.

E.g. cohere/, bedrock/.