litellm/litellm/llms
2026-03-21 15:11:29 -07:00
..
a2a style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
ai21/chat
aiml style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
aiohttp_openai/chat
amazon_nova style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
anthropic Apply Black formatting to 11 files 2026-03-21 15:05:53 -07:00
aws_polly style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
azure fix(azure): auto-route gpt-5.4+ tools+reasoning to Responses API 2026-03-17 23:06:39 -03:00
azure_ai Apply Black formatting to 11 files 2026-03-21 15:05:53 -07:00
base_llm Merge branch 'litellm_dev_sameer_16_march_week' into litellm_file-search-emulated-alignment 2026-03-20 16:37:15 +05:30
baseten style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
bedrock Merge pull request #24076 from Chesars/feat/cache-control-tool-config-21969 2026-03-20 23:29:53 -03:00
bedrock_mantle/chat feat(provider): add Amazon Bedrock Mantle as a first-class provider 2026-03-05 00:03:40 -05:00
black_forest_labs [Feat] - Ishaan main merge branch (#23596) 2026-03-14 09:40:00 -07:00
brave/search fix(mypy): fix scattered 1-off type errors across 14 files 2026-03-13 00:08:57 +00:00
bytez style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
cerebras fix: add reasoning param support for GPT OSS cerebras 2026-02-02 17:20:04 +05:30
chatgpt style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
clarifai/chat style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
cloudflare/chat
codestral/completion fix(types): remove StreamingChoices from ModelResponse, use ModelResponseStream 2026-02-20 17:47:42 -03:00
cohere style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
cometapi style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
compactifai style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
custom_httpx [Staging] - Ishaan March 17th (#23903) 2026-03-18 15:09:01 -07:00
dashscope fix: remove list-to-str transformation from dashscope 2026-02-19 07:30:13 +00:00
databricks style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
dataforseo/search style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
datarobot/chat Updated URL handling for DataRobot provider base 2025-08-21 19:42:46 -06:00
deepgram fix mypy lint 2025-11-03 18:02:19 -08:00
deepinfra style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
deepseek feat(deepseek): add native support for thinking and reasoning_effort params (#17712) 2025-12-11 15:28:43 -08:00
deprecated_providers fix(mypy): resolve type checking errors in 5 files (#20627) 2026-02-06 18:34:55 -08:00
docker_model_runner/chat style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
duckduckgo/search style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
elevenlabs style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
empower/chat
exa_ai/search style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
fal_ai style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
featherless_ai/chat fix(featherless_ai): use correct FEATHERLESS_AI_API_KEY env var name 2026-03-01 17:11:58 +01:00
firecrawl style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
fireworks_ai fix(fireworks): skip #transform=inline for base64 data URLs (#23729) 2026-03-16 22:30:18 -07:00
friendliai/chat
galadriel/chat
gemini fix: apply Black formatting to 7 files 2026-03-21 14:51:15 -07:00
gigachat style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
github/chat
github_copilot style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
google_pse/search style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
gradient_ai/chat style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
groq Add grok reasoning content 2026-01-27 16:34:57 +05:30
heroku/chat style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
hosted_vllm style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
huggingface style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
hyperbolic Revert "Litellm dev 07 21 2025 p1 (#12848)" 2025-07-22 18:28:36 -07:00
infinity style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
jina_ai style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
lambda_ai style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
langgraph style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
lemonade style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
linkup style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
litellm_proxy Root cause fix - migrate all logging update to use 1 function - for centralized kwarg updates (#23659) 2026-03-15 23:21:01 -07:00
llamafile/chat style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
lm_studio style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
manus style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
meta_llama/chat [Feat] Enable Tool Calling for meta_llama (#11895) 2025-06-19 13:44:22 -07:00
milvus/vector_stores docs: document milvus endpoints 2025-11-01 12:17:02 -07:00
minimax style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
mistral Merge pull request #23818 from BerriAI/litellm_oss_staging_03_17_2026 2026-03-21 14:54:39 -07:00
moonshot/chat Apply Black formatting to 11 files 2026-03-21 15:05:53 -07:00
morph fix morph api tests 2025-07-22 18:44:44 -07:00
nebius
nlp_cloud
novita/chat
nscale/chat
nvidia_nim style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
oci style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
ollama style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
oobabooga
openai Apply Black formatting to 11 files 2026-03-21 15:05:53 -07:00
openai_like style: run black formatter on 52 non-enterprise files 2026-03-12 14:23:50 -03:00
openrouter style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
ovhcloud Apply Black formatting to 11 files 2026-03-21 15:05:53 -07:00
parallel_ai/search style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
pass_through Feature/guardrail model argument (#19619) 2026-01-23 20:48:42 -08:00
perplexity [Feat] - Ishaan main merge branch (#23596) 2026-03-14 09:40:00 -07:00
petals
pg_vector/vector_stores style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
predibase
ragflow style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
recraft style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
replicate style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
runwayml [Staging] - Ishaan March 17th (#23903) 2026-03-18 15:09:01 -07:00
s3_vectors style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
sagemaker [Staging] - Ishaan March 17th (#23903) 2026-03-18 15:09:01 -07:00
sambanova style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
sap style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
searchapi style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
searxng style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
serper/search style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
snowflake merge: resolve conflicts between main and litellm_oss_staging_03_11_2026 2026-03-12 09:38:31 -03:00
stability style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
tavily/search style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
together_ai [Refactor#2] litellm/init – Lazy-load utils to reduce memory + import time (#17171) 2025-12-03 11:40:16 -08:00
topaz
triton
v0 style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
vercel_ai_gateway style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
vertex_ai Merge remote-tracking branch 'origin/main' into litellm_dev_sameer_16_march_week 2026-03-21 15:11:29 -07:00
vllm fix vllm passthrough 2025-09-22 10:09:02 -03:00
volcengine style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
voyage style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
wandb (feat): Add W&B Inference to LiteLLM 2025-09-11 00:07:30 +05:30
watsonx style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
xai style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
xinference/image_generation [Feat] Add XInference Image Generation API Provider (#12439) 2025-07-08 21:17:38 -07:00
zai style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
__init__.py fix: move code from litellm/llms to the mcp_server dir 2026-01-05 12:05:16 +09:00
base.py
custom_llm.py Fix mypy issues 2026-01-16 14:47:56 +05:30
maritalk.py
README.md

File Structure

August 27th, 2024

To make it easy to see how calls are transformed for each model/provider:

we are working on moving all supported litellm providers to a folder structure, where folder name is the supported litellm provider name.

Each folder will contain a *_transformation.py file, which has all the request/response transformation logic, making it easy to see how calls are modified.

E.g. cohere/, bedrock/.