scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-06 08:16:43 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 79
litellm/litellm/llms
History
Mateo Wang b52b5d9421
Merge pull request #38734 from BerriAI/litellm_fix_bedrock_buffered_responses_stream 
fix(bedrock): route streamed responses-API output through the unified guardrail
2026-09-01 14:44:41 -07:00
..
a2a refactor(types): replace Any with precise types across 73 modules 2026-09-01 11:05:02 +00:00
ai21/chat feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
aiml refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
aiohttp_openai/chat refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
amazon_nova refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
anthropic fix(anthropic): use native structured output for claude-fable-5-1 on Vertex AI and Bedrock Invoke 2026-09-01 20:01:03 +00:00
apiserpent feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
aws_polly fix(aws): build every AWS endpoint and ARN from the region partition 2026-08-29 01:21:59 -07:00
azure Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_fix_azure_chat_anyof_tool_schema 2026-09-01 13:59:59 -07:00
azure_ai refactor(types): replace Any with precise types across 73 modules 2026-09-01 11:05:02 +00:00
base_llm Merge pull request #38985 from BerriAI/litellm_fix_ocr_annotation_page_cost 2026-09-01 10:13:01 -07:00
baseten feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
bedrock fix(bedrock): use tool fallback without forced tool_choice for claude-fable-5-1 structured output 2026-09-01 20:19:46 +00:00
bedrock_mantle chore(typing): clear fresh tech debt from the Aug 25 window 2026-08-26 07:55:16 +00:00
black_forest_labs refactor(types): replace Any with precise types across 73 modules 2026-09-01 11:05:02 +00:00
brave/search chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
bytez refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
cerebras fix(cerebras): add max_retries and extra_headers to get_supported_openai_params (#36601) 2026-08-25 14:10:56 -07:00
chatgpt Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5 2026-08-29 06:37:10 -07:00
clarifai/chat refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
cloudflare/chat feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
codestral/completion refactor(types): replace Any with precise types across 73 modules 2026-09-01 11:05:02 +00:00
cohere refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
cometapi refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
compactifai Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5 2026-08-29 06:37:10 -07:00
custom_httpx Merge branch 'litellm_internal_staging' into litellm_decrease_anys_opus5 2026-08-29 21:41:04 -07:00
dashscope refactor(dashscope): wrap long error message strings in common_utils 2026-09-01 11:34:23 -07:00
databricks Merge branch 'litellm_internal_staging' into fix_databricks_oauth_url 2026-08-29 07:00:58 -07:00
dataforseo/search feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
datarobot/chat chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
deepgram feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
deepinfra refactor(types): replace Any with precise types across 73 modules 2026-09-01 11:05:02 +00:00
deepseek fix: collapse image_url blocks whose payload lacks a url instead of forwarding them 2026-08-26 13:19:06 -07:00
deprecated_providers chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
docker_model_runner/chat chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
duckduckgo/search feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
e2b Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5 2026-08-29 06:03:33 -07:00
elevenlabs chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
empower/chat LiteLLM Common Base LLM Config (pt.3): Move all OAI compatible providers to base llm config (#7148) 2024-12-10 17:12:42 -08:00
exa_ai/search feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
fal_ai refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
fastcrw feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
featherless_ai/chat feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
firecrawl feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
fireworks_ai Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5_0826 2026-08-27 10:39:56 +00:00
friendliai/chat (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
galadriel/chat (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
gdc chore(typing): clear 1.5k basedpyright Any errors across 54 files 2026-08-21 05:25:22 +00:00
gemini refactor(types): replace Any with precise types across 73 modules 2026-09-01 11:05:02 +00:00
gigachat fix(gigachat): fold cached tokens back into prompt and total token counts 2026-08-31 15:16:44 -07:00
github/chat (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
github_copilot refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
google_pse/search feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
gradient_ai/chat feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
groq refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
heroku/chat refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
hosted_vllm test(embeddings): move legacy intercepts to the wire for the omitted-format path 2026-08-29 12:04:44 -07:00
huggingface refactor(types): replace Any with precise types across 73 modules 2026-09-01 11:05:02 +00:00
hyperbolic chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
inception chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
infinity Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5 2026-08-29 06:03:33 -07:00
jina_ai Merge origin/litellm_internal_staging into litellm_azure_ai_entra_auth 2026-08-24 11:33:18 -07:00
lambda_ai chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
langflow refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
langgraph refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
lemonade refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
linkup feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
litellm_proxy Merge branch 'litellm_internal_staging' into litellm_decrease_anys_opus5_r2 2026-08-30 12:16:13 -07:00
llamafile/chat chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
lm_studio chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
manus feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
meta_llama/chat feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
milvus/vector_stores feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
minimax fix(minimax): attach MINIMAX_API_KEY on anthropic messages requests 2026-08-26 12:19:37 -07:00
mistral Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5_0826 2026-08-29 03:29:39 -07:00
modelscope chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
moonshot/chat fix(moonshot, together_ai): send the reasoning effort Kimi K3 accepts (#38611) 2026-08-27 20:46:46 -07:00
morph feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
nebius feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
nimble feat(search): add Nimble as a search provider (#36347) 2026-08-14 17:09:58 -07:00
nlp_cloud refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
novita/chat refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets 2026-08-01 15:43:29 -07:00
nscale/chat feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
nvidia_nim Merge origin/litellm_internal_staging into litellm_azure_ai_entra_auth 2026-08-24 11:33:18 -07:00
nvidia_riva refactor(types): replace Any with real types across 54 more backend files 2026-08-29 19:00:43 +00:00
oci Merge branch 'litellm_internal_staging' of https://github.com/BerriAI/litellm into litellm_decrease_anys_opus5_r2 2026-08-31 16:12:29 -07:00
ollama Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5 2026-08-29 06:37:10 -07:00
oobabooga refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
openai Merge pull request #38734 from BerriAI/litellm_fix_bedrock_buffered_responses_stream 2026-09-01 14:44:41 -07:00
openai_like refactor(types): replace Any with precise types across 73 modules 2026-09-01 11:05:02 +00:00
openrouter refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
opensandbox Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5 2026-08-29 06:03:33 -07:00
ovhcloud feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
parallel_ai/search feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
pass_through feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
perplexity refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
petals refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
pg_vector/vector_stores feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
predibase chore(typing): clear 1.6k basedpyright Any errors across 56 files 2026-08-11 06:47:39 -07:00
ragflow feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
recraft refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
reducto refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
replicate refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
runwayml refactor(types): replace Any with precise types across 73 modules 2026-09-01 11:05:02 +00:00
s3_vectors feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
sagemaker Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5_0826 2026-08-29 04:18:02 -07:00
sambanova feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
sap refactor(types): replace Any with precise types across 73 modules 2026-09-01 11:05:02 +00:00
scaleway/audio_transcription feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
searchapi feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
searxng feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
serper/search feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
snowflake chore(typing): drop 1.3k basedpyright errors across 42 Any hotspot files 2026-08-19 01:12:41 +00:00
soniox Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_soniox_srt_cue_grouping 2026-08-29 12:02:21 -07:00
stability refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
tavily/search feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
tencent fix(tencent): satisfy basedpyright budget in thinking mapping 2026-08-24 18:41:50 -03:00
tinyfish/search fix(tinyfish): keep hidden-params header stashing within lint budgets 2026-08-18 13:37:03 -07:00
together_ai fix(moonshot, together_ai): send the reasoning effort Kimi K3 accepts (#38611) 2026-08-27 20:46:46 -07:00
topaz refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
triton refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
v0 chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
valkey feat(vector_stores): add Valkey as a managed vector store provider (#37002) 2026-08-18 21:45:22 +00:00
vercel_ai_gateway feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
vertex_ai fix(anthropic): use native structured output for claude-fable-5-1 on Vertex AI and Bedrock Invoke 2026-09-01 20:01:03 +00:00
vllm chore(lint): strip inert type: ignore comments and zero LIT009, LIT010, LIT011 headroom 2026-08-05 02:37:24 -07:00
volcengine chore(lint): remove litellm/types from the ruff lint exclusion 2026-08-05 01:10:15 -07:00
voyage Merge origin/litellm_internal_staging into litellm_azure_ai_entra_auth 2026-08-24 11:33:18 -07:00
wandb feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
watsonx refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
xai refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
xinference/image_generation feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
you_com feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
zai feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
__init__.py fix(gemini): bill Google Maps grounding as its own SKU 2026-08-26 15:31:27 -07:00
base.py refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
custom_llm.py refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
maritalk.py feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) 2026-08-04 12:54:39 -07:00
README.md LiteLLM Minor Fixes and Improvements (09/13/2024) (#5689) 2024-09-14 10:02:55 -07:00

README.md

File Structure

August 27th, 2024

To make it easy to see how calls are transformed for each model/provider:

we are working on moving all supported litellm providers to a folder structure, where folder name is the supported litellm provider name.

Each folder will contain a *_transformation.py file, which has all the request/response transformation logic, making it easy to see how calls are modified.

E.g. cohere/, bedrock/.