scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-13 23:11:40 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 101
litellm/litellm/llms
History
Exact
Shivam Rawat bb90565092 fix(bedrock): honor ttl for tool_config cache injection points (#31929) 
Backport of #31929 to stable/1.90.x.
Cherry-picked from 1543725916 (litellm_internal_staging).

Deviations from the upstream squash, needed because the line predates some
staging-only state:
- model_prices JSON churn reduced to its semantic content: drop the stale
  1h-TTL pricing keys from the two Claude 3.5 Sonnet Bedrock entries and add
  supports_parallel_tool_use_config to the flagged entries. 6 of the 58
  flagged entries (*.anthropic.claude-sonnet-5) do not exist on this line and
  were skipped
- ported the local_model_cost_map fixture into
  test_anthropic_claude3_transformation.py (added upstream by an earlier
  staging commit that never reached this line)
- test_parallel_tool_calls_config_kept_for_sonnet_5 renamed and pointed at
  anthropic.claude-sonnet-4-6, since sonnet-5 has no entry on this line
- test_parallel_tool_calls_newer_model_adds_disable_flag now forces the
  bundled cost map so it does not depend on the remote map having synced the
  new flag
- ruff-strict-budget.json kept at the line's schema (no change needed)
2026-07-02 21:22:01 -07:00
..
a2a style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
ai21/chat
aiml style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
aiohttp_openai/chat
amazon_nova style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
anthropic chore: litellm oss staging (#30745) 2026-06-18 13:55:35 -07:00
apiserpent Litellm oss staging (#29492) 2026-06-02 08:48:10 -07:00
aws_polly style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
azure ci(lint): add blanket-noqa, dataclass-default, and unused-noqa Ruff rules (#30516) 2026-06-16 12:07:22 -07:00
azure_ai feat(azure_ai): add MAI-Image-2.5 image generation support (#29688) 2026-06-08 18:27:04 -07:00
base_llm fix(vertex/files): stream OpenAI->Vertex batch JSONL uploads (#31036) 2026-06-29 17:56:01 -07:00
baseten style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
bedrock fix(bedrock): honor ttl for tool_config cache injection points (#31929) 2026-07-02 21:22:01 -07:00
bedrock_mantle chore: litellm oss staging (#30745) 2026-06-18 13:55:35 -07:00
black_forest_labs Litellm OSS Staging 010626 (#29422) 2026-06-01 21:42:51 -07:00
brave/search fix(mypy): fix scattered 1-off type errors across 14 files 2026-03-13 00:08:57 +00:00
bytez ci(lint): add blanket-noqa, dataclass-default, and unused-noqa Ruff rules (#30516) 2026-06-16 12:07:22 -07:00
cerebras fix: add reasoning param support for GPT OSS cerebras 2026-02-02 17:20:04 +05:30
chatgpt Litellm oss staging 04 21 2026 2 (#26569) 2026-05-20 21:25:19 -07:00
clarifai/chat style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
cloudflare/chat Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_oss_staging_04_25_2026 2026-05-02 06:04:39 +00:00
codestral/completion fix(types): remove StreamingChoices from ModelResponse, use ModelResponseStream 2026-02-20 17:47:42 -03:00
cohere Litellm oss staging 050626 (#29774) 2026-06-05 13:51:51 -07:00
cometapi style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
compactifai style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
custom_httpx fix(realtime): stop second Gemini Live setup, retry hung handshake, close guardrail bypass (#31519) 2026-06-30 18:37:14 -07:00
dashscope build(deps-dev): bump black to 26.3.1 and apply formatting (#28525) 2026-05-21 17:24:18 -07:00
databricks [internal copy of #28007] Fix/gcp model garden streaming (#28363) 2026-06-10 12:31:00 -07:00
dataforseo/search style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
datarobot/chat build(deps-dev): bump black to 26.3.1 and apply formatting (#28525) 2026-05-21 17:24:18 -07:00
deepgram
deepinfra build(deps-dev): bump black to 26.3.1 and apply formatting (#28525) 2026-05-21 17:24:18 -07:00
deepseek Litellm oss staging 080626 (#29932) 2026-06-08 13:49:52 -07:00
deprecated_providers style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
docker_model_runner/chat style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
duckduckgo/search style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
e2b feat(sandbox): e2b code execution primitive (#30898) 2026-06-20 16:30:01 -07:00
elevenlabs build(deps-dev): bump black to 26.3.1 and apply formatting (#28525) 2026-05-21 17:24:18 -07:00
empower/chat
exa_ai/search style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
fal_ai feat(fal_ai): add Nano Banana / Gemini 2.5 Flash Image generation support (#29798) 2026-06-06 11:16:44 -07:00
fastcrw chore(oss): litellm oss staging 150626 (#30463) 2026-06-16 12:06:41 -07:00
featherless_ai/chat fix(featherless_ai): use correct FEATHERLESS_AI_API_KEY env var name 2026-03-01 17:11:58 +01:00
firecrawl style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
fireworks_ai chore: litellm oss 170626 (#30637) 2026-06-17 21:11:12 -07:00
friendliai/chat
galadriel/chat
gemini fix(realtime): stop second Gemini Live setup, retry hung handshake, close guardrail bypass (#31519) 2026-06-30 18:37:14 -07:00
gigachat style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
github/chat
github_copilot feat: litellm oss 110626 (#30202) 2026-06-11 22:30:26 -07:00
google_pse/search style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
gradient_ai/chat style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
groq style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
heroku/chat style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
hosted_vllm ci: drop mypy entirely, standardize type checking on basedpyright (#30648) 2026-06-17 09:42:00 -07:00
huggingface chore(lint): remove PLR0915 too-many-statements ruff rule (#30574) 2026-06-16 16:52:49 -07:00
hyperbolic
inception Litellm oss staging 030626 (#29578) 2026-06-03 11:01:51 -07:00
infinity build(deps-dev): bump black to 26.3.1 and apply formatting (#28525) 2026-05-21 17:24:18 -07:00
jina_ai build(deps-dev): bump black to 26.3.1 and apply formatting (#28525) 2026-05-21 17:24:18 -07:00
lambda_ai style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
langflow feat(agents): add LangFlow agent provider with A2A session bridging (#28963) 2026-06-02 14:45:56 -07:00
langgraph feat(a2a): well-known agent-card discovery + LangGraph Platform mode (#28860) 2026-05-29 20:50:42 -07:00
lemonade Litellm OSS Staging (#29161) 2026-06-01 21:22:35 -07:00
linkup style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
litellm_proxy Litellm oss 090626 (#30021) 2026-06-10 10:34:07 -07:00
llamafile/chat style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
lm_studio build(deps-dev): bump black to 26.3.1 and apply formatting (#28525) 2026-05-21 17:24:18 -07:00
manus fix: encode upstream URL path identifiers 2026-04-29 22:02:39 -07:00
meta_llama/chat
milvus/vector_stores fix: drop milvus dbName and partitionNames from MILVUS_OPTIONAL_PARAMS 2026-04-30 11:51:32 -07:00
minimax Litellm oss staging 080626 (#29932) 2026-06-08 13:49:52 -07:00
mistral Merge pull request #25256 from BerriAI/litellm_ishaan_april6 2026-04-17 16:26:45 -07:00
modelscope chore(oss): litellm oss staging 150626 (#30463) 2026-06-16 12:06:41 -07:00
moonshot/chat Litellm oss staging 050626 (#29774) 2026-06-05 13:51:51 -07:00
morph
nebius
nlp_cloud
novita/chat build(deps-dev): bump black to 26.3.1 and apply formatting (#28525) 2026-05-21 17:24:18 -07:00
nscale/chat
nvidia_nim build(deps-dev): bump black to 26.3.1 and apply formatting (#28525) 2026-05-21 17:24:18 -07:00
nvidia_riva feat(audio_transcription): add NVIDIA Riva STT provider (#27185) 2026-05-05 17:17:51 -07:00
oci feat: litellm oss 110626 (#30202) 2026-06-11 22:30:26 -07:00
ollama Litellm OSS Staging (#29161) 2026-06-01 21:22:35 -07:00
oobabooga
openai chore: litellm oss 170626 (#30637) 2026-06-17 21:11:12 -07:00
openai_like chore: litellm oss staging (#30745) 2026-06-18 13:55:35 -07:00
openrouter chore: litellm oss staging160626 (#30527) 2026-06-16 18:23:13 -07:00
ovhcloud fix(ovhcloud): remove dead transform_response override, parent already handles non-streaming via _extract_reasoning_content 2026-04-28 23:19:13 +05:30
parallel_ai/search feat: litellm oss 110626 (#30202) 2026-06-11 22:30:26 -07:00
pass_through feat(proxy): enforce key/team guardrails on bedrock passthrough routes (#30194) 2026-06-12 07:23:29 -07:00
perplexity chore: litellm oss 170626 (#30637) 2026-06-17 21:11:12 -07:00
petals style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
pg_vector/vector_stores fix: encode upstream URL path identifiers 2026-04-29 22:02:39 -07:00
predibase chore(lint): remove PLR0915 too-many-statements ruff rule (#30574) 2026-06-16 16:52:49 -07:00
ragflow fix: encode upstream URL path identifiers 2026-04-29 22:02:39 -07:00
recraft fix(image_edit): forward litellm_params to validate_environment for Vertex AI credentials 2026-04-21 14:54:18 +05:30
reducto Litellm oss staging 04 21 2026 2 (#26569) 2026-05-20 21:25:19 -07:00
replicate style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
runwayml fix(vertex-ai): use DB credentials in video handlers + implement Veo video edit (#29098) 2026-05-28 11:45:41 -07:00
s3_vectors Fix extra body error 2026-04-29 08:34:31 +05:30
sagemaker ci(lint): add blanket-noqa, dataclass-default, and unused-noqa Ruff rules (#30516) 2026-06-16 12:07:22 -07:00
sambanova style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
sap build(deps-dev): bump black to 26.3.1 and apply formatting (#28525) 2026-05-21 17:24:18 -07:00
scaleway/audio_transcription Feature/add audio support for scaleway (#26110) 2026-04-20 14:49:41 -07:00
searchapi style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
searxng style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
serper/search style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
snowflake chore(oss): litellm oss staging 120626 (#30292) 2026-06-12 09:49:25 -07:00
soniox Litellm oss staging 050626 (#29774) 2026-06-05 13:51:51 -07:00
stability fix(image_edit): forward litellm_params to validate_environment for Vertex AI credentials 2026-04-21 14:54:18 +05:30
tavily/search style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
tinyfish/search feat(search): add TinyFish as search provider (#30634) 2026-06-18 09:17:53 -07:00
together_ai build(deps-dev): bump black to 26.3.1 and apply formatting (#28525) 2026-05-21 17:24:18 -07:00
topaz
triton feat(triton): add embedding usage estimation for self-hosted responses (#25345) 2026-04-08 21:14:27 -07:00
v0 style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
vercel_ai_gateway style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
vertex_ai fix(vertex_ai/files): single media upload for batch files to fix 499s on large uploads (#31653) 2026-06-29 18:10:47 -07:00
vllm build(deps-dev): bump black to 26.3.1 and apply formatting (#28525) 2026-05-21 17:24:18 -07:00
volcengine fix: encode upstream URL path identifiers 2026-04-29 22:02:39 -07:00
voyage chore(oss): litellm oss staging 120626 (#30292) 2026-06-12 09:49:25 -07:00
wandb
watsonx fix(watsonx): wrap string embedding input in array for WatsonX API (#30897) 2026-06-20 15:50:44 -07:00
xai Litellm oss 090626 (#30021) 2026-06-10 10:34:07 -07:00
xinference/image_generation
you_com Litellm oss staging 050626 (#29774) 2026-06-05 13:51:51 -07:00
zai style: run black formatter on entire codebase 2026-03-11 17:07:57 -03:00
__init__.py Litellm oss staging 04 02 2026 p1 (#25055) 2026-04-08 21:37:10 -07:00
base.py
custom_llm.py Fix mypy issues 2026-01-16 14:47:56 +05:30
maritalk.py
README.md

README.md

File Structure

August 27th, 2024

To make it easy to see how calls are transformed for each model/provider:

we are working on moving all supported litellm providers to a folder structure, where folder name is the supported litellm provider name.

Each folder will contain a *_transformation.py file, which has all the request/response transformation logic, making it easy to see how calls are modified.

E.g. cohere/, bedrock/.