mirror of
https://github.com/BerriAI/litellm.git
synced 2026-11-05 07:37:50 +00:00
c6fc5b01bb
* fix(bedrock): send batch jobs to a configured control-plane endpoint
Bedrock batch create, retrieve and cancel always built the regional
bedrock.{region} host, so a VPC endpoint or compatible gateway could not
be used. Add aws_bedrock_control_plane_endpoint as a deployment setting
read by the signed HTTP path and the boto3 path, carry it through the
proxy credential filter, and refuse it in request bodies like the other
endpoint overrides. api_base stays out of it because on a Bedrock
deployment it points at the runtime host.
Fixes #45056
* fix(bedrock): read the control-plane endpoint from typed kwargs in job status
The named parameter added one unknown-argument error in litellm/batches/main.py,
which unpacks untyped kwargs into this function
* docs(bedrock): explain batch control-plane endpoint configuration
* fix(bedrock): keep the batch control-plane endpoint out of chat request bodies
A deployment that sets aws_bedrock_control_plane_endpoint also serves chat,
and the unregistered key was swept into the Bedrock request body, so every
chat call on it failed with "Extra inputs are not permitted". Register it
with the other Bedrock batch connection fields so it stays a LiteLLM-owned
kwarg on every route while batches still read it from litellm_params.
* test(bedrock): verify endpoint signatures without internal mocks
---------
Co-authored-by: mateo-berri <277851410+mateo-berri@users.noreply.github.com>
|
||
|---|---|---|
| .. | ||
| ai_coding_tool_guides | ||
| anthropic_agent_sdk | ||
| benchmark | ||
| codellama-server | ||
| community-resources | ||
| gollem_go_agent_framework | ||
| litellm-ollama-docker-image | ||
| litellm_proxy_server | ||
| litellm_router | ||
| litellm_router_load_test | ||
| livekit_agent_sdk | ||
| logging_observability | ||
| misc | ||
| mock_guardrail_server | ||
| mock_prompt_management_server | ||
| Benchmarking_LLMs_by_use_case.ipynb | ||
| Claude_(Anthropic)_with_Streaming_liteLLM_Examples.ipynb | ||
| Evaluating_LLMs.ipynb | ||
| google_adk_litellm_tutorial.ipynb | ||
| liteLLM_A121_Jurrasic_example.ipynb | ||
| LiteLLM_Azure_and_OpenAI_example.ipynb | ||
| liteLLM_Baseten.ipynb | ||
| LiteLLM_batch_completion.ipynb | ||
| LiteLLM_Bedrock.ipynb | ||
| liteLLM_clarifai_Demo.ipynb | ||
| LiteLLM_CometAPI.ipynb | ||
| LiteLLM_Comparing_LLMs.ipynb | ||
| LiteLLM_Completion_Cost.ipynb | ||
| liteLLM_function_calling.ipynb | ||
| liteLLM_Getting_Started.ipynb | ||
| LiteLLM_HuggingFace.ipynb | ||
| liteLLM_IBM_Watsonx.ipynb | ||
| liteLLM_Langchain_Demo.ipynb | ||
| litellm_model_fallback.ipynb | ||
| LiteLLM_NovitaAI_Cookbook.ipynb | ||
| liteLLM_Ollama.ipynb | ||
| LiteLLM_OpenRouter.ipynb | ||
| LiteLLM_Petals.ipynb | ||
| LiteLLM_PromptLayer.ipynb | ||
| liteLLM_Replicate_Demo.ipynb | ||
| liteLLM_Streaming_Demo.ipynb | ||
| litellm_test_multiple_llm_demo.ipynb | ||
| litellm_Test_Multiple_Providers.ipynb | ||
| LiteLLM_User_Based_Rate_Limits.ipynb | ||
| liteLLM_VertextAI_Example.ipynb | ||
| Migrating_to_LiteLLM_Proxy_from_OpenAI_Azure_OpenAI.ipynb | ||
| mlflow_langchain_tracing_litellm_proxy.ipynb | ||
| nova_sonic_realtime.py | ||
| Parallel_function_calling.ipynb | ||
| Proxy_Batch_Users.ipynb | ||
| result.html | ||
| TogetherAI_liteLLM.ipynb | ||
| Using_Nemo_Guardrails_with_LiteLLM_Server.ipynb | ||
| veo_video_generation.py | ||
| VLLM_Model_Testing.ipynb | ||