scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-06 02:48:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 103
litellm/tests/test_litellm/llms/sagemaker
History
Exact
jymmi 33d4b93bee
fix(sagemaker): Add role assumption support for embedding endpoint (#20435) 
The SageMaker embedding handler was not using _load_credentials(),
which meant aws_role_name and aws_session_name parameters were
ignored. This prevented cross-account role assumption for embeddings
while it worked for completions.

Changes:
- Replace direct boto3 client creation with _load_credentials() call
- Create boto3.Session with assumed credentials
- Add comprehensive unit tests for role assumption

This aligns the embedding handler behavior with the completion handler,
which already supports role assumption via the BaseAWSLLM.get_credentials()
method.

Fixes cross-account SageMaker embedding access where users need to
assume a role in another account to invoke endpoints.
2026-03-09 20:58:14 -07:00
..
test_sagemaker_common_utils.py Litellm fix GitHub action testing (#11163) 2025-05-26 14:41:42 -07:00
test_sagemaker_embedding_role_assumption.py fix(sagemaker): Add role assumption support for embedding endpoint (#20435) 2026-03-09 20:58:14 -07:00
test_sagemaker_embedding_voyage.py fix(sagemaker): Support TEI raw array response format for embeddings (#20487) 2026-02-12 19:39:05 +05:30