diff --git a/docs/my-website/docs/completion/supported.md b/docs/my-website/docs/completion/supported.md index 750c98ef58e..052e56a28d7 100644 --- a/docs/my-website/docs/completion/supported.md +++ b/docs/my-website/docs/completion/supported.md @@ -137,7 +137,7 @@ Example TogetherAI Usage - Note: liteLLM supports all models deployed on Togethe ### AWS Sagemaker Models https://aws.amazon.com/sagemaker/ Use liteLLM to easily call custom LLMs on Sagemaker -### Requirements using Sagemaker with LiteLLM +#### Requirements using Sagemaker with LiteLLM * `pip install boto3` * Set the following AWS credentials as .env variables (Sagemaker auth: https://boto3.amazonaws.com/v1/documentation/api/latest/guide/credentials.html) @@ -149,6 +149,7 @@ https://aws.amazon.com/sagemaker/ Use liteLLM to easily call custom LLMs on Sage | Model Name | Function Call | Required OS Variables | |------------------|--------------------------------------------|------------------------------------| | Llama2 7B | `completion(model='sagemaker/jumpstart-dft-meta-textgeneration-llama-2-7b, messages=messages)` | `os.environ['AWS_ACCESS_KEY_ID']`, `os.environ['AWS_SECRET_ACCESS_KEY']`, `os.environ['AWS_REGION_NAME']` | +| Custom LLM Endpoint | `completion(model='sagemaker/your-endpoint, messages=messages)` | `os.environ['AWS_ACCESS_KEY_ID']`, `os.environ['AWS_SECRET_ACCESS_KEY']`, `os.environ['AWS_REGION_NAME']` | ### Baseten Models Baseten provides infrastructure to deploy and serve ML models https://www.baseten.co/. Use liteLLM to easily call models deployed on Baseten. diff --git a/litellm/tests/test_completion.py b/litellm/tests/test_completion.py index c0ed591d9e5..566b47fa071 100644 --- a/litellm/tests/test_completion.py +++ b/litellm/tests/test_completion.py @@ -404,8 +404,6 @@ def test_completion_sagemaker(): print(response) except Exception as e: pytest.fail(f"Error occurred: {e}") -test_completion_sagemaker() - # def test_vertex_ai(): # model_name = "chat-bison"