Hi team, how to deploy multiple hugging face models for inference on a single aws sagemaker endpoint? Actually I have a AWS lambda from which I’m invoking the endpoints, I’ve 3 endpoints but I want them into single AWS endpoint to save my AWS billing amount, I’m finding article but did not find an…

Sagemaker multimodel endpoint

crajah February 2, 2023, 9:42am 2

Topic		Replies	Views
Aws sagemaker multimodel endpoint Amazon SageMaker	1	974	February 2, 2023
Getting "No worker is available to serve request: model" with HuggingFaceModel endpoint Amazon SageMaker	13	5256	March 22, 2022
About the Amazon SageMaker category Amazon SageMaker	25	4285	August 5, 2021
Serverless endpoint deployment with Terraform Amazon SageMaker	3	1709	November 2, 2022
Creating Sagemaker Endpoint for 2 models (Segment Anything & YOLOv8) and Invoking it Amazon SageMaker	0	433	January 6, 2024