Amazon SageMaker HyperPod now supports model caching for faster inference autoscaling and reduced cold starts
Amazon SageMaker HyperPod now supports model caching, an inference optimization that pre-loads model weights and container images onto cluster nodes so pods start ...
