Would you use Lambda's GPU instances for inference?
AWS has added G-series GPU instances to Lambda Managed Instances for inference and other workloads. Where would this fit compared with Bedrock, SageMaker endpoints, or GPUs on ECS…
AWS has added G-series GPU instances to Lambda Managed Instances for inference and other workloads. Where would this fit compared with Bedrock, SageMaker endpoints, or GPUs on ECS…
I'm working with a small team on large language model inference using AWS, but we're struggling with frequent spot instance interruptions. We've tried various solutions like capacity-optimized ASGs…