How do you make intentionally idle GPUs accountable?
We spent about two weeks making our GPU utilization metrics trustworthy by enabling DCGM profiling counters and correcting which workloads the measurements were attributed to. The result was…
capacity management
How to Temporarily Stop Traffic to a WebSocket Instance?
I'm managing a service with long-lived WebSocket connections, and I'm facing a challenge. Once I reach my configured capacity, I'd like to stop my Application Load Balancer (ALB)…