Where should I start learning AI infrastructure and model serving?
I want to learn how to serve models and understand things like KV caches, vLLM, and GPU scheduling. Is there a sensible order to learn this stuff?
I want to learn how to serve models and understand things like KV caches, vLLM, and GPU scheduling. Is there a sensible order to learn this stuff?
I'm interested in deploying an OCR model found on Hugging Face (specifically, the rednote-hilab/dots.ocr model). I have experience using Sagemaker Realtime endpoints, but I've found them to be…