I'm planning to build a computer specifically to run a local LLM using Proxmox and Ollama, and I'd like to get your thoughts on my specs. The main goal is to control my smart home through the LLM, hooked up to Home Assistant. Here's what I'm considering for my build:
- AMD Ryzen 5 7600
- Noctua NH-L9a-AM5 chromax.black CPU cooler
- ASRock B650I Lightning WiFi (Mini-ITX) motherboard
- Nvidia 3080Ti Founders Edition GPU (already owned, currently in my gaming PC)
- Cooler Master NR200P case
- 32GB (2x16GB) G.Skill Flare X5 DDR5-6000 CL30 EXPO memory
- Western Digital Black SN770 1TB NVMe M.2 PCIe 4.0 SSD
- Corsair SF850L 850W SFX-L 80+ Gold power supply
- 2x Noctua NF-A12x15 PWM chromax.black (120mm slim fans)
My question is whether the 850W power supply is necessary, or if it might be overkill for this setup. Since the primary focus will be on the GPU performance for running the LLM, I'm also curious about the overall suitability of these specs for my intended use.
2 Answers
Running local models can be pretty demanding on VRAM, and your setup looks solid overall. The 850W power supply is actually a good choice for the Nvidia 3080Ti, especially considering future upgrades or running additional services over time. You'll likely need that headroom to ensure everything runs smoothly. Plus, it gives you flexibility for any expansion later on.
You're spot on about the GPUs needing sufficient VRAM for performance. The 3080Ti has 12GB which is decent and should let you run several models without running into issues. If you are careful not to run models that require too much RAM, you should be good. So yeah, the 850W is definitely safe and not really overkill in this case.
Related Questions
Lenovo Thinkpad Stuck In Update Loop Install FilterDriverU2_Reload