Hey everyone! I've been a Macbook user my whole life, but as a software engineer, I'm really eager to build my own PC for running some local AI models, specifically large language models (LLMs) during my weekends. Here's my proposed build, and I'd love to hear any feedback or suggestions you might have. Thanks a lot!
2 Answers
Your build looks promising! If you're aiming for a more modern setup, consider something like this build: [Link to alternative build]. It features an Intel 12600K, which is a superior platform. I also switched up the cooler to the latest version from Thermalright. You might want to get 64GB of RAM for better training capabilities; plus, DDR5 is now cheaper than the DDR4 option you picked. The SSD you chose seems overpriced; I've suggested a more cost-effective 4TB option for similar pricing. Also, I upgraded the PSU to 1050W since you’re planning on using a 3090. Hope this helps!
I’d recommend switching to the AM5 platform and looking at something like the Ryzen 7600 instead. There’s really not much reason to stick with AM4 anymore. Your parts look solid for running LLMs, but are you only running inference, or planning to do training as well?
Right now, I'm just doing inference.
Thanks for all the insights! I'm just looking to run models, maybe tweak some smaller ones for fun. I'm hunting for a used 3090 on eBay.