I'm currently using a Ryzen 7 3700X with 96GB of RAM for running language models using llama.cpp. I'm not into gaming, but I'm wondering if upgrading my processor is a smart move right now, especially considering my somewhat limited income. What do you all think?
2 Answers
Nah, upgrading your CPU won't really help with running LLMs. They rely more on memory bandwidth rather than CPU power. If you're looking to boost your performance, consider investing in a dedicated GPU instead, like a used RTX 3060 or 3090. Those will give you much better results for what you're doing.
What GPU are you currently using? If it’s an older model, upgrading to something with better tensor cores could be a big help before GPU prices start to climb!
I have an RX-580 with 8GB of VRAM.