I'm in the process of building a new Network Attached Storage (NAS) system. It's going to run several applications, including OpenWebUI with Gemma3 and Home Assistant. I'll be executing straightforward queries, like analyzing my security camera footage to count how many trash cans appear in the frame.
I'm considering using an Intel 14500 processor since it allows me to keep my existing DDR4 RAM. However, I'm contemplating switching to the Ultra 5 if the NPU would provide a significant performance boost. I'm anticipating that the 14500 will take around 2 to 3 minutes to process a request like the one I described.
3 Answers
Interesting scenario! So, the Ultra 5-245 has the same 14 cores as the 14500 but offers a higher clock speed (2.9GHz vs. 4.2GHz). However, it sacrifices some of those for the NPU. If you already have DDR4 RAM, the 14500 might be more cost-effective. I suggest comparing both setups on PCPartpicker. You could find that the savings from not needing new RAM can get you a better LGA1700 CPU or even a GPU suited for AI work!
That’s a good question! I think the NPU can indeed enhance local AI processing, but it might not be as massive of a boost as you hope—maybe around a 5% improvement at most. For tasks like the one you mentioned, you might find that a decent graphics card with Tensor Cores could outperform the NPU by a long shot, especially for image recognition tasks. Just a heads up though; the complexity of what you're trying to achieve might be more than it seems. I’d love to hear how it goes if you manage to get it working!
I hear you! Automation using AI has been integrated into Home Assistant for a while now, so it’s possible. There are even tutorials out there to help set up these kinds of automations. Best of luck!
I've tried using the i5 Ultra with Intel's ipexllm and found it pretty sluggish for chat and coding tasks. Can't say if it'll be any better for what you're aiming to do, though. Definitely not the best experience for AI tasks!
Comparing specs is a great idea! I have a Lenovo laptop with an Ultra 9 and I'm considering testing it with a Linux distro to get a better idea of how it stacks up with the Ultra 5. Just worried about driver support for TrueNAS.