I'm looking to purchase a PC strictly for AI applications at work, and I have a budget between $15,000 and $25,000 CAD. I'm well-versed in the consumer market for PCs, but I'm not familiar with the options available for higher-end enterprise setups beyond what's typically offered for personal use, like the RTX 5090. Can anyone provide suggestions for powerful hardware that would be suited for this kind of work?
5 Answers
You should check out Nvidia's RTX Pro series! They're designed specifically for AI workloads. I recommend looking into the RTX Pro 6000 Blackwell GPUs, which are fabulous for heavy AI tasks. Just note that they can get pricey!
Before you buy, make sure to check the manufacturing date – ideally, it shouldn't be older than 2024 to ensure you're getting the latest tech.
It might be a good idea to consult some AI-specific forums instead. You'll find more experts there. For your budget, a workstation with a Threadripper and an RTX Pro 6000 could work, but don’t overlook options like multiple DGX Sparks for better performance.
Thanks for the tip! I'll definitely check out those AI forums.
I'm no expert, but I have a couple of questions. What kind of AI tasks are you planning to tackle? And how many users will be working with the system? For a work setup, consider a system that maximizes memory bandwidth to speed up your processes. If you're using pipelines like Rocm or Vulkan, you might want to build an Epic server setup with several AMD R9700s. A little extra work with drivers could really save you on VRAM costs.
I'll mainly be focusing on object tracking and classification with video footage. Using an NVIDIA card seems to be the way to go since I need something robust for high-demand tasks.
You need to clarify what type of AI you're running. If it's local models, you might need a heavy-duty setup. But if you're using cloud-based AI via API, you can get by with less. For example, while training models in-house needs serious gear, like the RTX Pro or H100, inference speed matters more for active user loads.
I'm processing local models for object tracking on a large amount of video footage. I currently have an A4000 and can analyze 24 hours of video in about 2 hours. My goal is to reduce that to minutes since everything is pretrained.
Wow, those are around 15K CAD each, which would wipe out my budget pretty quick! But they do seem really promising.