I've heard that some startups are managing to cut down on their GPU expenses by partnering with certain services. I'm familiar with typical advice like optimizing usage, scaling down when GPUs aren't needed, and buying reserved instances. But I'm curious if there are any additional strategies or partners that really help with these costs.
5 Answers
Make sure to check if your startup qualifies for any special programs. AWS has resources specifically for startups that might help you save.
I’d suggest looking into past-generation GPUs if that fits your needs. They often have better availability and are cheaper depending on your region.
If you're able to commit to a predictable level of GPU usage, it might be worth looking into discounts beyond just reserved instances. However, I get that many startups like yours are in flux and might not have that flexibility.
You might want to check out Shadeform. It's a marketplace for GPU resources from new cloud providers, giving you an overview of pricing and options across the board. They also maintain a live pricing database that might help you find better deals.
Spot instances can be a game-changer! We exclusively use them for our GPU needs, and they've really helped us save. If you haven't explored them yet, you definitely should.
Spot instances really do offer some good savings overall. I'd recommend giving them a shot if your workloads can handle the variability.
Yeah, we keep pivoting, so committing long-term isn’t really feasible for us right now.