How Do I Estimate Costs for Deploying a Private Version of DeepSeek?
Asked by
TechieTraveler99
I'm looking to put together a budget estimate for deploying a private version of DeepSeek R1 and V3 that would serve a company with 3,500 employees. Any suggestions or guidance on how to approach this? Thanks!
Answers
You might want to reach out to providers like DeepInfra, Modal, or other AI companies; several of them offer private deployment solutions. They could give you specific quotes based on your needs.
Reply to this answer
Based on my experience at Open Router, I’d recommend checking out DeepInfra or Novita as they provide solid services. For a company your size, connecting directly to the DeepSeek API could be a good approach too.
Reply to this answer
I found this article that might be helpful: https://www.aifun.cc/en/deepseek-local-deployment-cost.html. It shares insights into local deployment costs for DeepSeek.
Reply to this answer
One option is to invest in a couple of Mac Studios with 512GB of VRAM to handle the processing needs.
Reply to this answer
Add your answer
Answers are reviewed before publication.
TechieTraveler99: OP meant Private inference.