How can a startup increase AWS GPU instance quotas?
Asked by
MellowPine42
I'm new to AWS and received startup credits. My company has also been accepted into the NVIDIA Inception Program and has requested additional AWS credits. We're training our own machine-learning models and need access to GPU instances, ideally comparable to the A100s we used on Google Cloud. What is the correct process for requesting higher GPU quotas, and how likely is approval for a new account? Has anyone successfully obtained increased GPU limits while using startup credits?
Answers
Request the increase through the AWS Service Quotas console. Select the relevant EC2 quota for the specific GPU instance family and Region you plan to use, then submit the desired limit along with a detailed explanation of your workload, expected instance types and quantities, training timeline, account history, and how youโll control costs. Startup credits can help with billing, but they donโt automatically grant higher quotas or guarantee GPU capacity. AWS may approve increases gradually, especially for a brand-new account.
Reply to this answer
Add your answer
Answers are reviewed before publication.
MellowPine42: I submitted a request but it was denied with a note saying the account needs to ramp up gradually. I came from Google Cloud, where we used A100s for model training. Is there a way to appeal and improve the chances of getting GPU quotas approved?