I'm new to Amazon Web Services and I've noticed that my upload speeds to S3 are surprisingly low. I used to host my files on Google Cloud Platform (GCP), where I averaged about 40MB/s for uploads. Currently, on AWS S3, I'm only getting around 12MB/s with the same files. My internet's upload speed is 480Mbi/s, so it doesn't make sense to me why the S3 speeds are so slow. Plus, I'm using a region without Transfer Acceleration. Has anyone else experienced this slowdown or have suggestions? Also, my Internet Service Provider isn't throttling my speed.
2 Answers
Definitely check where your bucket is located compared to your upload location. That distance can impact speeds.
It sounds like you're hitting some obstacles. I usually get pretty close to my internet's max upload speed when sending files to S3. Here are a few things you might want to check:
- What client are you using for uploads?
- Does that client support multipart uploads?
- Can it handle multiple parallel streams?
- Also, consider the nature of your data—like if you're uploading a lot of small files, that can slow things down.
Just to add, I’m uploading straight from my browser to S3 for now. I think AWS handles it, but I doubt the console supports multipart uploads. My test file is a single 6GB video. Should I try a dedicated client?
Good point! Also, what region is your bucket in? And where are you uploading from in relation to that region? That could make a big difference.