I've been trying to figure out what storage technology AWS EBS volumes are built on. Google hasn't really helped, and neither have any of the language models. I'm curious about how AWS manages to deliver such high throughput and IOPS along with strong resiliency, especially considering it's a multi-tenant cloud environment. I thought maybe they're using a distributed storage solution like Ceph, but is that the case or is it something entirely different?
5 Answers
While the specifics aren't publicly disclosed, it's known that AWS EBS uses a proprietary storage system that's tailored for their needs. It's definitely not a conventional software or hardware solution you can buy off the shelf. There's an informative article that dives into some history and tech details if you're interested! Check it out here: https://www.allthingsdistributed.com/2024/08/continuous-reinvention-a-brief-history-of-block-storage-at-aws.html
EBS is built on a proprietary system that isn't based on Ceph since it's designed for much higher performance and is exclusively block storage. It has likely evolved significantly since its launch in 2006, especially with the advent of SSDs and NVMe drives. There are also alternatives now, like OpenEBS or SimplyBlock, if you're exploring similar options that you can manage on your own hardware.
For some insights, you might want to watch this talk. It touches on aspects of AWS's storage technology: https://youtu.be/1EWh2aDvHzY.
Honestly, you won't find much detailed information available to the public about AWS's technology. It's quite secretive, similar to how terms like 'hyperplane' are vaguely defined in public resources.
Lol, right? Why would AWS share details about their proprietary stack? Your guess is as good as mine!
Related Questions
Sports Team Randomizer
10 Uses For An Old Smartphone
Midjourney Launches An Exciting New Feature for Their Image AI
ShortlyAI Review
Is Copytrack A Scam?
Getting 100 on Pagespeed Insights for Mobile is Impossible