I'm looking for a way to replace MinIO in my Kubernetes cluster for S3 storage. I'm not sure how Rook-Ceph fits into this. I know Ceph can be set up in various ways, but can I simply run Rook-Ceph on top of my current CSI? Or would I need a new storage class and deal with Ceph's hardware requirements? Just to clarify, I'm not interested in using Ceph for backing my PV storage since I already have that covered.
2 Answers
For S3 use, you should check out Ceph-RGW. When you create the object bucket claim, make sure to use the storage class designated for RGW. If you have smaller datasets, increasing memory beyond 8GB can enhance performance too!
Did you consider Garage S3? We’re transitioning to it, and our experience has been pretty positive so far!
Yes, you can definitely set up Rook-Ceph for your S3 needs! You can deploy a Ceph cluster using the Helm chart and define your object storage from there. There are options to build Ceph on top of your existing CSI, which can handle the PVCs for you. Just keep in mind that performance might vary depending on how you manage your PV storage and how Rook places the OSDs. Also, it’s a good idea to read through the Rook and Ceph documentation for important details.
Also, have a look at the SeaweedFS project. It provides an object store similar to Ceph. Nooba is another option you might consider, especially if you're using local PV.