I'm looking for advice on how to effectively back up persistent volume claims (PVCs) that are provisioned by Ceph-CSI, specifically for CephFS and RBD, to an external NFS storage. My current backup plan involves using external Ceph storage via Ceph-CSI, with Velero creating snapshots of the PVCs. These backups are intended to be stored on a local NAS through an NFS share, while a secondary NAS would receive snapshots from the primary NAS.
However, I've heard that Velero may not support using NFS as a backup endpoint. Is that correct? I've mostly seen examples of Velero backing up to object storage like S3, which Ceph does support, but that feels risky if Ceph fails. As a workaround, I'm considering using the free MinIO edition to create S3-compatible storage while storing data on the NAS. Yet, I'm unsure if this is still the best approach given recent changes in MinIO's community edition. Any thoughts or feedback would be greatly appreciated!
3 Answers
For backing up with Rook-Ceph, I've found a great combo in Volsync and Kopia. They're pretty reliable for me. Just a heads up: Velero might indeed use Kopia behind the scenes to facilitate NFS support, but I'll need to double-check that. Was Volsync your first pick, or have you experimented with other tools?
I ended up going with RBD export for my backups since it was straightforward and effective at the time. Have you thought about rbd export or rsync? Though I’d suggest working on automating the process, especially if you're considering these solutions.
I have been exploring Velero, rbd export, and rsync, but I need to get more familiar with them, especially for automation.
If you're looking for alternatives to MinIO, consider other local object storage options like Garage, SeaweedFS, or RustFS. Garage has worked well for me in the past with Velero. I’ve done several restores without any issues. Have you looked into any of those?
I'll have to research those options. I wasn't sure if other alternatives besides Ceph Rados Gateway and MinIO were viable. Any advice on using Velero with S3 over NFS?
I’ll definitely dig into Volsync and Kopia more. I want to understand how they work together before diving in too deep.