Hey everyone! I'm looking to set up a CSI driver that supports ReadWriteMany PVCs because I need to manage a lot of large TIFF files (around 500MB each, totaling about 100 TB). I think Juice-FS would be a good fit for my needs. My Kubernetes cluster is hosted on IONOS, and I'm using their Object Storage. However, I'm fairly new to Kubernetes, so I'm unsure where to start. Can anyone give me some guidance on how to integrate Juice-FS into my existing Terraform/ArgoCD setup? I'm hoping to avoid manual steps as much as possible.
2 Answers
To set up Juice-FS, I suggest creating an umbrella chart named "juicefs-csi-driver" and defining an ArgoCD Application that points to it. In your Chart.yaml, load the upstream chart from the JuiceData repositories as a dependency, and in your values.yaml, pass the needed configuration parameters to ArgoCD's Helm. It should help streamline the process!
Using object storage might work, but if your goal is to have POSIX compatibility, Juice-FS is a great choice. If you just need to write and read files like you would on regular storage, relying on sidecar containers to push files to object storage could be cumbersome. Instead, Juice-FS will allow you to manage those files more easily directly within your cluster. Just a thought!
I agree, for POSIX compliance Juice-FS is probably the way to go! It makes handling files much more straightforward than mixing object storage with sidecars.

That sounds like a solid plan! Just make sure to check if you need to set up MinIO and format the storage first; I've seen that mentioned in some guides.