Hey everyone! I'm currently working on a project that involves deploying Kubernetes with some stateful applications. We're planning to set up both cloud and on-premise (customer hardware) deployments. For our on-prem testing environment, I'm using AWX with Docker, but I need to establish a robust Kubernetes setup with high availability for production. Should I go with kubeadm for automation, or would Rancher be a better fit? I've got some experience with AWX and Jenkins (for cloud), but I'm pretty new to managing Kubernetes in a production setting on-premise. Any recommendations for tools to help manage the Kubernetes lifecycle effectively? Thanks!
2 Answers
You might want to check out the RKE2 Ansible project on GitHub; it's pretty solid for what you're looking to do. K3S is another great option. Just keep in mind that managing Kubernetes on-prem is quite different from using cloud services. Make sure your networking and hardware are configured properly—like setting static IPs for master nodes. Also, don’t overlook storage considerations since slow storage can really impact etcd performance. You’ll also need to manage external integrations such as object storage and any custom certificate authorities you might have, which can be tricky.
We’ve been using RKE2 in production for about two years, and it’s been working pretty well for us! It’s HA capable, and I think it can handle clusters of up to 100 servers. I don't have much to say about storage though, sorry!
That's great to hear! I’m mainly concerned about storage solutions for scalability; how are you managing that?
I can definitely automate some things using Ansible myself, but I'm still worried about managing storage for stateful sets.