I'm transitioning from using cloud-based Kubernetes solutions like GKE and EKS to hosting our own clusters on-prem for specific workloads. I've gathered some info and wanted to know what self-hosted/on-prem Kubernetes distributions people are currently using and how they feel about them. It's been a couple of years since I've seen updated discussions, so I want to hear what everyone's using in 2025. What should I expect for upgrades? How easy is it to install additional tools or use various operating systems? Do folks typically deploy with Infrastructure as Code (IaC) or through GUI interfaces? Are there any critical payment requirements for management features like Single Sign-On (SSO)? While I want a budget-friendly solution, having the option for support later is a plus. I've looked at various options like Rancher's RKE2, Talos Linux, and Kubespray among others, but I'm keen on hearing firsthand experiences. Any recommendations?
1 Answer
I've been using RKE2, and I really like it. It's not too opinionated, easy to install, and runs smoothly. I deploy it using Infrastructure as Code (IaC). It’s turned out to be pretty lightweight too.
Yeah, RKE2 is great, especially if you have specific OS requirements. Have you tried combining it with Harvester and Rancher for managing virtual clusters? Might work well depending on your setup.