Hello everyone! I'm reaching out for some guidance. We're a small IT team (1-5 people) transitioning into the world of Kubernetes, and we have a background primarily in Windows administration. Currently, we're using VMware vSphere 8 on-premises and need to set up two clusters—one for DMZ and another for internal tooling. We're interested only in Linux containers and would prefer to build our capabilities internally rather than hire outside consultants.
We have several requirements for our setup, including:
- Helm-based manifests
- Metrics endpoints for all applications
- Support for horizontal scaling
- A full observability stack (covering metrics, logging, and tracing)
- Management for authentication, certificates, and secrets
- In-cluster database management
- Tools for cluster compliance validation
With that said, we have a couple of burning questions:
1. Which Kubernetes distribution integrates well with vSphere 8, offers robust GUI management, and meets most of our requirements out of the box?
2. Is there a practical approach to evolve from a compliant beginner setup to more advanced configurations without going through tedious migrations?
We're already considering options like RKE2, K3s, Rancher, Talos, Headlamp, and Tanzu (though we won't be using Tanzu). Would love to hear any real-world experiences you have!
5 Answers
Have you checked out Portainer? It works well with Talos Omni for managing both infrastructure and workloads! Just a heads-up, I work at Sidero, who created Talos and Omni.
I suggest using Lens for GUI operations and K9s for terminal management. It's worked well for me!
That sounds interesting! Could you share more about your experience with it?
Completely second this. Freelens or Lens should be suitable for any Windows admin looking for a GUI.
Given that you have vSphere 8, you should really consider using VMware Supervisor. It comes with built-in features like metrics and observability, and it's covered by your license—so it’s effectively free. Cluster setup is straightforward as well. For GUI tools, I'd recommend using something like Headlamp or Lens, but remember that managing everything through a GUI isn't ideal.
We have a limited VMware Supervisor license, so we might need to set up VM Kubernetes instead. A combination of a GUI like Rancher, along with CI/CD and CLI tools, seems like the way to go.
Rancher is a fantastic option for GUI management, and it makes setting up clusters pretty straightforward! You’ll find it user-friendly, especially if you're coming from a Windows background.
We were considering using microOS VMs managed by Rancher with Cilium as the CNI—sounds like a solid plan!
Why are you leaning towards GUI management? That wasn't listed among your functional requirements initially.
We've got several VMs running Docker now, and we're managing them with Portainer! Also looking into Sidero with Talos!