Hey everyone! I'm looking to deploy an Elasticsearch, Fluentd, and Kibana (EFK) stack on Kubernetes. My goal is to make it easy for developers to access the logs. I want to truly grasp how everything works and how to set it up correctly. I've previously set up a monitoring stack, so I have a bit of experience. Any suggestions on where I can learn more about this? I would appreciate your guidance!
4 Answers
Not sure of your skill level, but this tutorial is great for beginners! It covers setting up observability logging with the EFK stack on AWS EKS. You might want to check it out: https://medium.com/@chuksteve370/observability-logging-with-efk-elasticsearch-fluentbit-kibana-stack-on-aws-eks-30f1a3001f1d
If you want a straightforward setup that’s easy to understand, you could look into VictoriaLogs. It's really user-friendly, working well with default configurations, and has a simple architecture which makes troubleshooting easier.
Be aware that using Elastic with Fluentd might require some configuration work. If budget allows, consider opting for the SaaS version of Elastic rather than managing it yourself. Additionally, you might want to check out Loki as an alternative.
You should definitely look into the Kubernetes operator for Elastic. It simplifies deployment. First, read the documentation to understand the architecture you want. Consider storage needs, multi-cluster setups, and availability. Also, standardizing your log format across apps, ideally using JSON with OpenTelemetry conventions, will help a lot. Think about whether you want all logs, metrics, and traces handled in one stack for easier correlation.
Related Questions
How To Get Your Domain Unblocked From Facebook
How To Find A String In a Directory of Files Using Linux