I'm looking for effective ways to manage logging, usage metrics, and traces for a backend of a public API that experiences high traffic. I want to avoid storing everything in a relational database since that can lead to issues with size scaling. What kind of observability stack do others actually use at scale?
3 Answers
To really keep your logging manageable, start by defining what you absolutely need to log. Sometimes less is more! Also consider implementing sampling for certain logs to avoid bloating your database.
For a high-traffic environment, I suggest using Clickhouse as your backend for logs. It's designed to handle large volumes of data efficiently. Also, you might want to check out the website loggingsucks.com for more insights on this topic.
Grafana Cloud is a solid choice for monitoring and metrics. It’s built on open-source tech and provides high-quality support for various integrations. Just a heads up though, the costs can add up quickly with high-volume usage.
Related Questions
How To: Running Codex CLI on Windows with Azure OpenAI
Set Wordpress Featured Image Using Javascript
How To Fix PHP Random Being The Same
Why no WebP Support with Wordpress
Replace Wordpress Cron With Linux Cron
Customize Yoast Canonical URL Programmatically