My colleague and I have been transitioning our company's APIs from ECS to EKS, and while we've got the Kubernetes setup mostly in place, we've hit some major performance snags during our testing phase. Each month, we run a batch environment, so we decided to use that time to test out traffic shifting by sending a small fraction of requests to EKS while keeping ECS operational. At first, everything seemed to flow smoothly, but as the data load ramped up, EKS performance took a nosedive. Although Nginx and our APIs show low CPU and memory usage, requests are timing out, exceeding our default 5-second timeout. Interestingly, ECS handles the traffic just fine, and we're using the same container image across both platforms. Additionally, we have Istio in place and rely on ingress-nginx for our ingress controller, while the APIs pull data from MongoDB. We're trying to troubleshoot this and would love insights from anyone who's faced similar issues when moving from ECS to EKS, especially where Istio is involved. I'll make sure to update here with our progress as we dig deeper.
4 Answers
Here are a few things to consider: First, run load tests directly on your API using port-forwarding to see if the issue persists; if it does, it might be related to the app or database. Second, consider temporarily removing Istio to test the performance. Lastly, make sure to check the number of replicas for both Nginx and your application, and also for MongoDB if it's self-hosted.
What monitoring tools are you using? Have they provided any insights into what might be causing the slowdowns?
Are you using EC2 T-series instances? If so, you might be out of CPU credits, which would definitely affect performance.
Quick question—do you really need Istio for your services? It might be adding unnecessary complexity that could lead to these performance issues.

Related Questions
How To: Running Codex CLI on Windows with Azure OpenAI
Set Wordpress Featured Image Using Javascript
How To Fix PHP Random Being The Same
Why no WebP Support with Wordpress
Replace Wordpress Cron With Linux Cron
Customize Yoast Canonical URL Programmatically