How can I simulate a missing container image for a Lambda triggered by SQS?
We run a Lambda function from a container image stored in ECR, with messages arriving through SQS. If processing fails, messages eventually go to a dead-letter queue, and…
SQS
How can I simulate a Lambda failure caused by a missing container image?
I have an AWS Lambda function deployed from an Amazon ECR container image and triggered by SQS. If processing fails, messages eventually go to a dead-letter queue, so…
How should I build an analytics pipeline for billions of tiny, unpartitioned S3 files?
I receive billions of very small JSON objects—usually a few bytes to 10 KB—in a flat S3 prefix that I cannot change. Existing objects may be overwritten with…
How to Set Up a Lambda in a Private Subnet to Receive SQS Events?
I'm working with AWS CDK, setting up a VPC that has both public and private subnets. In the private subnet, I've got a security group configured to allow…
How Can I Effectively Rate Limit Lambda Processing with SQS?
I'm working on an app that lets users perform bulk imports of products. When a user starts an import, each product gets added as a message to an…
How to Handle Rate Limits on an API with AWS Lambda?
I'm dealing with a situation where we have an ad-hoc burst operation that runs once or twice a month, sending thousands of messages to a queue processed by…
How can I extract and version control my AWS project configurations and code?
I'm working on a project involving AWS Lambda and various services, and I'm looking to extract the code and configurations I've set up in the AWS console. My…
Should I Store One Small File Per SQS Message in S3, or Batch Multiple Messages Together?
I'm working on an application where events are sent to SQS, and then a consumer processes those messages and writes them to S3. The messages are quite small,…
How Do You Handle Sudden Traffic Spikes in APIs?
We recently faced a major problem at 3 AM when an integration partner accidentally sent around 100K requests to our API in less than a minute. Our initial…
How to Design an API Proxy in AWS with Throttling and Queuing?
I'm working on an API proxy that will receive requests from a source system. It needs to query DynamoDB and then forward a request to a target API.…
How Can I Prevent Concurrent Executions for My Lambda Function?
I'm relatively new to AWS, working as an intern, and I'm developing an internal app for my company. I need to ensure that my Lambda function does not…
Why does my Lambda function wait for the timeout before processing the next SQS batch?
I'm running a Lambda function that uses SQS triggers set to a visibility timeout of 1 minute, with an execution timeout also at 1 minute. The issue I'm…
Is It Possible to Achieve Content-Based Deduplication with EventBridge and SQS?
Hey folks! I've got a setup where EventBridge sends events to my SQS FIFO queue. The issue is that the event body includes the event ID and timestamps,…
Is Using SQS for Cognito User Deletion a Good Idea?
I'm developing a mobile app that utilizes API Gateway and Lambda functions, with most components hosted in a VPC. However, I found that I need to delete user…