Stay up to date
We'll highlight new content in your collectives with a blue activity indicator on navigation items and posts.
Manage preferences
Questions
Browse questions with relevant AWS tags
258,540 questions
2
votes
1
answer
31
views
How do I delete all the versions of the S3 object using AWS Node.js SDK?
I have versioning enabled bucket and need to delete multiple objects and their versions. I am referring to this guide which lacks Node.js example. This is my current code which only works for non-...
- 21.5k
0
votes
0
answers
8
views
Why does Milvus fail with “fs == nullptr” when loading large HNSW indexes from S3 storage?
I’m running into a fatal error when loading a large HNSW index in Milvus 2.6.7, deployed via Docker, and backed by S3-compatible object storage.
Here is the setup:
Collection size: ~50 million ...
-3
votes
0
answers
43
views
Is it possible for ses events to go to firehose and then to an http endpoint with no custom code? [closed]
When I've tried to set this up in aws, I get error messages that don't make sense.
The firehose stream is listed in this output: aws firehose list-delivery-streams --region us-east-2 but SES will ...
- 1,195
0
votes
0
answers
38
views
Network HTTP/2 requests from Next.js frontend randomly stalled/queued towards node backend EC2 behind ALB
I have a Next.js frontend and Node.js backend application running on AWS. There are two environment levels:
Staging: Separate EC2 instances for frontend and backend
Production: Separate EC2 instances ...
- 512
-3
votes
0
answers
45
views
Chrome HTTP/2 requests from Next.js frontend randomly stalled/queued towards node backend EC2 behind ALB [closed]
I have a Next.js frontend and Node.js backend application running on AWS. There are two environment levels:
Staging: Single EC2 instance running both frontend and backend
Production: Separate EC2 ...
- 512
-5
votes
0
answers
32
views
How to setup SNS subscription to filter CloudWatch log alarm [closed]
We have created CloudWatch alarm in Terraform for multiple services, differ by var.name
resource "aws_cloudwatch_log_metric_filter" "logfilter" {
name = "${var....
- 663
1
vote
0
answers
31
views
Trouble decrypting CiphertextForRecipient after KMS GenerateDataKey
I'm building a route for my go (gin) server that generates a Data Encryption Key (DEK), following the principle of zero-trust (the backend never sees the plaintext).
Right now, the client generates a ...
- 928
1
vote
0
answers
78
views
AWS Lambda TargetInvocationException : could not load file or assembly 'System.Data.SqlClient, Version=4.6.1.6'
I have a .NET 8 based multi-project backend solution. It uses GitHub actions to build the build/publish project with release, that is later used by AWS Lambda to run it whenever an invocation occurs.
...
- 329
-3
votes
0
answers
54
views
CORs Preflight Errors [closed]
New programmer here. I keep getting 'CORS preflight did not succeed errors' on the OPTIONS method using API Gateway. It's a mock integration with all the correct headers and mappings:
method.response....
0
votes
0
answers
46
views
How to sync Fundraise Up webhook data to external authentication provider?
I'm integrating Fundraise Up donations with a membership system that needs authentication. When a user donates, Fundraise Up sends a webhook with donor information, and I need to automatically create/...
- 21
-2
votes
0
answers
61
views
How to make sure that server is always available (at least to do SSH) under high CPU and mem usage? [closed]
I want to reserve some CPU and mem for SSH in case of high CPU and mem usage, so that I can go inside the server troubleshoot and kill the process consuming most resources.
I have used the below to ...
- 7
0
votes
0
answers
17
views
EMR Spark cluster getting stuck on resizing
I have a EMR spark cluster, on which I have enabled EMR managed auto scaling as
auto scaling configuration
and primary - c5a.xlarge
Core - c5a.xlarge
Task - c5a.xlarge
With these cluster ...
- 1
-1
votes
0
answers
58
views
Installing python through UserData in Windows [closed]
My EC2 instances uses windows-2019 AMI and I want to install python through my userdata. This userdata format is unrecognised from Instance Diagnostics -> System Logs on the EC2. Also the ...
- 29
Advice
0
votes
0
replies
31
views
How to forcibly disconnect/terminate a WebSocket subscription in AWS AppSync Events API from the server side?
I'm using AWS AppSync Events API for real-time WebSocket subscriptions. Users subscribe to channels (e.g., /activities/{userId}) and receive events.
My requirement:
When a user logs out, or their ...
- 35
0
votes
0
answers
37
views
AWS SES Complaint events are not received for GMAIL users
I want to handle user complaints by performing some business actions when such complaints occurre. I also want to differentiate email campaign by custom tags since I send quite a lot of different ...
Best practices
1
vote
0
replies
97
views
How to securely build Docker images in GitHub Actions on Kubernetes runners (no privileged mode / no DinD)?
I'm setting up a secure CI/CD pipeline using GitHub Actions with self-hosted runners running in Kubernetes, and I want to build Docker images and push them to AWS ECR securely.
Goals
Build Docker ...
0
votes
0
answers
64
views
Run Ansible deployment via SSM Failed [closed]
Task failed: DISABLE ECHO command 'stty -echo' timeout
Code :
- name: Run Ansible deployment via SSM
env:
AWS_DEFAULT_REGION: ${{ env.AWS_REGION }}
AWS_REGION: ${{ env.AWS_REGION }}
run: |
...
- 301
1
vote
1
answer
56
views
AWS Glue PySpark job taking 4 hours to process small JSON files from S3
I have an AWS Glue job that processes thousands of small JSON files from S3 (historical data load for Adobe Experience Platform). The job is taking approximately 4 hours to complete, which is ...
- 461
0
votes
0
answers
76
views
Glue Job connection with SQL Server hosted on EC2
I have created a Glue JDBC Connection for my SQL Server running on EC2.
I tested the connection with Visual ETL in the following way:
Used SQL Server as source
Selected my SQL Server connection in ...
- 3,117
-1
votes
0
answers
36
views
How to get Terraform value into Spring Boot application? [duplicate]
I build my project using Buildkite, one of the steps is to create the AWS infra using Terraform. Then helm is used to deploy the application to EKS. I'm wondering how to get a value from Terraform (in ...
- 35
1
vote
1
answer
200
views
Get inner JSON node using search script
I have this JSON file stored in OpenSearch:
{
"clientId": "1263434",
"record": {
"id": "88749b1f-4946-4033-b9a8-2b99bf1205ff",
...
- 956
0
votes
1
answer
52
views
"Max concurrent runs exceeded" in AWS Glue job with job run queuing
I am having a problem with my architecture on AWS and I need help because I do not understand the behavior I am witnessing.
In short, I have a bucket in S3 where CSV files are sometimes placed. Each ...
1
vote
0
answers
41
views
Using Mass Transit, is there a granular way to override the headers on error messages when there is a fault?
On errors in my service (while consuming a message) Mass Transit will attempt to send the message to an '_error' queue and will fail due to an SQS hard limit on message Attributes:
MassTransit....
- 23
0
votes
0
answers
47
views
AWS SDK v4 and S3 GetObject - System.Net.WebException: The underlying connection was closed: An unexpected error occurred on a send
I'm trying to figure out the source of this issue so I have created a little sample C# app that uses the AWS SDK v4. It calls out to an s3 bucket to get a file, the same file, in a loop.
Here's a ...
- 429
2
votes
1
answer
112
views
Dynamic grouping over parameter in athena quik suite SQL
I am looking for a way to dynamically group rows of a data set. If a defined column name is passed in the parameter, each row should be listed individually. If the column name is not listed, all ...
- 11
1
vote
0
answers
122
views
Observability in AWS Bedrock Agent Core Runtime
I am experimenting with AWS Bedrock Agent Core runtime for production level deployments of Agents. I already have deployed an agent in a runtime successfully. But now, I want to enable the ...
- 21
0
votes
0
answers
66
views
Multipart uploading with s3/lib-storage failed after updating from v3.712 to v3.948
My multipart uploading service for my website (using Angular) failed immediately after updating s3/lib-storage from v3.7xx to vc.9xx. This service has failed before when updating to v3.8xx, so I ...
- 743
Tooling
0
votes
0
replies
27
views
How to include dynamic runtime values in CloudWatch alarms
I want to include dynamic runtime data in CloudWatch alarms. Specifically, when my application emits metrics with contextual information, I want that context to appear in the alarm descriptions or ...
0
votes
0
answers
57
views
How to setup AWS KMS with pulumi for log group?
I'm having hard time getting my KMS key working for my log group.
Right now I got this error in pulumi up:
policy: operation error KMS: PutKeyPolicy, [some other informations] ...
- 1,018
0
votes
1
answer
49
views
Iceberg field-id values - can I specify my own when creating a table?
I'm using AWS Glue Data Catalog to store Apache Iceberg tables. I use the Iceberg Java SDK to define the tables there. When I create an Iceberg table, I provide field-id values associated with each ...
- 3,419
1
vote
1
answer
118
views
Presigned URL for S3 - Check your key and signing method
I am trying to get an object from my S3 bucket using pre-signed URLs (from the AWS docs):
import boto3
from botocore.config import Config
from botocore.exceptions import ClientError
def ...
- 1,435
0
votes
1
answer
194
views
`SSLV3_ALERT_ILLEGAL_PARAMETER` error connecting to AWS SES from Python using smtplib
We started seeing this error yesterday when calling smtplib starttls()
SSLError: [SSL: SSLV3_ALERT_ILLEGAL_PARAMETER] sslv3 alert illegal parameter (_ssl.c:1010)
The issue happens when connecting to ...
- 2,633
-3
votes
1
answer
109
views
Localstack Terraform S3 creation error of Error: listing tags for S3 (Simple Storage) Bucket [closed]
I am trying to create a S3 bucket on LocalStack using Terraform and when I copied the code from their documentation it is giving me this error. I am unable to solve this terraform error.
main.tf:
...
1
vote
1
answer
81
views
Filter aws lambda event source on metadata
I'm trying to filter based on metadata values of incoming SQS events, not what is in their body.
From the documentation, it is mentioned that there is a messageAttributes attribute. I want to filter ...
- 1,013
-4
votes
0
answers
149
views
AWS Storage Gateway - Tapes - Retrieved Status [closed]
I have inherited a storage gateway that is no longer accessible, VM not running etc.
I have 3 tapes in AVAILABLE and 1 that was archived.
I setup a new storage gateway to an EC2 instance and retrieved ...
- 341
0
votes
1
answer
92
views
Not all AWS resources (Lambdas) detected by Grafana
I am creating widgets in Grafana for monitoring AWS resources, including Lambda functions. For this purpose, I am creating variables that filter to just my team's Lambda functions using regex. Some ...
- 2,529
Best practices
1
vote
1
replies
145
views
How do I determine the correct order of Lambda layers in AWS?
I’m working with AWS Lambda and need to attach multiple Lambda layers to a function. I know that AWS allows you to specify the order of layers, but I’m unclear on how the ordering actually affects ...
- 29
Best practices
0
votes
0
replies
77
views
Do I need to redeploy an API Gateway stage after switching the Lambda integration?
I’m working with AWS API Gateway (REST API) and testing routes using the “Test” feature in the API Gateway console.
I changed the backend Lambda function that an API route is integrated with (for ...
- 29
Best practices
0
votes
1
replies
34
views
Is routing a production API Gateway to QA Lambda functions bad practice? What are the security and reliability risks?
I’m working on an AWS setup with multiple environments: master (production) and qa.
Recently, our Flutter app was getting 500 errors when calling the master API Gateway endpoints that are integrated ...
- 29
0
votes
0
answers
63
views
AWS LoRaWAN uplink messages contain no wireless metadata
I'm playing around with some LoRaWAN devices connected to AWS IoT Core, and have managed to send downlink messages and receive uplink messages through a AWS IoT core destination which is in turn ...
- 9,415
0
votes
0
answers
65
views
How can I standardize Amazon Bedrock model invocation parameters when each provider and model uses different request schemas?
I’m building an internal LLM testing platform where users can select any Amazon Bedrock model and dynamically adjust its input parameters (e.g., max_tokens, temperature, top_p, embedding options, etc.)...
- 13
0
votes
0
answers
62
views
AWS Secrets Manager key causes 401 Unauthorized when fetched in ASP.NET Core, but works as plain text in Elastic Beanstalk
Whenever I try to pass the API key for Mistral AI into the backend through secrets manager, I get an error "401: unauthorized". When stored as plain text in the environment variables in ...
- 1
Advice
0
votes
1
replies
61
views
Using AWS TRANSFORM To migrate Angular 16 to 21
I want to know if it's possible to do Angular migration version automatically with aws TRANSFORM argentic IA?
-1
votes
0
answers
74
views
AWS App Runner: Deployment passes health checks but fails during traffic routing
I’m running an AWS App Runner service that has been working for months. Recently, whenever I deploy a new ECR image to this existing App Runner service, the deployment passes health checks but fails ...
1
vote
1
answer
79
views
angular-auth-oidc-client with AWS Cognito PKCE Flow state error
I'm building an application that uses AWS Cognito as IDP for authentication and angular-auth-oidc-client library to handle authentication on my Angular 21 client.
I configured it as follows:
config: {
...
0
votes
0
answers
70
views
AWS Bedrock Data Automation (BDA) – InvokeDataAutomationAsync returns “Data automation project does not exist”
I am trying to invoke an Amazon Bedrock Data Automation (BDA) project asynchronously to extract structured data from a PDF stored in S3. I am able to successfully create, list, and retrieve the BDA ...
- 1
0
votes
1
answer
71
views
NextJS standalone under ECS Container, can not use localhost or 127.0.0.1
I have a frontend app running at port 3000.
.........
USER nextjs
EXPOSE 3000
ENV PORT=3000
ENV HOSTNAME="0.0.0.0"
CMD ["node", "server.js"]
Inside the frontend's ...
- 1,235
3
votes
2
answers
76
views
Autovacuum causing deadlocks with ALTER TABLE RENAME on Aurora PostgreSQL 14
I'm working with COTS software, so changing the software is difficult.
The software has a process:
Creates a temporary table
Adds a bunch of data
When finished, renames the table
ALTER TABLE ...
- 1,269
Best practices
0
votes
3
replies
64
views
Next.js + S3-compatible storage: presigned uploads from browser vs uploading files to API route
I’m building a page builder in Next.js (App Router) where users upload images that are stored in DigitalOcean Spaces (S3-compatible).
Depending on the page:
some flows upload a single image (e.g. ...
- 101
Best practices
0
votes
1
replies
49
views
Terraform | Default tags at module level
I have a Terraform project for my AWS account. At the root, I have a set of modules, each representing a different project. I'd love to apply default tags to each resource, so I can easily propagate ...
- 318
Alexxino
scored 10
asking questions this week
Members can contribute articles
Simply submit a proposal, get it approved, and publish it.
See how the process works
Simply submit a proposal, get it approved, and publish it.
See how the process works