Questions tagged [amazon-s3]
This is for questions on Amazon's cloud storage service.
1,124
questions
2
votes
1
answer
139
views
Resizing images using AWS Lambda - issue
I'm trying to resize images automatically using Amazon S3/Lambda. The problem is I cannot get any connection to Amazon S3 buckets while creating a Lambda function.
Creating a new blank function in ...
- 21
0
votes
0
answers
3k
views
S3 – Connection Aborted / Broken Pipe when uploading to one bucket's presigned URLs, but other buckets are fine
I have an S3 bucket in a Cloudformation stack that holds artifacts. A lambda function in the same stack generates a presigned URL for clients to upload files into the bucket.
I already had the code ...
- 103
2
votes
1
answer
1k
views
Redirect apex domain to www with Route53 and CloudFront
I'm trying to setup redirect from the apex domain example.com to www.example.com with route53, cloudfront and s3.
I've seen many tutorials online and discussions here on the topic, but nothing has ...
- 123
1
vote
0
answers
560
views
How to access a S3 bucket accessible only through a EKS Pod
We've got a S3 bucket we use to store files used by an application deployed on EKS, to access the bucket we have a secret web identity token.
The application maintenance guys sometime need to browse ...
- 111
0
votes
0
answers
114
views
SPA from S3 and Java backend in the same domain. ALB fixed response limit
I would like to have S3 bucked stored Single Page Application and its backend in the same domain. Now I am using ALB Listeners configuration to serve a fixed response for my index.html (by path). The ...
- 197
0
votes
1
answer
579
views
SSL Certification- secures subdomain on AWS s3 using Godaddy Wild Card SSL
I need to get resources.fairfuturesny.org secured. Its currently living on Amazon CloudFront S3. It's being used to host files.
I the main domain is fairfuturesny.org from godaddy, which is secured.
I ...
12
votes
1
answer
14k
views
Adding CloudFlare to S3 bucket
I have an Amazon S3 bucket that contains thousands of JPGs and similar media assets. (It's the storage for my forums.) I don't host a static site in this bucket (no HTML of any kind) and it's ...
- 1,127
1
vote
1
answer
203
views
Most efficient way to enable S3 versioning on existing objects?
The AWS S3 API lets you enable versioning on a bucket using the aws s3api put-bucket-versioning command. Future objects written to that bucket are versioned, but existing objects are not.
But is there ...
- 123
0
votes
1
answer
250
views
Cloudfront behaviors with S3, Wordpress backend, and Vue frontend
I'll try to explain my situation and issue as best as I can.
Previously I had a wordpress site behind cloudfront. Set up behaviors and that all worked well.
Recently I have moved to using my wordpress ...
2
votes
2
answers
533
views
How to point route53 records to bucket for *any*subdomain?
I have an S3 bucket called www.mybucket.com
I have an A record: name = www.mybucket.com. It answers well with the index.html contained in the bucket.
Now I want to send any subdomain to that bucket.
I ...
- 621
0
votes
2
answers
90
views
AWS billing for EC2 instance bandwidth
I have two AWS accounts. In the first Account, I have data in S3. And I have an application running on Ec2 instance in 2nd Account. Both are in the same region
I have mounted the s3 of the first ...
- 103
0
votes
0
answers
150
views
AWS: Remove S3 files not accessed for a long time via cloudfront
I wonder is it possible to configure using AWS build-in lifecylce capability if certain files were not accessed (via pubic Cloudfront distribution) for a certain period of time, they would be auto-...
- 175
0
votes
1
answer
119
views
Do all cloud storage services store data as objects instead of files? [closed]
I've been using AWS S3, and I'm not happy that I can't do things like an rsync from the Linux server to do a backup on S3. It's because S3 stores objects I'm told and not files. Is this something all ...
google-cloud-platform
1
vote
1
answer
384
views
AWS EC2 deleted but still shows current usage
I am using AWS EC2 free tier now.
I deleted EC2 instances but my billing dashboard shows current usage space is 11 GB-MO.
Here is my billing dashboard image.
And here is EC2 dashboard.
Can any one ...
- 109
1
vote
1
answer
358
views
Amazon SES data via AWS S3: Is there a simple way to list and download a folder and get line counts?
I've set up Amazon SES to send a company announcement to a list of about 1,000 contacts. I set up the Kenesis Firehose to log all e-mail events (e.g., Send, Bounce, Click) to a bucket in S3. SES seems ...
- 113
1
vote
1
answer
608
views
Trying to revoke public access on CloudFront S3 bucket
All the AWS security tools are bugging me all day about having public S3 bucket access turned on. So I said sure, the only bucket we have that needs public access is our cloudfront bucket, let me fix ...
- 113
-2
votes
1
answer
32
views
Domain Double Pointing
I have one main domain basicdomain.com;
About 100 domains's CNAME are pointing to that main domain.
domain1.com, domain2.com, ... domain100.com
All domains will show basicdomain.com contents.
I am ...
- 109
0
votes
1
answer
29
views
What kind of service I need to point multiple domains to different webpages?
I would like to provide my users a way to publish their site, meaning I'll be hosting it and I would provide them the DNS information so they can point their custom domain to it.
I'm totally new on ...
- 203
1
vote
0
answers
877
views
Confluent Kafka Connect S3 re-processing data due to offset out of range
I'm experiencing a strange situation.
My Confluent Kafka Connect S3 is processing around 8K messages/sec. What started happening randomly every few days is:
The Fetcher class would try to fetch an ...
- 433
0
votes
0
answers
50
views
AWS Route 53 configuration problems for S3 hosting
I have a static site hosted on S3, mylifeinlimbo.ca
I have set up S3 with a bucket for www.mylifeinlimbo.ca which redirects to the main bucket and created an 'A' record in Route 53 (see image for ...
- 1
0
votes
1
answer
168
views
CloudFront distribution from S3 bucket: big "bucket is public" warning. What can go wrong?
I'm moving an existing static website to S3/CloudFront.
Following some documentation from AWS, I setup a policy on the S3 bucket to make it public:
{
"Version": "2012-10-17",
"Statement": [
...
- 360
0
votes
0
answers
552
views
Is there a way to make CrossFTP or DragonDisk access path-style s3 server?
I'm trying to find a way to speed up the transfer of 95gb of data to my company's Object Storage.
I'm transfering the files via node/aws-sdk but it's too slow.
I already tried ManagedUpload and ...
- 225
0
votes
1
answer
305
views
Permanent redirect all http requests to include www subdomain [duplicate]
I have noticed both google.com and amazon.com, redirect requests to www.google.com and www.amazon.com
I am thinking of doing the same for my website which is hosted on AWS. What is the best approach ...
- 528
0
votes
1
answer
44
views
AWS S3 and Bandwidth billing by Cognito user
I Want to build an serverless application that can store simple objects in S3, manage the user Login using AWS Cognito, and make the pricing pay-as-you-go for the user, (Charge the user for the ...
- 73
0
votes
0
answers
363
views
Static websites in s3 bucket returns 404 for links
I'm uploading Gatsby static built files to s3 static website hosting in subdir.
For example.
test.s3-website-us-west-2.amazonaws.com/site1
test.s3-website-us-west-2.amazonaws.com/site2
So I want ...
- 55
1
vote
1
answer
87
views
Cloudtrail S3 data events: "The maximum number of S3 data resources is 250"
We need to monitor object-level access and changes in one of our S3 buckets with cloudtrail (specifically with cloudtrail, not s3 access logs).
The cloudtrail documentation indicates in a small note ...
- 360
2
votes
0
answers
2k
views
Access denied for S3 bucket with redirect access via CloudFront
I have public S3 bucket exposed via CloudFront to S3 A record for www.mezinamiridici.cz.
https://www.mezinamiridici.cz/ - works
http://www.mezinamiridici.cz/ - redirects to https://www.mezinamiridici....
- 305
0
votes
0
answers
30
views
Did AWS stop allowing PUTs to S3 locations more than one directory deep through the AWS CLI?
On our various servers that have a product that includes a database, I create a job that runs a small script that makes a backup of the database, compresses the file, and sends it to S3. I have one ...
- 1
1
vote
1
answer
735
views
AWS S3 Bucket Django 3.0 User Profile Image Upload Access ERROR
INTRO
I am following this guide as recommended, here is the guide's GitHub repo.
I have created an AmazonS3FullAccess to it as well
I am using the guide's 3rd example "Mixing public assets and ...
- 223
1
vote
3
answers
1k
views
mysqldump using a lot of space
I have a server and the / partition is 20GB in size.
Databases are stored in /mnt/mysql-data partition is 500GB in size.
Now here's the problem. Whenever I run mysqldump it fills up / partition to ...
- 129
2
votes
2
answers
670
views
Trigger AWS Lambda by S3 object GET
My Problem
I have a public S3 bucket which serves as a storage solution for large files (GBs) that I send to colleagues and clients. The files are auto-deleted after a few weeks.
The problem with ...
- 13.4k
1
vote
0
answers
948
views
Amazon S3: How to automatically copy uploaded files to another directory upon file creation
I have an S3 bucket where files are uploaded regularly, with the folowing directory structure:
backup/
process/
The ideia is: I upload files to backup, the new files are regularly copied to process ...
- 11
1
vote
1
answer
1k
views
What is the format of S3 lifecycle configuration?
My Problem
An S3 lifecycle configuration changes object storage classes. A typical usage is periodically moving objects to cheaper storage classes after a specified retention period.
I am trying to ...
- 13.4k
1
vote
3
answers
7k
views
using terraform to download zip file from aws s3
I can't seem to find a documentation that will help me download a zip file from aws s3 to an instance using terraform, can someone help me find a solution to this ?
Thank you.
- 129
3
votes
1
answer
737
views
How does reduced redundancy storage (RRS) fit in S3 storage
This is a highy theoretical question as I am trying to get familiarized with S3 storage classes. The storage classes page in AWS docs does not mention RRS at all. RRS has its own page in AWS docs. The ...
- 133
1
vote
3
answers
236
views
Using Amazon S3, why do I have inter-region transfers when replication is turned off?
I have an S3 bucked in the Asia Pacific (Sydney) region and have users from Australia using that bucket.
By far my largest charge is for
AWS Data Transfer APS2-USE1-AWS-Out-Bytes
Asia Pacific (...
- 167
1
vote
1
answer
240
views
Serving secure static S3 site without www
I'm trying to set up AWS to serve a static S3 site over SSL with a custom domain. I'm so close but I'm missing one piece.
S3 static website (works): xyz.s3-website.us-east-2.amazonaws.com
CloudFront ...
- 119
1
vote
1
answer
523
views
is it possible to change aws s3 access denied message with nginx 403 forbidden
I am using DigitalOcean Spaces. How do I change the XML access denied page to Nginx 403 forbidden page
1
vote
1
answer
633
views
what should the ACL value be when limiting S3 object access to CloudFront only?
I followed https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/private-content-restricting-access-to-s3.html
But I cannot figure out what should the ACL on AWS.S3.PutObjectRequest be ...
- 113
1
vote
1
answer
310
views
Setting up S3 to host 'wp-content' folder
If this is not the right SE to post the question, please kindly direct me to the right one.
I've seen configuration of setting up S3 to host wp-content folder, what are the advantages of doing so? ...
- 157
0
votes
1
answer
4k
views
aws s3 ls --summarize switch is broken when trying to get the size of a specific prefix in a bucket
Am I stupid or is this command just totally broken or unclear in usage
I want to see the size of a specific prefix in a bucket
aws s3 ls --summarize --human-readable --recursive 's3://mybucket/...
- 4,233
0
votes
0
answers
172
views
How to move nginx cache contents to another machine
I'm running a nginx server on debian 9 to save some bandwidth for my s3 bucket. It currently holds 300gb of data. In order to save some money I want to move this data to another server. I'm currently ...
- 21
2
votes
1
answer
3k
views
Ansible Download file from S3 to ec2 instance Error
I'm trying to learn Ansible. I'm working on creating an instance and uploading a file into it, the file i want to put into the ec2 instance is in stored in S3, but it keeps saying that the destination ...
- 129
23
votes
2
answers
42k
views
Deleting S3 files with a given prefix only
We have a bucket with more than 500,000 objects in it.
I'm assigned a job where I've to delete files which have a specific prefix. There are around 300,000 files with the given prefix in the bucket.
...
- 471
2
votes
1
answer
4k
views
S3 PUT directly to glacier
This AWS post from 2018 makes it sound like it should be possible to make S3 style PUT requests to create archives in glacier now:
I'm interpreting that to mean that you could use the s3 CLI or sdk ...
- 123
3
votes
2
answers
809
views
Why AWS encryption for EBS and S3 is disabled by default? [closed]
For EBS and S3 encryption (even via the default key from KMS) is disabled by default, as I understood from the documentation, there is no difference to the user if volume/objects is/are encrypted ...
- 133
0
votes
2
answers
4k
views
What is the way to access private S3 bucket files using nginx as proxy?
I have a website and an S3 bucket with numerous images, which should not be accessible directly from any machine with a direct URL.
Those images will be shown on different website pages for ONLY ...
- 95
0
votes
1
answer
128
views
How can you set up secure Terraform state storage for different infrastructure layers using S3 for backend?
Context
After reading a lot about Terraform and playing with it in minor projects, I'd like to start using it in a real, production environment.
As the environment is mostly in AWS, I'd go for the ...
- 71
1
vote
1
answer
877
views
How to use SES as an outbound relay for Postfix
I'm looking for a way to both receive emails and then store them in s3 at the same time while using ses, i found out that it can't be done unless i do some way of forwarding, so, what i did was that i ...
- 129
1
vote
0
answers
344
views
domain masking for a cloudfront distribution
I have a domain test.com which is linked to a cloudfront distribution which then serves static content from s3 bucket. Now I want another domain www.test2.com to masked redirect to test.com. I created ...
- 111