All Questions
Tagged with amazon-s3 amazon-ec2
184
questions
0
votes
0
answers
65
views
AWS AppStream is unable to push session script logs to s3
I have configured session scripts to log stdout and stderr to s3 bucket as described in https://docs.aws.amazon.com/appstream2/latest/developerguide/use-session-scripts.html#enable-S3-bucket-storage-...
- 1
0
votes
1
answer
73
views
Using S3 instead of MinIO for video management
I am relatively new to AWS so I wanted to reach out to the gurus in the community to get some advice on architecture, and I thought I would share my thoughts.
I am building out cloud infrastructure ...
0
votes
0
answers
62
views
Mimic user permissions on AWS EC2 instances using IAM roles
I'm setting up an AWS account with several users. Each of these users has policies attached that restrict their access to specific S3 buckets/objects and the EC2 instance types / Autoscaling Groups ...
- 101
0
votes
0
answers
463
views
Create Windows 10 AMI for EC2 AWS
I have case to create AMI based on windows 10 OS, the AMI file will be used on AWS ec2 to run some our 3rd party programs for client. I have tried to follow several tutorial and guidelines from google ...
1
vote
1
answer
10k
views
How do I extract a list of all folders of my AWS S3 storage bucket or directories?
Does Amazon provide an easy way extract a list of all folders that have files greater than 500 MB from a s3 bucket? want to limit the scope to the '/files/ftp_upload/' directories also This is so I ...
- 59
-1
votes
2
answers
346
views
How do I share all resources between two AWS Root accounts?
We have one person that has been in charge of all AWS resources for our company, including EC2, elastic IPs, EBS storage, etc. Now we want a second person to also have access to ALL the resources in ...
- 109
4
votes
1
answer
204
views
AWS EC2 Windows server with S3 storage for Veeam backup
I want to create a remote repository for the backup of my local infrastructure.
I'm using Veeam v10.
I think I need a remote machine with a Veeam component installed, then I was wondering if I can ...
- 1,312
0
votes
0
answers
28
views
Static WP website and web app are in different host with one domain
I don't know if this is the right place to post this but I am so much in deep confusion right now.
I have a static WP website hosted in Fastcomet with a domain name www.hpdc.com (namecheap) and also
a ...
- 101
1
vote
1
answer
384
views
AWS EC2 deleted but still shows current usage
I am using AWS EC2 free tier now.
I deleted EC2 instances but my billing dashboard shows current usage space is 11 GB-MO.
Here is my billing dashboard image.
And here is EC2 dashboard.
Can any one ...
- 109
2
votes
1
answer
3k
views
Ansible Download file from S3 to ec2 instance Error
I'm trying to learn Ansible. I'm working on creating an instance and uploading a file into it, the file i want to put into the ec2 instance is in stored in S3, but it keeps saying that the destination ...
- 129
0
votes
1
answer
331
views
Backing up an SQL backup file from EC2 to Glacier
I have an EC2 server running Sendy (bulk mailing) and I wanted to take backups of the SQL db. Currently, I can download the backup.sql file manually via Virtualmin but I wanted to automate this.
I've ...
- 103
0
votes
0
answers
16
views
Traffic handling capacity for 1 EC2 instance for t3.2xlarge [duplicate]
Protocol exchange between phone server and IOT device(inter regional). say there are 100000 users and each are requesting or using 12 - 20 times a day may be approximately at the same time(protocols ...
3
votes
1
answer
842
views
Guidance on Offline/Online Backup for AWS EC2, RDS & S3 [closed]
I have some EC2 instances (Linux and Windows) with attached EBS Volumes, some MySQL Database and S3 buckets in an AWS account. I am in a situation where
I won't have time to work on this project ...
- 33
2
votes
1
answer
589
views
Use S3FS Mount As HTTP Server Document Root
My proposed setup:
An EC2 server running Apache or nginx.
An S3 Bucket in the same region/availability zone mounted with S3FS.
The Apache or nginx document root set to the S3FS mount.
My question: ...
- 414
1
vote
0
answers
3k
views
How to set up S3 bucket with nginx?
I've encountered with the problem. I created S3 bucket with default permissions and uploaded files for my website (js, css, html) but when i try to access it via browser i get access denied. So i set ...
- 41
3
votes
1
answer
834
views
How to share a EFS/s3 with code in a auto scaling group?
the main problem is:
Infrastructure:
Autoscaling (min 1 - max 3)
RDS
ELB
elasticache (redis)
elasticsearch
I want to share a volume (EFS / S3) with the code of my application;
The size of it is ...
- 71
0
votes
1
answer
747
views
X-Accel-Redirect resume broken download
I am using Nginx X-Accel-Redirect to serve a large protected file (several GBs) to users. The server application processes the URL and verifies the download token (embedded in URL) and starts or ...
0
votes
1
answer
2k
views
Amazon EC2 - launch jar from S3
My java application is configured on an AMI image (so that I can use Auto Scaling Groups). I want to have the ability to update the app, and as existing AMIs cannot be updated, I would set my launch ...
- 103
3
votes
3
answers
674
views
Using S3 as a alternative to EFS for backup purpose
For centralised backup purpose of specific data from my instances, i was using EBS Volume mounted to that instances. Now we are planning to migrate to another region, but EFS service is not available ...
- 521
1
vote
1
answer
2k
views
Private s3 access from ec2 user-data script
I'm attempting to write an ec2 user-data script that will pull a file down from a private s3 bucket. The ec2 instances are located in multiple regions, which I believe eliminates the possibility of ...
- 233
9
votes
1
answer
16k
views
Amazon EKS: how to configure S3 access for worker nodes?
How can I configure an EKS cluster to automatically allow S3 access from worker nodes?
I've set up an EKS cluster following the Getting Started guide and have run the example Guest Book app. Now I ...
- 251
0
votes
2
answers
143
views
Making sure internal network is used
I am getting used to cloud computing, especially Amazon Web Services (AWS).
AWS has the concept of regions and availability zones. All availability zones of a Region are connected by a special, ...
- 101
1
vote
1
answer
79
views
Moved from ec2 to S3 static hosting breaks Chrome DNS resolution
I migrated an old website to a static version of it. Everything was hosted on EC2 and the Route53 hosted zone was configured like this :
A record for exemple.com pointing to ec2 instance IP
CNAME ...
- 111
1
vote
0
answers
610
views
Configuring nginx Reverse Proxy and Cache on Wordpress on AWS EC2 and S3 with multiples websites
I search on google and a lot of other questions here, but none helped me with my problem.
So what I'm trying to do is to serve all statics contents from s3 and the only ones that has to run in server-...
- 123
0
votes
1
answer
270
views
How to replicate existing aws-ec2 instances and s3 data on nearest location/endpoints for improved network throughput?
I am a remote developer working out of India. My client is based out of North America and has his ec2 servers/s3 data kept in the us-west-2 region.
The number of hops needed to fetch the data is ...
- 115
1
vote
1
answer
2k
views
How to copy more than 300GB files one AWS EC2 server to another EC2
I need to copy more than 300 GB files (most them are images) one EC2 instance to another EC2 instance, what will be the best method for doing this?
EBS Snapshot will be not work in my situation ...
- 13
1
vote
3
answers
6k
views
Is possible to reduce AWS data transfer costs using any other AWS resource?
I do have a AWS EC2 instance that contains a very large blog. My data transfer is about 200Gb/month. 80% of it are only media and images.
My data transfer costs are high due the server location in ...
- 168
0
votes
2
answers
132
views
scaling up when new object is inserted in s3
I want to setup auto scaling in following way.
I am storing website data as zip in aws s3 bucket (versioning not enabled)
when an instance is launched in auto scaling, user data will have shell ...
- 33
2
votes
3
answers
535
views
How correctly and cost effective to store EC2 instance backups
How correctly and cost effective to store EC2 instance backups?
I have a scenario like:
Create EC2-instance snapshot.
Move it to S3 bucket.
Move it from S3 bucket to Glacier
Done
It is correctly ...
- 145
1
vote
1
answer
374
views
Is there any way to persist files for a web application using Amazon AWS without a full VM?
I would like to migrate an web application to Amazon AWS.
The application stores and retrieves small persistent data from a content/ directory. I tried Amazon Elastic Beanstalk to deploy the ...
- 168
0
votes
0
answers
122
views
Testing CloudFront in Europe
I'm trying to set up CloudFront so that European users can download from my S3 bucket quickly.
I've already set it up and am now testing. To test, I have created a Windows EC2 instance and based it ...
- 105
1
vote
2
answers
4k
views
Cloud-init is failing to execute awscli command in User Data
Need help to fix the error and enable the instance to run issue free User Data script.
Issue: cloud-init is unable to execute awscli command. I have mentioned a custom script (which will be present ...
- 23
-3
votes
1
answer
54
views
How do I upload to S3 server from EC2 with low cost?
i have 5072,792,622 files every month to upload on s3 server and it's costing me lot of money as we are using PUT request to upload them to s3 server, is there another method which I can use to upload ...
- 97
-7
votes
1
answer
79
views
AWS S3 EC2 EBS Confusion [closed]
Currently when a user uploads a photo / video i upload it in root directory of my website.
/var/www/mysite/pics/hash/example_filename.jpg
and
/var/www/mysite/videos/hash/example_filename.mp4
I'm ...
26
votes
7
answers
39k
views
How to verify a AWS VPC (S3) endpoint works?
I added a VPC endpoint to my VPC using CloudFormation, and allowed s3 usage. The routes are visible in the AWS console, but not in the local routing tables of the
EC2 instances:
$ route -n
Kernel IP ...
- 1,994
2
votes
1
answer
4k
views
Is it possible to upload files directly to Amazon S3 and edit them?
I'm facing this problem, I wish to let users to upload their files directly to my bucket on Amazon S3. This step can be accomplished easily like described here.
But what if I need to edit each file ...
- 189
0
votes
1
answer
1k
views
Combining EC2 with S3 and RDS from AWS Amazon
I would like opinions if the following scenario is feasible or not. Also, if you think that I see something wrong don't hesitate to mention that.
I have to propose and create a System Architecture ...
- 1
2
votes
1
answer
3k
views
Use Ansible S3 module to sync files in EC2 instances
Is the below play is the right way to sync files from S3 bucket to instances in EC2?
I am running my play from my mac.
- name: "syncing S3 for Keys"
hosts: ec2instances
s3:
...
- 21
0
votes
1
answer
75
views
Point specific S3 URL to another IP (EC2 instance) [duplicate]
I have a static website hosted in AWS S3 with a URL www.example.com. However, I need www.example.com/blog to point to an EC2 instance instead of looking for blog inside S3, since I installed Wordpress ...
- 101
-1
votes
1
answer
128
views
how to migrate shared mount points to aws
we are planning to migrate to AWS, how do you migrate shared NFS mount points to AWS, we have file systems in them. Is S3 a good choice or EBS, Is there any other way to do this, how have people been ...
- 103
1
vote
1
answer
736
views
Best manner to access files in S3 Bucket from EC2 instance
I have tried several packages (goofys, s3fs, fuse) and have not been able to find a solution to my problem.
I have an S3 Bucket with several thousand files currently in it and will continue to grow. ...
- 277
1
vote
1
answer
2k
views
Amazon route 53 + cloudfront + s3 -> with angularjs2 app in ec2
I am really confused about the setup I need for my angularjs2 app.
It's simply a SPA application with html5 mode urls and all I want is:
requests to www.mydomain.com/blabla... will be redirected ...
- 113
0
votes
1
answer
45
views
how to map my app to my domain in AWS
I am very new to AWS.
I have a java app which runs in AWS instance and I am able to run that using following myIp:8080/myApp
Also I have my domain (mydomain.com) registered with S3bucket, Now this ...
- 103
1
vote
1
answer
495
views
Encrypt on jenkins or S3 and decrypt on EC2 instance
I want to automate the deployment of new code on my application using AWS CodeDeploy. I'm using AWS to run my application. What I want to do is the following:
Build the application in jenkins (runs ...
- 113
1
vote
1
answer
163
views
Confusion about Amazon EC2 and S3
Planning to host a PHP website with MySQL DB in Amazon Web Services, which AWS components should I choose? The website is just a dynamic website with a custom CMS, though a large amount of data are ...
- 1,021
5
votes
3
answers
5k
views
Amazon Lambda for video and image processing?
The service I am building the architecture for has a video processing part in it. Basically, some people can upload videos (stored in S3) that will be split into frames with high resolution. From ...
- 151
0
votes
1
answer
618
views
Access s3 bucket from Ec2 service
I'm new to AWS and was looking for a bucket policy to enable my ec2 servers access to the S3 buckets on the same account.
I tried using this policy which enables the account:
{
"Sid": "...
- 101
0
votes
1
answer
402
views
Differentiating between volume, snapshot and understanding Stop
I am not very clear in the difference between a Volume and a Snapshot. When a new instance is created, it automatically creates a snapshotID like snap-ad8e61t8 in Volume under Elastic Block Store but ...
- 159
3
votes
2
answers
2k
views
AWS Windows EC2 instance: daily EBS snapshot without downtime
I have one "Windows Server 2008" instance on "Amazon AWS EC2" with two "EBS-volumes" attached: D:\, E:\.
I want to schedule a daily snapshot of only D:\ "EBS-volume" to "s3 bucket" so that we have ...
- 375
6
votes
3
answers
8k
views
What is the benefit of VPC Endpoints on AWS?
I learned a long time ago that if you want an EC2 instance to be able to talk to AWS services like SQS, Kinesis and the like, the instance has to either have a public IP address or there needs to be ...
- 1,214