All Questions
Tagged with amazon-s3 amazon-ebs
31
questions
-1
votes
2
answers
346
views
How do I share all resources between two AWS Root accounts?
We have one person that has been in charge of all AWS resources for our company, including EC2, elastic IPs, EBS storage, etc. Now we want a second person to also have access to ALL the resources in ...
- 109
3
votes
2
answers
809
views
Why AWS encryption for EBS and S3 is disabled by default? [closed]
For EBS and S3 encryption (even via the default key from KMS) is disabled by default, as I understood from the documentation, there is no difference to the user if volume/objects is/are encrypted ...
- 133
0
votes
1
answer
764
views
EBS vs EFs vs FSx vs S3 for feeding data to a distributed machine learning model?
Lets says there are 1TB of data to be simultaneously fed to 100 EC2 consumer instances. Each instance accesses random chunks of data of size 10MB. What would be the considerations to take into account ...
- 101
1
vote
1
answer
1k
views
What is the difference between "Amazon Storage Gateway" and another storages?
I use "Amazon Web Services (AWS)" and I think about share storage with more instances "Elastic Compute Cloud (EC2)". Data grows by client usage, and may be searched in those data.
Obviously I should ...
- 819
0
votes
1
answer
374
views
Use S3 bucket as a mounted drive or EBS volume on EC2?
I have an application that writes the logs on the server, it is a windows server. By increasing the logs the disk drive used space, increases and we have to scale up the volume from time to time. ...
- 261
2
votes
1
answer
700
views
Docker Storage in AWS. S3, EBS or EFS
I have just moved companies and I am building a new docker swarm on aws. In my last organisation everything was on premises.
I am trying to understand my options for persistent volumes, and see that ...
- 125
1
vote
1
answer
84
views
Error writing from S3 to EBS
I'm trying to copy from an S3 bucket to a mounted EBS volume on a Windows EC2 Instance.
I have the following IAM policies in place:
AmazonEC2FullAccess
AmazonS3FullAccess
...
- 21
1
vote
1
answer
374
views
Is there any way to persist files for a web application using Amazon AWS without a full VM?
I would like to migrate an web application to Amazon AWS.
The application stores and retrieves small persistent data from a content/ directory. I tried Amazon Elastic Beanstalk to deploy the ...
- 168
-1
votes
1
answer
128
views
how to migrate shared mount points to aws
we are planning to migrate to AWS, how do you migrate shared NFS mount points to AWS, we have file systems in them. Is S3 a good choice or EBS, Is there any other way to do this, how have people been ...
- 103
1
vote
2
answers
636
views
How to take EBS Volume snapshot and store to S3 Reduced Redundancy?
By default, EBS Volume snapshots on AWS are stored to S3 Standard storage. I would like to figure out how to direct those snapshots to Reduced Redundancy storage instead. I've been trudging through ...
- 75
0
votes
1
answer
402
views
Differentiating between volume, snapshot and understanding Stop
I am not very clear in the difference between a Volume and a Snapshot. When a new instance is created, it automatically creates a snapshotID like snap-ad8e61t8 in Volume under Elastic Block Store but ...
- 159
3
votes
2
answers
2k
views
AWS Windows EC2 instance: daily EBS snapshot without downtime
I have one "Windows Server 2008" instance on "Amazon AWS EC2" with two "EBS-volumes" attached: D:\, E:\.
I want to schedule a daily snapshot of only D:\ "EBS-volume" to "s3 bucket" so that we have ...
- 375
0
votes
1
answer
1k
views
Is S3 a proper choice to keep live linux user home directories?
We are building an RDP cluster using Amazon EC2/S3. Users' home directories are on S3 (single bucket) and all EC2 nodes mount the same S3 bucket using S3FS. Each EC2 node uses the appropriate home ...
- 23
8
votes
5
answers
30k
views
How can I set up an SFTP server backed by S3 (or similar)
I need to set up an SFTP server that, essentially, has very large capacity. I need to give one of our partners SFTP login details to a server where they will upload millions of files, totalling a few ...
- 1,432
0
votes
1
answer
1k
views
AWS: Best solution for syncing files across autoscaled EC2 instances?
I'm working on setting up autoscaling on EC2; Instances will be running a web app with big traffic spikes. The first solution I tried for syncing files across instances (since the web app will write ...
- 511
-2
votes
1
answer
164
views
Sync EC2 instances [closed]
I know many people have asked how to sync multiple ec2 instances and it seems the usual answer is to store all the assets in S3. Would this still make sense if the only thing I am trying to share ...
- 113
1
vote
1
answer
931
views
Restore snapshot from other aws account?
I am new in this, so forgive my beginner question. I have an aws account which is currently in us-west-2c. It has a instance running, and also a couple of volumes which i made. I have multiple backups ...
-2
votes
1
answer
813
views
Which is better - AWS S3 or EBS? [closed]
I am trying to create a system where users can upload their data (audio, text) which can run into around 200 MB per user. I am trying to figure out what is the best way to go ahead - using S3 or EBS.
...
- 149
0
votes
1
answer
195
views
Empty /mnt: store-backed instance launch from EBS-backed AMI
I have an EBS AMI which I want to publish in AWS Market Place.
The AMI was created with data in /mnt.
The snapshop includes both /dev/sda1 and /dev/sdb devices :
Block Devices: /dev/sda1=snap-xxxxxx:8:...
2
votes
1
answer
256
views
How can I turn an existing Windows Server 2008 EBS-backed instance into a S3-backed (instance-backed) AMI?
I understand there is no direct conversion to get from EBS to S3. But is there some series of steps that can make this happen, or is rebuilding the image from scratch the best option?
Is there a way ...
- 145
5
votes
2
answers
3k
views
What design features make Joyent's ZFS and Amazon's EBS (S3) reliable?
I know this isn't exactly an apples to apples comparison, what I'm trying to evaluate is which one is safer - less likely to lose data.
Joyent's SmartOS uses ZFS to store data whereas an EC2 machine ...
- 435
3
votes
3
answers
4k
views
Amazon EC2 - What's the point of having Instance storage if it is non-permanent and EBS provides a permanent store?
I'm specifically looking at the Standard Large On-Demand instance which has 850 GB of instance storage.
What I really don't understand is why have 850 GB of storage on the instance if that data will ...
- 1,741
9
votes
2
answers
4k
views
EC2 - Shared Storage - S3FS or EBS?
Building my web service onto EC2 right now and have a single instance behind a load balancer. I will of course cater for multiple instances.
My initial idea was to run all the instances a dumb slaves,...
- 344
0
votes
3
answers
2k
views
Best practice for storing read-only instance data?
So, i'm currently writing my bachelor thesis and my job is to cloudify a webservice which recommends a soundtrack for images. The main part of the recommendation process is a lookup on a ~40gb index ...
- 101
2
votes
4
answers
905
views
What kind of EC2 setup do I want?
Okay, I'm more of a coder, and not as familiar when it comes to things like system setup, though I try my best. I'm currently using Slicehost (stats below) to run a personal website that gets an okay ...
- 567
2
votes
2
answers
725
views
AWS S3 and EBS backup?
I'm rather new to Amazon Web Services. I have a question regarding S3 and EBS. Do I have to backup an S3 or EBS service? Are these types of storage secure and backuped by amazon itself?
- 698
2
votes
2
answers
1k
views
Best AWS Architecture?
The goal is to have as much redundancy as possible so that we can quickly recover from instance failures or any other issues. Our current AWS setup for a Rails WebApp that we run is as follows:
EC2 ...
- 131
1
vote
2
answers
2k
views
Speed of file transfer from Amzon S3 to EC2/EBS
I'm working on estimating how long it would take to download 100 GB worth of files from Amazon S3 to an EBS drive. Assuming both are in the same region, what kind of speed could be expected?
- 528
4
votes
3
answers
314
views
AMIs in Amazon EC2
I really like the Amazon EC2 environment, and thought I'll spend a bit of time playing around with various types of public (Windows!) AMI servers. But testing has been a bit, well, questionable. Some ...
Jack of Trades
6
votes
4
answers
3k
views
MogileFS/GlusterFS/etc + Amazon EBS + Amazon EC2
I have a web application that serves binary files (images, etc). Our application runs on Amazon EC2. We were originally going to use Amazon S3 to store and serve these files, this is no longer an ...
- 367
3
votes
4
answers
926
views
best practice? Consumer data in MySQL on Amazon EBS (Elastic block store)
This is a consumer app, so I will care about storage costs - I don't want to have 5x copies of data lying about. The app shards very well, so I can use MySQL and not have scaling issues.
Amazon EBS ...
- 161