Questions tagged [object-storage]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
3 votes
2 answers
11k views

Deploy Minio distributed on 3 nodes with 1 drive

I need to deploy a MinIO infrastructure on three nodes, where each nodes has a single local directory where they can save files in. I read the MinIO Erasure Code Quickstart Guide, but I don't need ...
Mat's user avatar
  • 1,893
1 vote
1 answer
396 views

Use NGINX as a reverse proxy for Object storage to serve WEBP conditionally

I'm using a location config like this in Nginx for serving WEBP when the user supports it map $http_accept $webp_suffix { default ""; "~*webp" ".webp&...
erfan's user avatar
  • 11
0 votes
1 answer
339 views

How does an object store write objects to disk

In an object storage solution, how is the object data actually written to the underlying storage volumes? i.e. In what format is it written? Does it use an intermediate file system, or does it access ...
swami's user avatar
  • 155
0 votes
1 answer
128 views

Storing 100 million files in the same "directory" under S3-compatible storage?

I have > 100 million image files (book covers) as a flat list of files under a single "directory": /images/000000093e7d1825b346e9fc01387c7e449e1ed7 /images/...
BenMorel's user avatar
  • 4,557
0 votes
1 answer
434 views

Object Storage vs HDD Block Storage

Currently I am using SSD Block Storage at Digital Ocean which is very costly. When I checked Vultr they are providing HDD Block Storage. Which is cheap. We have to store approx 700GB of data (Mostly ...
Future King's user avatar
0 votes
1 answer
841 views

cannot Delete objects on s3 ceph bucket

I have a ceph cluster and running a few s3 bucket on it, 'gitlab-s3-api' user has full permission on everything on ( users=;buckets=;metadata=;usage=;zone=* ) but very oddly it cannot delete any file ...
AliReza NaSRi's user avatar
0 votes
0 answers
232 views

How suitable is a S3 backend for rsync operations?

I run a large server providing open source software (https://ftp.halifax.rwth-aachen.de), currently serving more than 30 TByte of data with Multi-Gigabit throughput. Data is synchronized and kept up-...
C-Otto's user avatar
  • 334
0 votes
1 answer
2k views

Ceph Cluster - Reduced data availability: 96 pgs inactive And All OSD Nodes Are Down

I set up my Ceph Cluster by following this document. I have one Manager Node, one Monitor Node, and three OSD Nodes. The problem is that right after I finished setting up the cluster, the ceph health ...
Shaghayegh Tavakoli's user avatar
0 votes
1 answer
208 views

How can each OpenStack Swift object-storage container be set up with a different password/key in a standard way?

I'd like to have many storage buckets, each with its own password or key for read & write access for use by end users. Some options I've discovered: ACLs: These work on a per-OpenStack-user basis....
colan's user avatar
  • 520
0 votes
1 answer
510 views

Experience with using Openstack Swift with s3fs multi user access?

Does anyone have experience with using Openstack Swift object storage with s3fs and having multiple write mounts accessing the same file(s) at the same time? The man page for s3, for example: https://...
mlum's user avatar
  • 1
-1 votes
1 answer
483 views

Cephadm + Openstack Keystone Integration

Hello I am trying to Integrate Openstack Keystone as Ceph authentication Mechanism So i can use ceph object storage as openstack swift backend Environment: Kernel : Ubunutu Server LTS 22.04 (minimal) ...
Hoodad Tabibi's user avatar