Questions tagged [storage]
Primarily questions about disk storage, sometimes questions about application storage or cloud storage. Always questions about storing data.
1,960
questions
1
vote
0
answers
25
views
truenas NFS on kubernetes
I am using the following link to setup my k3s setup with Truenas. I am only interested in NFS. I will not be doing ISCSI. After I applied the "helm upgrade --install --create-namespace --values ...
- 159
2
votes
0
answers
33
views
Fix kickstart drift between CentOS 8 Stream behavior and CentOS 9 Stream behavior
I'm facing a weird situation on one of my server on the provisioning process.
Here is the machine HW Model:
HPE Proliant DL365 Gen 10 Plus with 6x 1.9TB SATA 6GBps SSD disks.
What's going on:
When I'm ...
- 975
-3
votes
0
answers
121
views
Expand storage on PERC H710 RAID 0 Dell Poweredge R620
I cant find any good tutorials online, its my first server, i don't know much.
I have a raid 0 and i want to expand storage without losing my data? And is it the same process to a raid 5?
I've read ...
- 1
2
votes
2
answers
72
views
Storage configuration for GPU servers (ML training)
We have recently purchased a couple of high performance GPU servers to use in training AI/ML models and the job of set up and administration has fallen upon me.
I'll preface this by saying I am ...
0
votes
0
answers
130
views
Proliant ML10 gen9 SSD upgrade
I have a proliant ML10 gen9 with windows server 2012 r2 foundation installed.
The system has a software raid 1 setup (intel rst) with two 1tb HP sata hdds and has started to run very slow.
I am ...
0
votes
0
answers
57
views
Kubernates - mount remote disk (Hetzner Storage Box) on pods
Imagine having a Pod with the capability to access a remote disk, in this instance, a Hetzner Storage Box. These types of storage can be accessed using various protocols
FTP/FTPS
SAMBA/CIFS
SFTP/SCP
...
- 101
0
votes
0
answers
35
views
CEPH STORAGE ERROR PLEASE
I am using ceph storage and the disks suddenly disconnected and when I tried to reconnect it on ESXi, it says time out. When I want to reboot iscsi.service on the server where it is installed, it does ...
- 1
0
votes
0
answers
7
views
Cannot see google storage buckets when connecting to VM through SFTP
Let's call sftp user Bob. On the VM itself, I can see and access the bucket no problem. Permissions are bob:bob. But when connecting via sftp directory buckets don't even show.
fstab config:
Bucket /...
0
votes
0
answers
121
views
Storage Replica Configuration Failure (error code 0x8009030e)
I`m not able to establish a storage replica between 2 windows servers 2016.
#The script I used
$SR = @{
SourceComputerName = 'Server-1'
SourceRGName = 'RG-1'
SourceVolumeName = "A:"
...
- 11
1
vote
0
answers
29
views
Hidden Storage Usage on Root Partition - Can’t Locate Files [duplicate]
I'm encountering a problem with the df command on my Debian 11.8 system. According to df, almost 90% of the space on my / (root) partition is being used. However, the root partition (formatted as ext4)...
- 11
4
votes
0
answers
67
views
Data Replication Approaches for Hot Standby Architecture
I'm relatively new to the world of storage & filesystems (please forgive me if I'm not using the correct language), and I'm currently researching ways to achieve a hot standby configuration -- i.e....
- 141
0
votes
0
answers
29
views
Storage configuration leads to Ubuntu Linux Server Boot failure - ( initramfs )
Ubuntu Server 22.04 installation is completed and successful but the OS doesn't boot!
What does mean initramfs ?
I've tried to install Ubuntu Server 22.04 on VM.
Installation is completed and ...
0
votes
1
answer
45
views
Can`t get Oracle SAS SSDs to work in HP Z640
I got a pair of SAS SSDs from a decomissioned Oracle server. Model name LB1606R SUN1.6T. I want to use them in HP Z640 workstation (running Windows 10 Pro) so I bought HP LSI 9217-4i4e SAS controller. ...
- 101
2
votes
1
answer
61
views
BIOS/Hardware Mirror Drive RAID 1 - Reliability, Consistency and Synchronization
Assuming I have enabled in BIOS a (presumably) hardware RAID in mirror aka RAID1 mode (as opposed to Software-one provided by the OS like Windows Storage Spaces), how is it actually ensuring data ...
- 127
0
votes
1
answer
50
views
Server 2022 Expand C:
I have a server running Server 2022. It has 2 Disks running in a raid configuration, copying everything from one disk to another (2TB per disk, 2TB total storage). I added 2 more disks(2TB ea), ...
0
votes
0
answers
44
views
Failover and offline reads in GlusterFS?
I have a cluster, where all machines have the daemon running and the clients mounted. As far as I understand, only the machine where I run peer probe becomes the host.
If a client goes down:
the ...
- 19
1
vote
0
answers
75
views
Multi-node OpenStack with iSCSI storage
I’m trying to deploy a multi-node OpenStack environment using Kolla, Ansible, and Ubuntu server. I successfully added a partition to my Cinder storage using iSCSI. But I can't configure OpenStack to ...
- 11
0
votes
1
answer
94
views
Data Sync between 2 Datacenters
I'm reaching out to you in the hope that some of you can provide me with fresh ideas for a current problem I'm working on. I'm planning to set up a redundant data center (including websites, mail ...
4
votes
1
answer
298
views
How to configure a LSI MegaRAID controller to host non-RAID backup disks which allow hot swap
I'm running a server with a LSI MegaRAID controller that has 4 slots in the backplane for 4 SATA HDDs. Two of those slots are used for HDDs which are configured as RAID1 which is used as the "...
- 43
0
votes
0
answers
134
views
Test-SRTopology Fails to Create CIM Session to Local Host
We are trying to setup Storage Replication between two brand new Server 2019 VMs. I have followed all the steps in Microsoft's guide (https://learn.microsoft.com/en-us/windows-server/storage/storage-...
- 444
0
votes
1
answer
48
views
Can I mirror a 2-disk striped zpool to a single large drive?
Currently I have a 4TB pool with two striped drives:
# zpool status
pool: lxd
state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
still be used, but some ...
- 65
1
vote
1
answer
37
views
Storing each file on separate physical drives for a single file volume
I am working with a bunch of really large files (>100 GB). As we often process multiple large files in parallel (e.g. 10-12), we think that it might be advantageous to have each file be stored on ...
- 13
-1
votes
3
answers
182
views
how to design a sql query to have sub-columns in the result?
I tried several sql queries but it does not meet my expectations because in the result I cannot have sub-columns
i need to design a sql query for the following result (have sub-columns in the result):
...
-2
votes
2
answers
74
views
How many SAS drives can you put on an ASUS RS720A-E11/E12-RS24U?
The ASUS RS720-E12-RS24U server comes with 24 2.5‘‘ drive bays. The specification on the ASUS web page says that only 8 of the 24 bays support SAS drives. However, according to the manual, (chapter 2....
- 117
0
votes
0
answers
40
views
How to size compute/gpu/storage/network for generative AI or LLM? [duplicate]
I would like to provision compute (servers), gpus (say 2 A100 80GB or H100), storage and network (may be 100GbE) to run OpenApaca 7B (https://huggingface.co/openlm-research/open_llama_7b) model.
How ...
- 1
0
votes
0
answers
38
views
Windows Server 2016 Standard: User accounts filling up C: drive, but the accounts are empty
I'm dealing with a virtual server that keeps maxing out the C: drive due to the Users directory. The Users directory has well over 2,000 Users, each taking up ~70MB of space, but when I look in an ...
0
votes
0
answers
667
views
ceph "permission denied" when adding storage OSD
I just setup three storage nodes for ceph in a qemu/kvm environment to learn about it. OS is Ubuntu Server 22.04 LTS. The ceph and ceph-common packages are from standard repos. I followed the ...
0
votes
0
answers
187
views
LVM disk is corrupt - is any data recoverable?
Under RHEL7 we have a logical volume consisting of 27 volume groups PVs. Each of these VGsPVs was added sequentially as we ran out of space on the LV.
We do not have a backup of the data. There are ...
- 141
0
votes
1
answer
82
views
HBA in Linux storage server - best practices for many HDDs
I will launch and administrate a Linux storage server: 4U, HBA LSI 9500-16i Tri-Mode, hybrid. It wiill possess 12 positions for the HDDs/SSDs in the back, 24 positions in front. There is an expander ...
- 11
0
votes
0
answers
77
views
Many drives in two RAID6 arrays simultaneously failed, seem to be working after reboot except SMART long test
in my storage server, I operate three RAID6 Linux software arrays. Everything was working fine until it was not.
There are two RAID6 arrays and one RAID5 array, all consisting of SATA drives, all ...
- 11
0
votes
1
answer
61
views
Jenkins - Space distribution
We are running a Jenkins server with multiple nodes. After some time and more and more projects that got added to the instance, we are encountering multiple issues (that we have to few people to solve,...
0
votes
0
answers
36
views
Erasure coding error detection ability
I would like to know in an (2+1) Erasure coding storage setup, can it detect corruption when one node is lost, and there is a silent data corruption from HDD on one of the remaining node.
I am ...
- 23
1
vote
1
answer
64
views
iSCSI shared disks with custom device name on clients
I'm using RHEL 7.9 (Maipo) and need to setup for all iSCSI clients the same device name, like /dev/sdb or /dev/thiscustomname.
I could do that by sharing the source disk using multipath, but for Db2 ...
- 113
21
votes
1
answer
2k
views
Birth time of files are missing if file is created in a logical volume with size less than 512 MB
I have a volume group in my system, created with single physical volume.
I'm creating two logical volumes - one with size 100M and one with size 512M.
Any file created on LV with 100M size does not ...
- 333
0
votes
0
answers
31
views
df command showing incorrect information
i have two rhel 7.9 servers with replicated glusterfs storage, and the df command is dispalying wrong size information on both servers
The machines size on Vcenter is 16.3To but when using df it shows ...
0
votes
0
answers
21
views
Spanned disk created from a single LUN?
Does this appear to you as a single 2 TB LUN (Disk 4), separated into two separate 1 TB partitions, then spanned together into a logical volume ('G')? If so, how was this accomplished? I am unable to ...
- 41
5
votes
2
answers
1k
views
Windows File server heavy cpu usage - Render Farm with many clients reading data at once
I have a windows file sever with Dual Xeon E5-2650v4 cpus. They are 14 core each so 28 cores total.
The network interface is a Mellanox Connectx3 40gbs.
The disk drives in the server are 7.68TB Sata ...
- 51
1
vote
1
answer
83
views
Upgrade from SATA to SAS: Expected speedup?
My current setup is this:
Megaraid 9361-16i
12 x 12 TB SATA disks WD DC HC520
Connected to the controller via 3 of the 4 SAS ports
Configured either Raid-10 or Raid-6 without spares. Raid-6 in write-...
- 113
2
votes
4
answers
602
views
Creating replicated gluster volume always gives Distributed-Replicate volume
Peace upon you,
I am trying to create a replicated gluster volume but always it gives me Distributed-Replicate volume
i followed the following commands
Pool Peers
root@tiny1:~# gluster peer status
...
- 121
0
votes
1
answer
43
views
Cloud File Storage: Does zipping files reduce data transmission speed / costs?
If I need to store, say, a 5gb file on a cloud file storage location (e.g., aws s3 bucket), will zipping the file reduce the cost / latency when people download it?
Obviously zipping a file reduces ...
- 105
1
vote
2
answers
338
views
Expanding XFS file system from another device?
I have two virtual devices on a fedora system. Both are in a raid 5 configuration. No LVM is in place. The system it’s self is installed on one of the devices. That same device is also the one with ...
- 113
5
votes
1
answer
619
views
Linux immutable backup repository deployment architecture best practice?
What are the Linux distributions that are compatible with the Immutable repository?
Can you give me some advice on the best hardware or virtual machine configurations to deploy a large backup ...
- 1,295
1
vote
1
answer
43
views
Netapp Storage to HP Nimble cloud
We have a working Netapp Setup with FAS2720 9.7P9 Version connected to Fujitsu ESXi (VMWare 5.5). With multiple VMs running on 3 ESXi Systems but they are residing entirely on Netapp Storage.
We are ...
- 11
0
votes
1
answer
114
views
Recover files from deduplicated volume in Windows Storage Server 2016
We have a Windows Storage Server 2016 having some volumes with Storage Deduplication enabled.
Its OS crashed so we had to re-install the OS (couldn't restore from backup).
There are some files which ...
- 103
-1
votes
1
answer
43
views
Do clouds charge upon the storage usage or processing power or both? [closed]
I am interested to know if I want to deploy my Kubernetes cluster on a cloud service like AWS, do they charge upon the storage my application uses or the processing power it uses or both?
Is there any ...
- 407
0
votes
1
answer
74
views
Can you use a SAS fan-out cable to connect more drives?
I bought a Broadcom 9400-16e HBA that has four external ports. I was hoping that by using four mini-SAS cables that fan-out to two, I could double the number of connected drives from 16 to 32. However,...
- 141
0
votes
0
answers
505
views
LVM thin pool show 100% usage
I've deployed openstack and used LVM as a backend for the cinder block storage, but after using it for a while I could no longer allocate block storage volumes , after checking the available space in ...
- 35
1
vote
1
answer
190
views
RAID6 REBUILD - Virtual Drive not importable
Good morning,
Last week, the heatsink of our LSI9271-8i Raid card dropped off from the card and the card is dead. It is an 8 disk x 10TB (Slot7 is hot spare) RAID6.
Well, we have another LSI9271-8i, ...
- 11
2
votes
2
answers
606
views
Distributed SSD cache for network storage
Our small computing cluster has 3 computing nodes and 1 file server. The file server has around 70TB data to be accessed by the 3 computing nodes. All of the 3 computing nodes have 3 4TB SSDs which ...
- 21
1
vote
2
answers
169
views
Configure ceph block storage pool in cockpit
I have a plain install on machine C with Oracle Linux 9.1 and cockpit and cockpit-machines. On machines A and B I have a ceph cluster configured which defines an rbd block storage pool for VM disks. ...
- 121