Questions tagged [replication]
Replication is the process of sharing information so as to ensure consistency between redundant resources, such as software or hardware components, to improve reliability, fault-tolerance, or accessibility.
1,037
questions
45
votes
10
answers
6k
views
PostgreSQL Replication
We constantly bat this around the office, and the question continues to come up. How do you deal with PostgreSQL replication? I'm not even necessarily talking about advanced clusters, just keeping it ...
- 859
29
votes
2
answers
40k
views
Reload my.cnf without restarting MySQL service
I have to configure a MySQL server to act as a replication-master.
I modified my.cnf to activate binary logs, but now in order to reload configuration I have to reload the service with /etc/init.d/...
- 407
25
votes
2
answers
15k
views
Is it a good idea to store Docker volumes in glusterfs?
I am currently thinking about migrating some of our servers and apps to a coreOS environment. One of the problems I see here is the management of persistent data as coreOS does not handle Docker ...
- 363
21
votes
1
answer
12k
views
PostgreSQL 9: Does Vacuuming a table on the primary replicate on the mirror?
Running PostgreSQL 9.0.1, with streaming replication keeping one read-only mirror instance up to date. Auto-vaccuum is on on the primary, except for a few tables which are not vacuumed by the auto-...
- 596
19
votes
3
answers
12k
views
How fast is MySQL replication?
I'm considering setting up replication of our mysql db to be able to have local slaves in each of our branch offices, while having the master in the main office to improve application performance (...
- 673
17
votes
7
answers
15k
views
USABLE multi-master replication for Postgres?
I tried Postgres-XC and it doesn't implement full SQL yet (like SERIAL)
Postgres-R looks interesting but it's "not production ready" according to developers.
So I used pgpool-II 3.0.1. Yes, it works ...
- 379
16
votes
3
answers
7k
views
Windows Server: Replicate folders without DFS?
From reading the DFS documentation, AD appears required.
This is a problem for us because our servers are either stand alone (not in AD), or part of our hosting service AD, and AD is out of our ...
16
votes
4
answers
600
views
Starting a branch office on the other side of the world
Going to cut right to the point on this question, as I'm after as diverse range of solutions as possible so don't want to effect any opinions with the question too much.
Client is a UK based company.
...
- 3,235
16
votes
7
answers
20k
views
Is DRBD the only viable block replication solution for Linux?
I've found myself needing redundant storage at a block level. File-level replication (Gluster, GFS, etc) does not work for my use case.
It looks like DRBD is the go-to solution for block replication....
- 1,214
15
votes
3
answers
7k
views
MySQL Replication Performance
I'm having a serious issue with MySQL 5.5 replication performance between two machines, mostly myISAM tables with statement based replication. The binary logs and mysql data directory are both located ...
- 153
15
votes
5
answers
23k
views
mirrored filesystem across a few servers
I'm looking for a solution to mirror or replicate one directory (or one filesystem) across a few Linux servers. Ideal solution would be one, which permits all servers read-write access. I also want it ...
- 6,237
14
votes
5
answers
11k
views
Prevent non-replication writes to MySQL slave?
We have some MySQL database servers set up with row-based replication, for performance. The software writes to the master, and reads from either the master or the slave. Everything's working great, ...
Ken
14
votes
4
answers
4k
views
Has anyone ever used SMTP site links?
A simple real-life question, inspired by a comment here:
Active Directory has supported inter-site replication using SMTP instead of direct RPC since its first introduction in Windows 2000.
But did ...
- 70.7k
12
votes
3
answers
38k
views
How to actually use mysql slave as soon the master is failover or got burnt
I have MySQL master-slave replication that works fine; I googled the whole net and MySQL site to find the standard procedure to make use of the replication but found nothing. It is as if admins are ...
- 254
12
votes
4
answers
4k
views
Windows Domain replication monitoring tool
I am looking for web-based interface GUI, or some kind of monitoring tool that will show replication status for a domain.
I know I can use repadmin with various options on the command line to query ...
- 131k
12
votes
1
answer
12k
views
ZFS on Linux (ZoL) and realtime replication
I would like to understand what is the best solution for realtime replication between two ZFS on Linux (ZoL) boxes connected by a 10 GbE link. The goal is to use them for virtual machines; only one ...
- 49k
11
votes
3
answers
11k
views
Windows DFSR - Changed replicated directory permissions and now have a 350,000 backlog for more than a week
Question: Is there a way to make this 350,000 file backlog complete faster? For nearly every file the only change was a change to the ACL for each affected file. Some files have changed content, ...
- 435
11
votes
4
answers
53k
views
MySQL simple replication problem: 'show master status' produces 'Empty set'?
I've been setting up MySQL master replication (on Debian 6.0.1) following these instructions faithfully: http://www.neocodesoftware.com/replication/
I've got as far as:
mysql > show master status;...
simon
10
votes
2
answers
3k
views
Expected performance of e-SATA port multiplication?
For a certain read/write workload, I get 30 MiB/s from a 4-disk array using esata port multiplication. When I move the exact same array to four individual sata connections, I get 90 MiB/s for the same ...
- 113
10
votes
2
answers
8k
views
How do MySQL logs compare to Postgresql logs?
MySQL has quite a few logs:
InnoDB transaction log
Binary log
General query log
Error log
Slow query log
I know about Postgresql's WAL, which is equivalent to InnoDB's transaction log (correct?).
...
- 3,110
10
votes
1
answer
3k
views
Can ZFS using snaphots replace DRBD using sync protocol A?
This question is related to a former, more generic one, but this time I would like to ask more specifically if ZFS can replace DRBD in a use case like mine. That is two servers, both hosting their own ...
10
votes
4
answers
5k
views
Is GlusterFS a good pick for keeping webservers in sync?
I've got 2 webservers, with the chance of having to add more servers along the way. Right now I keep these servers in synch using lsyncd + csync2. It works well performance wise because all files are ...
- 1,576
9
votes
4
answers
31k
views
How to find slave's IP address and user name from Master server?
I am writing code to extract the IP address and username of all slave servers in a MySQL replication environment.
Does anyone know any function, variable, or something else that I can run in the ...
- 321
9
votes
6
answers
14k
views
Create a MySQL slave from another slave, but point it at the master
Problem
I have MySQL replication setup between 2 servers, master (A) and slave (B). I need to add a new slave to the mix (C). I want this slave to get it's updates directly from the master, I do not ...
- 441
9
votes
2
answers
2k
views
How to scale out OpenStreetMap data efficiently
For over a year now, I'm running an in-house PostGIS server filled with OSM data, used for both Mapnik-based tile generation and Nominatim-based geocoding, updated with day replicates. This works ...
- 243
9
votes
1
answer
21k
views
Which binlog format to use for MySQL Replication?
Just about to start using MySQL replication and I'm wondering what kind of binlog format is the best to use? There's Row, Statement and Mixed.
I'm going to be using 5.1.49.
Row is winning at the ...
- 91
9
votes
3
answers
14k
views
Run a MongoDB configuration server without 3GB of journal files
For a production sharded MongoDB installation we need 3 configuration servers.
According to the documentation "the config server mongod process is fairly lightweight and can be ran on machines ...
- 240
9
votes
1
answer
7k
views
Redis Multi-Master Replication
Scenario: We have two datacentres which run concurrently (both serve traffic).
Each has it's own entire stack of infrastructure, so it can operate without the other being up.
That said, we would ...
user65539
8
votes
2
answers
898
views
Is there a difference in bandwidth consumption between a RODC and RWDC?
My organization has deployed 2008 RODCs on multiple seagoing platforms. The idea was to extend our shore-based domain onto our ships to better control security policies. RODCs were selected with the ...
8
votes
4
answers
711
views
Replicating storage efficiently
I want to replicate in the region of 10Tb of data (lots of smallish files, low level of churn) across a WAN with minimal impact on the available infrastructure.
While I could simply use rsync, this ...
- 21.9k
8
votes
4
answers
9k
views
Need to DUPLICATE HTTP requests to two servers
We're developing an new server to replace an old one, and want to put the side by side for before & after tests - so that we can compare the end result and find the discrepancies.
The input to ...
- 233
8
votes
1
answer
1k
views
Why would a domain controller encounter a USN rollback after an unclean shutdown?
I have this Windows Server 2008 R2 domain controller running on a physical Dell server, model PowerEdge R510.
There are some electrical problems around here, thus a black-out is, unfortunately, quite ...
- 70.7k
8
votes
2
answers
2k
views
Is it safe to replicate from Solaris ZFS to FreeBSD ZFS?
Is it safe to replicate from a Solaris 10 ZFS v22 to a FreeBSD 8.3 ZFS v28?
Are there someone that have done this with specific versions of ZFS, where it worked perfectly?
- 486
8
votes
5
answers
4k
views
Block-level LUN replication options for Windows [closed]
When it comes to replicating a LUN or partition to a physically separate server, Linux has DRBD (now in the kernel!). As I understand it, it has both synchronous and asynchronous replication modes. ...
- 134k
8
votes
1
answer
2k
views
AD Replica DC Promotion Stall
I recently inherited infrastructure duties for a small startup I am working with. My traditional role has been development, so bear with me...
I was hoping to start off on the right foot, and get ...
- 81
7
votes
3
answers
7k
views
What does zfs receive -F do?
When I read man zfs for zfs receive I see
-F Force a rollback of the file system to the most recent snap-
shot before performing the receive operation. If receiving an
...
- 10.4k
7
votes
2
answers
42k
views
How to monitor DFSR backlog more efficiently than dfsrdiag
Is there a way to monitor the DFSR backlog in a manner more efficient than using dfsrdiag.exe backlog?
I wrote a program that just slurps in the backlog count via dfsrdiag.exe backlog /smem:alpha /...
- 435
7
votes
1
answer
1k
views
Data missing after ZFS replication on FreeNAS/TrueNAS
In order to use the new encryption method in TrueNAS 12 I copied all data from a legacy encrypted FreeNAS pool to a newly formatted pool via a replication task.
After replication there seems to be ...
- 73
7
votes
2
answers
39k
views
DRBD Not syncing between my nodes
Some version info:
Operating system is Ubuntu 11.10, on EC2, kernel is 3.0.0-16-virtual and the application info is:
Version: 8.3.11 (api:88)
GIT-hash: 0de839cee13a4160eed6037c4bddd066645e23c5 build ...
- 1,265
7
votes
6
answers
7k
views
Is it possible to use an EC2 RDS MySQL instance as a slave to an external master?
I have a master MySQL instance running on our local network, but I was wondering if I can get an EC2 RDS instance to replicate the master or is this locked down by amazon?
user57758
7
votes
1
answer
1k
views
ZFS replication between 2 ZFS file systems
I initially replicated tank/storage1 --> usb1/storage1-slave (depicted below), and then (deliberately) destroyed the snapshot I replicated from. By doing this, did I lose the ability to incrementally (...
- 113
7
votes
1
answer
1k
views
one of the single dc per domain DCs has suffered USN rollback
I've inherited an Active Directory forest that is laid out very badly. It has a single forest with a domain tree for each site, each with a single domain controller. No domain is a child of any ...
- 2,625
7
votes
3
answers
2k
views
Replicate a big, dense Windows volume over a WAN -- too big for DFS-R
I've got a server with a LOT of small files -- many millions files, and over 1.5 TB of data. I need a decent backup strategy.
Any filesystem-based backup takes too long -- just enumerating which ...
- 1,910
7
votes
4
answers
13k
views
Open Source Alternative to Microsoft's File Replication Services [closed]
We're operating two rather busy locations with 40+Gigs of client data shared on Windows 2003 servers and need to have it replicated (as close to instantaneously as possible) to each.
We're ...
- 250
7
votes
6
answers
5k
views
Syncing multiple wordpress web servers in a farm
My company will shortly be setting up a blog, and I'm planning on setting up two web servers to host the wordpress website for redundancy. Normally when we do releases to a site in a farm we push to ...
- 27.2k
6
votes
4
answers
4k
views
Testing MySQL Database Replication / Synchronization
I'm setting up a MySQL Master database which replicates to a few Slave databases.
My question is what are the best practices to monitor and / or test that the slave databases are up-to-date, and that ...
- 163
6
votes
9
answers
13k
views
Make identical copy of Centos
I have a CENTOS server running and i want to make identical copy of it(all software,users), like twin server for mirroring purposes. how do i do that?
- 63
6
votes
4
answers
9k
views
How can I rebuilt MySQL replication without dumping the master?
Our MySQL database has grown fairly large, and I am running with master replication. Replication is broken. I am trying to rebuild the second master without freezing up the first master in doing a ...
- 161
6
votes
3
answers
2k
views
What are the typical methods used to scale up/out email storage servers?
What I've tried:
I have two email storage architectures. Old and new.
Old:
courier-imapds on several (18+) 1TB-storage servers.
If one of them show signs of running out of disk space, we migrate a ...
- 61
6
votes
2
answers
4k
views
Way to avoid server downtime when creating Master - Slave relationship?
I am preparing for setting up a MySQL master-slave or master-master relationship. Right now I have a single MySQL production server, and of course I don't want a lot of downtime while I connect the ...
- 302