Questions tagged [duplicity]
duplicity is an open source software to backup data incrementally in an encrypted format. It can save/upload the backup to local or remote destination. It is written in python and uses librsync.
107
questions
47
votes
7
answers
64k
views
How can one efficiently use S3 to back up files incrementally?
I understand how rsync works on a high-level, but there are 2 sides. With S3 there is no daemon to speak of — well there is, but it's basically just HTTP.
There look to be a few approaches.
s3rsync ...
- 571
20
votes
2
answers
9k
views
Duplicity Full Backup Lifetime and Efficiency
I'm trying to work up a backup strategy for some clients, and am leaning towards duplicity for remote backup (already use rdiff-backup for internal/on location backups).
Is it reasonable to want a ...
- 511
18
votes
2
answers
25k
views
How to list all available backup dates using duplicity
Using duplicity to backup a folder on a certain event, how can I get a list of all available backup dates as I don't know in advance when the event occurred?
I want to list the available dates as deja-...
- 765
14
votes
1
answer
6k
views
Duplicity: recommended value for --volsize?
I am backing up ~800GB from a server to a NAS via Gigabit (destination is a share mounted on the server I need to backup). What value would you recommend for volsize?
Thanks
- 347
13
votes
2
answers
17k
views
How can I restore a duplicity backup from a certain date?
Is it possible to restore a duplicity backup from a certain time in the past?
For example, if I'm making daily incremental backups, is there a way to restore a backup from three days ago?
- 233
13
votes
5
answers
11k
views
Duplicity: How to list versions of a file?
Using Duplicity I can make an incremental, efficient backup to an untrusted remote storage. This works fine and I can restore files at a specific point in time (or the next backup after that).
Well ...
- 1,978
10
votes
3
answers
12k
views
Very Huge Sized Cache of Duplicity
I am currently using a duplicity script to backup my 110G/2T CentOS server to a 2T sftp server.
Since 4 days passed, duplicity backed up just 90G. This is not a problem. The main problem is; I have ...
- 205
8
votes
4
answers
16k
views
Backup a remote directory with duplicity
Is it possible to backup a remote directory to a local path?
Using two URL in the command raises
Two URLs specified. One argument should be a path.
Using only one for the remote but specifying the ...
- 133
8
votes
3
answers
6k
views
Duplicity not writing to a pre-existing S3 bucket
I'm trying to backup a directory to a pre-existing Amazon S3 bucket using the following command:
duplicity --no-encryption system/ s3+http://MY_BUCKET_NAME/backup
However, I'm getting the following ...
- 489
7
votes
2
answers
7k
views
How can I use Duplicity with a symmetric key?
I am using duplicity to perform backups on my server. Right now duplicity is encrypting the backup using a GPG public-private key system. I would prefer to encrypt the backup files using just a ...
- 555
7
votes
4
answers
3k
views
Preventing duplicate DHCP server on network
How can I prevent a duplicate DHCP server on a network from interfering? Is it possible?
I am not asking for any actual scenario that is happening, just curiosity. In my apartment complex there is a ...
- 145
6
votes
5
answers
9k
views
user GPG key not able to be used by SUDO
I created a script that runs duplicity to backup files I have on a VPS,and uses a GPG key that I generated as a user.
When I try and run this script as SUDO I get:
GPGError: GPG Failed, see log ...
- 655
5
votes
4
answers
11k
views
How to manually extract a backup set made by duplicity?
I have a set of files on my webserver produced by duplicity software:
duplicity-full.20110315T085334Z.vol1.difftar.gz
duplicity-full.20110315T085334Z.vol2.difftar.gz
duplicity-full.20110315T085334Z....
- 321
5
votes
1
answer
2k
views
How can I set up automated, encrypted backups of live MySQL databases on a Ubuntu VPS to Google Drive using Duplicity?
We're using DigitalOcean as our VPS provider. They have a tutorial on how to set up Duplicity for encrypted backups, but it doesn't cover database backups or the Google Drive endpoint.
I found a few ...
- 371
5
votes
1
answer
3k
views
Why does duplicity need a passphrase for OpenPGP encryption?
I'd like to use duplicity to backup files and I'd like to encrypt them with GnuPG. I was wondering why duplicity asks for a passphrase to encrypt the files. For asymmetric encryption the passphrase is ...
- 103
4
votes
2
answers
4k
views
duplicity fail: not promping for password: "Running 'sftp user@host' failed"
I have two linode VPS accounts and I want to back up one onto the other (the reasons are mainly for fun and to practice server administration.)
the short version
Duplicity isn't even asking for my ...
- 431
4
votes
1
answer
3k
views
Backup 2 specific directories with duplicity
I used to backup directory /home/user/X with duplicity using
duplicity /home/user/X/ file:///home/user/Backup/
Now, I want to backup directories /home/user/X/ and /home/user/Y/ and ignore ANYTHING ...
- 215
4
votes
1
answer
2k
views
Duplicity Incremental Restores
I use duplicity to manage an encrypted daily incremental and weekly full backup schedule for my Linux box. Though duplicity allows incremental backups, I could not find any way to do anything other ...
- 208
4
votes
2
answers
5k
views
Duplicity - how to put passphrase in command?
I've tried a number of obvious commands as detailed in Duplicity Man page to do this but it doesn't seem to work.
Scenario
I'm SSH'ing to a machine, then running Duplicity; below is the command, of ...
- 344
3
votes
2
answers
5k
views
Why does Keychain compain that id_rsa.pub is missing?
I'm reading this article on setting up unattended backups in Duplicity.
I'm in the part called 7.2. SSH KeyCaching
I've added the following to my root .bash_profile
keychain --clear id_rsa
. /root/...
- 4,909
3
votes
2
answers
5k
views
How to change default duplicity archive directory?
How can I change the duplicity default archive directory (~/.cache/)? The following option seems to be ignored.
Option --archive-dir=/volume4/duplicity/cache/ --name backup
duplicity 0.6.21 (...
- 131
3
votes
4
answers
1k
views
Duplicity constant memory usage (duply)
I'm experiencing constant high memory usage from Duplicity on all servers running it as a backup tool to S3.
Isn't Duplicity supposed to run its backup task and kill its job afterwards, or am I ...
- 51
3
votes
1
answer
2k
views
Make Duplicity list files to be backed up?
When using --dry-run with rsync it can list the files that will be backed up. But when I with duplicity do
duplicity --dry-run --name pchome --encrypt-sign-key xxx --include $HOME/Desktop --exclude '*...
- 2,540
3
votes
1
answer
5k
views
How to restore a Duplicity backup to a new host?
Had a catastrophic failure on a RAID array and lost everything.
Have a full set of backups on S3 via duplicity (2003 files), encrypted with GPG.
I have the passphrase and a copy of the private key ...
- 482
3
votes
3
answers
4k
views
Duplicity error: BackendException: ssh connection to SERVER_IP:22 failed: Unknown server SERVER_IP
I'm trying to setup a backup system with Duplicity. I have a server that I want to backup to another SFTP server.
If I try to connect via sftp it works fine:
root@SERVER:~# sftp user@SFTP_IP
...
- 173
3
votes
0
answers
176
views
Duplicity "add-only" incremental backup
I have a large duplicity backup stored in a server that would be too slow and costly to fully restore, but I want to perform an incremental backup of a relatively small amount of data that was missing ...
- 131
3
votes
0
answers
787
views
Duplicity keeps telling last full backup date: none
I am using duply wrapper script and made a full backup of my folder to another location, when I then try to run incr backup, Duplicity keeps telling me, that last full backup date is none.
Warning, ...
- 237
2
votes
1
answer
7k
views
How can I speed up my Duplicity backup?
I need to perform onsite backups of hundreds of gigabytes from a few Xen VMs to some storage available on a dedicated server in the same network, with a Gigabit connection. The data is mostly MySQL ...
- 347
2
votes
4
answers
4k
views
Most cost efficient way to backup Subversion data to S3?
I'm looking at using S3 as an offsite backup repo for my Subversion database. When I dump my SVN database, it's about 10 gigabytes. I would like to avoid the charge of uploading that data repeatedly....
- 332
2
votes
3
answers
3k
views
Duplicity 0.7.10 fails after upgrading librsync in Ubuntu 14.04
I've spent a few hours trying to configure Duplicity to perform automated remote backups to a Google Drive. At this point, it's safe to say that I'm in my own private dependency hell.
Using the ...
- 371
2
votes
1
answer
2k
views
Cannot restore duplicity backup
I've created a backup of my home folder, to a remote system, using duplicity 0.6.26:
duplicity --no-compression --no-encryption . scp://...
while being in the home folder.
Now I seem to be unable ...
- 1,341
2
votes
1
answer
825
views
NIC bandwidth usage graphing as percent (not kbps/mbps)
I would like to validate a certain thought with you guys. Assuming that:
The device whose bandwidth I am measuring is an internal, Linux-based, router.
If a NIC is configured to 100mbps, the network ...
- 258
2
votes
1
answer
463
views
How can I remove a particular directory from a duplicity backup archive without affecting the rest of the backups, to save space?
Due to some really buggy software that likes to write its own backup files to its working area even when that it disabled, duplicity has backed up those backups resulting in several hundred GBs of ...
- 451
2
votes
3
answers
1k
views
duplicity backup fails: "Private key file is encrypted"
I am trying to upload my first duplicity backup to a remote server and it fails. It is the first time I am using the tool and it did not work before.
duplicity /home/me/Documents/ scp://me@<ip-...
- 499
2
votes
1
answer
1k
views
How to get only the pub part of gpg --list-public-keys?
Okay, there is probably a better way to phrase this question. I am writing a script to configure my web servers on the first boot, but I hit a snag when generating the GPG key that will be used to ...
user497477
2
votes
4
answers
3k
views
Duplicity backup to S3: BackendException
I'm trying to configure my Duplicity installation to backup to an Amazon S3 bucket. I keep getting a BackendException error with no further details.
EDIT: I've removed my Duply configuration from ...
- 163
2
votes
2
answers
2k
views
How does Duplicity check for modifications (mtime or checksum)?
How does Duplicity determine if the local version of a file has been modified since the last backup? Does it only look for a different mtime/size etc., or does it actually check for modified content, ...
- 570
2
votes
3
answers
2k
views
Duplicity and Google Drive
Is it there a way to make duplicity backups to Google Drive?
As far as I understand, WebDav and FTP are not supported by Google Drive. But maybe there is an extension to duplicity in the works?
- 151
2
votes
3
answers
2k
views
Problems restoring file backed up on Windows using Duplicati to a Linux server running mono
TL/DR version:
Mono + Duplicati.commandline.exe restore etc. etc. spits this out for several files regardless of what I try. I am able to list sets, list files in said sets, even do a verify, but ...
- 21
2
votes
1
answer
2k
views
Which ssh-based duplicity back-end should I choose?
I am looking at using duplicity for doing file backups over ssh to a remote machine. I see that duplicity supports multiple back-ends that work over ssh, such as ssh://, scp://, and rsync://.
Is ...
- 5,058
2
votes
1
answer
144
views
Why does Duplicity allow a new symmetric passphrase on incremental backups?
I am new to Duplicity and trying to test it as a new backup tool. However, I have found that it permits incremental backups with new symmetric passphrases which then causes the backup to be ...
- 121
2
votes
2
answers
2k
views
duplicity "CollectionsError: No backup chains found"
I'm using duplicity 0.7.06 to back up and 0.7.17 to restore a duplicity backup. But I'm getting the error "No backup chains found" when trying to restore a directory from it.
I'm not sure what that ...
- 471
2
votes
1
answer
187
views
Prevent duplicity to download all manifests
I need to restore most recent duplicity backup into the clean VM. Backup interval is 1 hour. The oldest backup should be 6 months.
And every time I restore backup into clean VM duplicity downloads ...
- 329
2
votes
1
answer
866
views
sftp backups with duplicity fail
I'm using duplicity on debian wheezy, which comes with version 0.6.18 as standard package. I also tried version 0.6.24 from wheezy-backports.
I want to use sftp as backend, but if I run:
duplicity --...
- 1,090
2
votes
1
answer
2k
views
Duplicity restore reports "Invalid SSH password" when I'm using a private key for connection
I'm testing the restoration of a backup with duplicity 0.6.15.
I can login to my backup server just fine using ssh and sftp using the following commands and my private key:
...sftp
root@client:~# ...
- 4,909
2
votes
1
answer
2k
views
Restore files from certain increments using Duplicity
Given the following backup sets ...
Found primary backup chain with matching signature chain:
-------------------------
Chain start time: Tue Jun 21 11:27:26 2011
Chain end time: Tue Jun 21 11:27:59 ...
- 3,059
2
votes
0
answers
196
views
Identify which volumes are needed for duplicity restore
Background
I've been running Duplicity backup with the --s3-use-glacier option, and I'd like to restore a single file. I'm running the command
duplicity restore --file-to-restore myfile.txt boto3+s3://...
- 121
2
votes
2
answers
2k
views
duplicity: UnsupportedBackendScheme: scheme not supported in url: dpbx:///
I'm trying to use duplicity to backup a directory to DropBox in Debian Stretch. However, duplicity gives me the error:
UnsupportedBackendScheme: scheme not supported in url: dpbx:///
I have verified ...
- 123
1
vote
2
answers
1k
views
How to backup my files secure and properly
Duplicity & rsnapshot helps me backup my files to remote FTPs server. I can recover file if my server harddisk failed. But if someone hacking my local server and he can get all remote server ...
- 111
1
vote
2
answers
3k
views
Why can my cron job not find a specific command?
I am using duplicity to create nightly backups of my server over FTP. I wrote a script that does both a local and remote backup and logs the output results. When I run this script as the root user, ...
- 555