rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.
4
votes
2answers
49 views
Two-way rsync results in oscillating content
I am trying to sync content between two servers. The servers are identical builds (Ubuntu 12.04LTS) and have this cron job running to sync the content:
rsync -arzc --update --delete ...
6
votes
3answers
165 views
Why does rsync fail to copy files from /sys in Linux?
I have a bash script which uses rsync to backup files in Archlinux. I noticed that rsync failed to copy a file from /sys, while cp worked just fine:
# rsync /sys/class/net/enp3s1/address /tmp
...
1
vote
1answer
29 views
Why does rsync look for DSA instead of RSA key when run from cron job?
I want to backup files from a server to my local computer using rsync. I can only log-in to the server with an RSA ssh key.
I have stored the passphrase to the key in Seahorse Passwords and Keys, ...
0
votes
2answers
101 views
rsync error: some files/attrs were not transferred
I'm trying to move my emails Maildir from an old centos server to a new debian server.
rsync -avz /home/me/Maildir ssh root@ipaddress:/var/vmail/me/Maildir
I tried to copy an 8gb account, didn't ...
0
votes
0answers
36 views
Rsync seems to back up files that haven't been opened or changed
I have started using rsync to back some data on my mac to an external HD. It works really well, but I have noticed something odd. Every time I run the command, I get a list of files that haven't been ...
2
votes
1answer
75 views
rsync: failed to set permissions on “/path/to/file.txt”: Operation not permitted (1)
I encountered the error when attempting to transfer source files from a remote Linux web server to a local HP dt1000i Desktop Hard Drive connected to an Ubuntu 12.10 box via USB.
A Samba share is ...
0
votes
1answer
33 views
rsync: failed to connect to host: Connection timed out (110)
I am not able to list drectories through rsync:
from Host2:
user@host2#sudo rsync user@host1::share
rsync: failed to connect to host1: Connection timed out (110)
rsync error: error in socket IO ...
1
vote
1answer
47 views
rsync: error starting client-server protocol
I have rsyncd running on both the systems . When I am trying to check the connection it giving me following error:
From host2:
user@host2#rsync username@host1::share
password: [password]
...
1
vote
0answers
64 views
Rsync daemon intrepreting parameters as command in rsync.conf
I meshed up with my rsync on linux. When I am restating it, its showing me following error:
sudo /etc/init.d/rsync restart
/etc/rsyncd.conf: line 13: [ftp]: command not found
/etc/rsyncd.conf: line ...
3
votes
2answers
91 views
Rsyncing files with special characters to USB FAT32
I want to copy a large number of files to a USB drive that is formatted FAT32 (and cannot be formatted anything else, unfortunately).
Many of these files have names with characters such as : and ? ...
2
votes
2answers
78 views
`cp -al` snapshot whose hard links get directed to a new file when edited
I am trying to take snapshots of a massive folder regularly.
I have read here: http://www.mikerubel.org/computers/rsync_snapshots/#Incremental
that cp -al takes a snapshot of a folder by simply ...
1
vote
1answer
45 views
backup / on ntfs filesystem encrypted
I was about to backup my archlinux, following this guide to my FritzBox, (which enforces a NTFS system that I mounted via samba) as I remembered, that NTFS is not capable to keep permissions and other ...
2
votes
1answer
77 views
rsync and backup and changing timezone
I back up my pictures from my camera using rsync, using:
rsync -vzrtl --progress --stats --timeout=0 host destination
Now I was in a different timezone when I did my first backup then I moved to a ...
0
votes
0answers
19 views
Using rsync without adding ssh user [duplicate]
How to give an user access to rsync (as www-data user), without giving him an ssh user (because i afraid that he could do something with my computer), how can i do this?
1
vote
2answers
64 views
Cancel and resume a duplicity backup
Is there a way to cancel duplicity (running over rsync and symmetric gpg encryption) without messing up the running backup and resume it later (for example after rebooting the laptop) without ...
0
votes
3answers
69 views
rsync timed out
I need to sync a directory to a directory on a remote server.
at the moment i use rsync -ca to do this but the directory is quite large and the whole process fails with a timeout error.
Now i'm ...
3
votes
1answer
88 views
How to see the total progress while copying the files
We know that if we give --progress parameter to rsync it will show the progress of files copied. But issue is that is shows the progress for each single file not total or overall progress.
So how to ...
0
votes
0answers
27 views
rsync a mac on linux box, --delete not working
I have a mac Darwin Kernel Version 10.8.0. One of its folders is called source. I want to back it up on a remote linux folder called destination.
My problem: whatever I try, I cannot make the rsync ...
0
votes
1answer
47 views
Rsync adding a “?” at the beginning of directories
I currently have many of these commands running in a .sh file that looks like this:
rsync -avz -e ssh --rsh='ssh -p1337' --bwlimit=10000 root@DestinationIP:/home/backup /home/localbackup
rsync -avz ...
3
votes
1answer
123 views
Having an rsync job complete after closing SSH connection
I am transferring a large amount of files from one computer to another using rsync. I am doing this by SSHing into the source computer and executing a command like this:
sudo rsync ssh ...
2
votes
0answers
104 views
Rsync --bwlimit not working
I am currently using rsync to transfert large file from a host to another.
I would like to limit the debit for this transfert. After reading the man page I found the option --bwlimit which is ...
1
vote
0answers
50 views
BackupPC can't finish backup
I'm trying to backup /etc/ directory on CentOS 5.2 using BackupPC.
It takes several hours and then aborted by signal ALRM.
There is a partial backup created with all data from /etc
But BackupPC thinks ...
2
votes
1answer
179 views
How to rsync only new files
I am trying to set up rsync to syncronize my main web server to the remote server by adding newly generated file to the later.
Here is the command that I use:
rsync -avh --update -e "ssh -i ...
0
votes
2answers
74 views
How to detect particular system call called or not in a whole workflow?
EDIT No. 1
My task is mirroring , i.e., copying updated data from master server to all mirrors, by using rsync and rsh. But during rsync and rsh, I found some delay. My thinking is , the reason for ...
0
votes
2answers
152 views
Synchronizing same files with different filenames using rsync [duplicate]
I have a directory ~/music that contains all my music files and a directory /media/backup/music that I wish to synchronize with the first one using rsync. Initially, I did a rsync -a ~/music ...
0
votes
1answer
61 views
rsync is changing my directory permissions
I have an rsync setup that transfers files from my local development machine to my production web server. On the production server, the storage directory needs to be 775.
When the rsync completes, it ...
3
votes
4answers
108 views
Most Efficient way to back up/sync large directories over SSH
I'm looking to back up some large directories on a Dedicated Server to another Server on a daily basis using minimal bandwidth
RSync looks like its up to the task but I'm unsure of the best command ...
1
vote
0answers
92 views
Cannot get rsync to keep source file ownership, tried many tricks
I'm trying to rsync some directories from a webserver running RHEL5 to a system running Xubuntu. I have rsync, ssh, and keys setup for the machines. I've tried everything so that when i backup from ...
5
votes
1answer
93 views
rsync: skip files for which I don't have permissions
I'm using rsync -rlptD to copy a directory from another user. There are a few files (I have no way of knowing these in advance) which I don't have permission to copy. Is there a way have rsync ignore ...
1
vote
1answer
78 views
rsync all directories that start with a specific digit
I have directory loaded with thousands of sub directories:
/home/tmp/
1
12
123
1234
2345
234
3456
345
34
...
4
votes
1answer
70 views
Can I exclude /run from my backup scheme?
I have written a rsync-based system backup for my Linux system. The aim is to be able to redeploy the system entirely from the saves, so I don't only backup homedirs. I have excluded a few top-level ...
2
votes
1answer
137 views
Unison can't synchronize Dropbox configuration (socket files)
I'm using Unison to synchronize my home across several computers, and I've addressed everything but this.
The Dropbox configuration is partially skipped, and as a result Dropbox thinks there is no ...
3
votes
2answers
65 views
Any ideas to simplify the awkward rsync expression below?
Here is expression:
rsync -avz --progress -e "ssh -i /where/is/my/id_dsa" [email protected]:`ssh -i /where/is/my/id_dsa [email protected] "find /remote/source/dir -type f -name '*.sql' | sort -nr | head ...
2
votes
1answer
76 views
rsync: how to relocate absolute symlinks?
I've pored over the rsync manpage as well as on several related questions here on serverfault. I've played with -R and -L and -l options, but no luck.
Here is the question: when sending a dir from ...
5
votes
2answers
122 views
Rsync different behavior when syncing folders HDD-HDD or HDD-Ext HD
When I sync two folders between two HDDs, rsync only lists the changes made at the end.
However if I sync a folder between a HDD and an external HD, while the sync is running it is listing each ...
1
vote
1answer
191 views
rsync to SFTP while moving completed uploads to another folder
I'm going to be moving a lot of data (30GB) to a server which is split up into multiple 200MB tar.gz files. This is going to take time, and I'm going to need to stop and start my computer again during ...
3
votes
1answer
157 views
Pausing rsync via bash script?
Is there a way to pause rsync via command line, if it transfers data for over X minutes? I'm working on using it as a backup and would like it to pause every once in a while to prevent the hard disks ...
0
votes
1answer
312 views
how to tell rsync to preserve time stamp on files when source tree has a mounted point
Related to this question
Short description of the problem
When source tree has a mounted point inside it, then time stamps on files inside that mounted point when copied to target tree are not ...
1
vote
0answers
52 views
Use rsync with closed files only
I am interested in using rsync with the --remove-source-files option. I am planning on pointing it to a directory, with a command like:
rsync -avm --remove-source-files --include='*.dat' -f 'hide,! ...
1
vote
1answer
292 views
rsync command to backup home tree to another disk
I want to make sure I am using the correct rsync command on Linux. I do not want to run an rsync and end up losing data as I am new to Linux and I have no backup now.
On Linux Mint, I want to backup ...
0
votes
0answers
58 views
Is there any rsync parameter for show at the end the changes made?
I have a script that sync (mirror mode) four folders between two disks. While it is running it shows the directory where it is in this very moment, and at the end it shows bytes sent, speed, etc.
I'm ...
2
votes
2answers
442 views
how to move (not copy) files from one server to another?
I want to move files from server1 to server2.
A producer on server1 will keep generating the files, and a consumer on server2 will keep processing them.
I can copy files using the following shell ...
4
votes
2answers
213 views
Restrict file access to append only
I have a directory with log files and I'm putting
logs from script launched by users into them. Logging with syslog doesn't seem
possible in this case. (non-daemon rsync)
I want the users to have ...
0
votes
0answers
172 views
Open alternative to crashplan friends
Is there a native linux alternative to "crashplan friends" http://support.crashplan.com/doku.php/getting_started/back_up_to_a_friend? The concept is that files are syncronized (backuped) to remote ...
2
votes
2answers
123 views
Suppress server message in rsync
When I rsync or scp from a particular server I get a rather long message telling me the rules of the server. However when I setup regular pulls, I'd like to be able to suppress those messages in my ...
3
votes
1answer
69 views
Is there a way to put comments in an rsync --files-from file?
I have a file that rsync uses as --files-from:
dir1
dir2
dir3
I want to be able to put comments above each dir entry like that:
# my dir1 comment
dir1
#dir2 comment
dir2
#yet another comment
...
3
votes
3answers
147 views
How to diff two folders by inodes
I'm currently using a script to backup files on my computer.
In a nutshell, it works like this:
rsync --link-dest=$FOLDER/current $SOURCE $DESTINATION
However, I think that my script may be ...
2
votes
1answer
615 views
rsync compare directories?
Is it possible to compare two directories with rsync and only print the differences? There's a dry-run option, but when I increase verbosity to a certain level, every file compared is shown.
ls -alR ...
2
votes
1answer
126 views
How to rsync to different directory?
Here is what I want to achieve:
Run Rsync to compare two directories recursively like this:
rsync -r /source /target
but don't actually rsync between the directories. I want the resulting ...
2
votes
2answers
289 views
Using rsync to sync two directories on server and localhost, but size is different
I'm using rsync to sync a directory from server to localhost:
rsync -avz --delete ./Stuff user@host:/Stuff
This all works fine, but how come when I type 'du -s' in both the server and the localhost ...
