rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.
0
votes
0answers
14 views
How to print vagrant's rsync timestamp and files changed?
I am using Laravel Homestead VM via Vagrant.
I run Vagrant by
vagrant rsync-auto --poll
At each file changed, it only prints
==> homestead-7: Rsyncing folder
Exclude: [ ...]
However I ...
0
votes
2answers
26 views
Error while executing rsync
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1536) [generator=3.0.9]
I get the above error while executing:
rsync -a -v -e ssh [email protected]:/def/ghi ...
0
votes
1answer
26 views
rsync - include top level file and exclude directories
I want to include all top level files (file1.txt, file2) and only anything under /top/dir1/. How can I achieve it?
I have tried the following but they don't work
$ tree
.
└── from
├── file1.txt
...
0
votes
1answer
55 views
How to use rsync? : Large projects backups via NFS share
I understand that rsync is very versatile, so I'm just wondering what the best way to use it would be in my situation ... which is:
~700GB project (in a single folder project/ with various sub-...
1
vote
1answer
23 views
How do I remotely exclude subdirectories with rsync?
I want to copy /opt/intranet and all its subdirectories and files but i need to exclude /opt/intranet/helpdesk and all of its children. Do I start from the server I want to copy, or do I run the ...
2
votes
2answers
41 views
Do I need to run backups with rsync as root user?
I'm creating a backup strategy for my laptop (Ubuntu) based on rsync. When backing-up /etc, I get a lot of Operation not permitted (1) and Permission denied (13) errors.
Is it required to do sudo ...
4
votes
1answer
38 views
Time Machine-style rsync usage
I seem to be having trouble getting this rsync script to work the way I need it to. The source is here. The idea behind it is to create incremental backups, similar to what MacOS's Time Machine does. ...
1
vote
1answer
31 views
rsync --update and symlink did't copy the most recent version
Rsync on Mac ( 3.1.2 or earlier ) does not seem to update symbolic links properly.
When I "push" from a client to a server, it automatically overwrites the server's symbolic link even when it is ...
0
votes
1answer
19 views
Combining rsync and find
I'm trying to use find & rsync to back up specific files from a remote machine, and getting nowhere.
Here's the setup: I want to use rsync to back up all files containing *state* or *srm on the ...
29
votes
4answers
2k views
How can I slow down rsync?
I'm trying to copy the contents of a failing USB thumb drive. If I read the data too fast, the drive's controller chip overheats and the drive vanishes from the system. When that happens, I need to ...
0
votes
0answers
23 views
Rsync behaving strange when running as cron
When I run my rsync script manually it copies each file in sequence and counts down the numbers of files in each sequence as well:
ArchiveLogs/BANK_DWH/db2inst1/BANK_DWH/NODE0000/LOGSTREAM0000/...
0
votes
3answers
35 views
Making a backup using rsync from two locations which contain the a lot of the same files
I have 2 external storage devices of 1TB each and I want to backup all of this to a server. I want to use rsync to do this but I have found that of ~100,000 files on each device, ~80,000 files are the ...
0
votes
0answers
37 views
Restore a file overwritten by rsync [duplicate]
I had a file overwritten by an empty file of the same name with rsync:
rsync src/data.file(empty) dest/data.file (not empty)
Is there a possibility to restore the overwritten dest/data.file without ...
3
votes
1answer
41 views
Different hash value of large rsynced file on centos and ubuntu?
I rsynced a large file from remote centos to local ubuntu with
rsync -avzP user@<remote-ip>:/path/to/file .
It reported the transfer went well:
sent 30 bytes received 257,293,476 bytes 1,...
3
votes
1answer
36 views
Is there any way to preview the size of an rsync transfer?
I'm working on a wrapper around rsync, and one of the points would be to determine whether the destination has enough space to accommodate the transfer; as a result, I'd like to know the size of the ...
5
votes
1answer
67 views
rsync of sparse qemu image increases disk size
I have a sparse raw qemu image that I want to transfer to another server. qemu-img info gives me:
image: sparse.img
file format: raw
virtual size: 50G
disk size: 16G
I transfer it with:
rsync -azhP ...
0
votes
1answer
41 views
Restore directory to previous state
I have an approximately 1TB directory with subdirectories dir1. I have made an rsync backup copy dir1.back.
How can I efficiently restore dir1 to the state of dir1.back - that is, replace files in ...
0
votes
1answer
17 views
`rsync` verbosity using `--files-from`
I'm working with rsync to archive old files on a running system. Thus, I use a command line of the form:
find /some/dir -various -conditions -printf '%P\n' | rsync -v --files-from=- --remove-source-...
0
votes
1answer
30 views
rsync --compare-dest is being ignored
Currently, I'm trying to copy the modified files between 2 folders, and want the files that have differences to be copied over to the new folder.
The folder structure is the following:
..
|-- update+...
-1
votes
1answer
44 views
forcing sudo on remote rsync server
I'm setting up rsync to transfer files from ServerA to ServerB, and need to preserve timestamps and permissions. They key here is the files are owned by a different account than the one performing ...
0
votes
2answers
60 views
Determine how many files from a sorted list will fill up a disk
This has me puzzled. I think it should be easy, but I must be missing something, as the results are not consistent.
I am backing up a long list of files to multiple disks, using rsync, using a list ...
0
votes
1answer
28 views
Automatically copy a certain folder from each of remote machine to a main machine
I have one main machine and a group of remote ones. I want to keep a track of a certain folder on each of the remote machines and copy its content to a certain folder in my main machine. The remote ...
0
votes
1answer
41 views
Use rsync copy multiple directories to the same location; keep tree
I'm using a Time Machine like backup script, that creates a partial backup to an external drive using hard links:
#!/bin/bash
date=`date "+%Y-%m-%dT%H-%M-%S"`
backup=/mnt/backup
targets="/ /data/...
0
votes
2answers
6 views
Raspbian, debian: Howto make find $SOURCE return all directories under $SOURCE without itself [duplicate]
Hope someone can help me. I use rsync to copy directories including files, with --remove-source-files I let rsync delete source files. Unfortunately it doesn't delete directories so I would like to ...
3
votes
1answer
27 views
extract incremental changes to directory
I would like to get only the differential backup of a single directory, using cmdline tools on OSX (to be run on a Continuous-Integration service)
Basically, i have a directory full of things (files ...
0
votes
1answer
32 views
How to properly use rsync
I am having trouble using the rsync properly and your help is needed. Here is what I would like to do. I have some files on a remote server (server1) and I'd like to copy them to the other server (...
1
vote
3answers
91 views
Sync same directories between two linux servers
There are two RHEL 7.2 linux servers located in different places. Both have same directory structure. Requirement is to keep certain directories of both servers in sync, i.e any modification in ...
0
votes
0answers
17 views
Rescue files from partially broken file system with rsync?
So my file system (ext4) broke down for several reasons. I've done everything possible to repair it and quasi-manually delete files which differed too much between actual disk usage and reported size ...
3
votes
0answers
24 views
rsync --delete-excluded with --prune-empty-dirs, but only prune excluded directories
I've been using rsync to clone my Windows user profile to a remote server on a nightly basis. I'm using a --filter='merge ' arg to load a file full of include/exclude rules, which I use to avoid ...
0
votes
2answers
29 views
Recursively compare root directory on Linux system A to root directory on Linux system B
I'm trying to diff all files on two Linux systems using rsync and ssh, by using the --dry-run option so it doesn't synchronize any files/folders. What am I doing wrong? I'm currently in the root ...
1
vote
2answers
54 views
Does rsync package have to be installed on the remote server?
I have rsync installed on a machine. I am trying to sync a directory to a remote machine. Sometimes it's working for some remote machines but sometimes it's not.
Do we need to install rsync to the ...
3
votes
3answers
67 views
rsync files with apache permissions over ssh
I'm running a rsync via apache to sync an assets directory
rsync -avz -e 'ssh -l rsync -i /home/rsync/.ssh/rsync -o StrictHostKeyChecking=no' /var/www/html/site/Uploads centos@$IP:/var/www/html/site/...
1
vote
1answer
105 views
rsync “skipping non-regular file” message when not copying links
I want to rsync a folder to another folder without copying links. When I do this and the origin folder contains a symbolic link to a directory, I get the following error message:
skipping non-regular ...
0
votes
1answer
32 views
Unix command to copy file from remote server to a terminal shell
I am using the terminal shell, and I’m finding it difficult to copy a file from my school remote server to my local machine.
I need to use this file to start my final project.
I used this command but ...
7
votes
1answer
70 views
find and rsync both choke on oddly named file
This isn't an important issue to me, but I thought rsync and find were fairly robust, so I was surprised when rsync choked on a file, and then find did too. ls -l shows the file has 6093 bytes (and it'...
0
votes
1answer
27 views
Locate the source of an rsync backup
I have an inherited server (foo) which I am told is receiving backups via rsync from various hosts (bar1, bar2, etc).
I'm looking to identify network information (hostname or ip address) for bar from ...
1
vote
1answer
31 views
Rsync directory filtering out files and retaining edge cases (e.g. names w/ hyphen (-) chars)
I have a test folder with the following structure:
"driveA"
- "bar - foo"
- "fileBarFooA"
- "fileBarFooB"
- "fileA"
- "fileB"
- "fileC"
- "folder.A"
- "fileAA"
- "fileAB"
-...
1
vote
1answer
43 views
rsync: How can I pull the --exclude-from file from the remote host?
I'm hoping someone more knowledgeable about rsync can help me out here. I'm setting up automated rsync across the network, using (or attempting to use) the following command:
rsync -e ssh -avhxAXHr -...
1
vote
1answer
22 views
copy files remotely on same path
I have thousands of csv files in some directories. Out of which I would like to copy one csv file to remote machine on same path, if remote machine doesn't have directory then it should create ...
0
votes
0answers
22 views
Labels for Mac RYSNC Script
Fixed the first issue with the echo command, it works just fine now. For the experts, does this script look decent enough as a back option. I know there are redundant entries but the destination is ...
0
votes
2answers
56 views
Rsync temporary file extension
I am having difficulties finding how Rsync "chooses" the extension for the temporary file created while copying the file if I don't use the --inplace option.
Example :
I want to copy ...
3
votes
7answers
265 views
How to copy big data over network?
I have a HP Microserver gen 8 with Centos 7 and only one hard disk in the bay area, 2 TB, mounted as NTFS.
I'm trying to copy files (about 100GB at once) over network from local.
I've tried with the ...
2
votes
1answer
22 views
sync a particular file recursively but only in the subdirectories present in destination
I have two directories dirOrig and dirDest in different remote servers. Both of them have numerous subdirectories at various depths. I now need to copy a specific file or extension -- say file1.txt ...
3
votes
2answers
103 views
rsync using part of a relative path
Suppose I have a directory on a local machine, behind a firewall:
local:/home/meee/workdir/
And a directory on a remote machine, on the other side of the firewall:
remote:/a1/a2/.../aN/one/two/
...
1
vote
1answer
30 views
How to set files and folders to their default permissions?
I am using Debian and want to reinstall a backup of personal and configuration files (the entire /home folder of a user) on a new computer.
For some reason I cannot understand, every files of my ...
0
votes
1answer
35 views
Rsync Wildcard Expansion Broken with SSH
Ansible generates:
/usr/bin/rsync --delay-updates -F --compress --archive --rsh 'ssh -S none -o StrictHostKeyChecking=no -C -o ControlMaster=auto -o ControlPersist=60s -o PreferredAuthentications=...
4
votes
1answer
78 views
Delete remote files matching local files, or delete files as they are downloaded
Say we have two hosts producer and consumer and the following process:
producer adds files regularly to /some/path.
consumer pulls those files to its own /some/path (e.g. via rsync) and processes ...
0
votes
1answer
24 views
RSync connecting but timing out with no data received
I am trying to create a local CentOS mirror, but all of the available rsync sites that I am connecting to are not sending me any data in return.
rsync -aSHP -vvvv --timeout=0 --delete --exclude "...
2
votes
1answer
26 views
What are “matches”, “hash_hits”, and “false_alarms” in rsync output, and does “data=0” mean success?
This is a corollary question to How to verify that rsync copied the device correctly when copy-devices is enabled?
When reattempting a transfer (using the --copy-devices) flag and two levels of ...
3
votes
1answer
56 views
How to verify that rsync copied the device correctly when copy-devices is enabled?
This is an extension to Why rsync attempts to copy file that is already up-to-date?
I'm attempting to use the --copy-devices patch to rsync to copy an entire disk drive and store it as an image on ...
