Tagged Questions
2
votes
1answer
21 views
move the search content to different directory
I am on Oracle Solaris.
I am using:
grep "searchstring" filename.*
above command returns my search result.
Now I want to move the all the files in above search result (all the files not the ...
2
votes
2answers
3k views
Move huge number of files into date structured directory order
I have about 1 million files in this directory: /home/username/images/
Each of the files are called something like: 012345678910(Place)_0_20120414185957_28841.jpg with the timestamp part of the ...
3
votes
1answer
51 views
Compose and pipe a gzipped tar archive in one go
I'm trying to come up with an effective way to create a gzipped archive of various system partitions on Android, piping everything out to stdout so as to be able to encrypt it as it comes across via ...
0
votes
1answer
113 views
How do I cat a command file?
I have the output of the crontab -l stored in a file (crontab_file) with no extension. But whenever I try to cat it, I get errors saying command not found for multiple line of the file. Here is the ...
3
votes
2answers
93 views
Find files in directory with paired names
I'm running tests of a variable-size-and-contents test set. Data files are added and removed frequently. I'm looking for an automated way of gathering a file list.
All files are in subdirectories of ...
0
votes
3answers
56 views
Looping the listing files in UNIX
I've given the command:
ls -lrt
and the listed files and directories are:
drwxr-xr-x 4 root root 4096 Feb 2 2014 abc
drwxr-xr-x 4 root root 4096 Feb 2 2014 cde
drwxr-xr-x 4 root ...
1
vote
2answers
67 views
Copying the newest files
We have a script running which picks up the report generated monthly on remote servers. I was trying to find a way to pick up the latest file from the remote servers only. Will find work in script ...
3
votes
1answer
137 views
Cron job to delete files older than 3 days
I need to remove files older than 3 days with a cron job in 3 different directories. (these 3 directories are children of a parent directory /a/b/c/1 & /a/b/c/2 & /a/b/c/3) Can this be done ...
4
votes
3answers
114 views
Bash: Zipping/grouping files by common substring
I have about 100 files.
They are named like this.
3000_ABCD_XXXXXXX.csv
3000_ABCD_YYYYYYY.csv
3000_ABCD_XYXYZYZ.csv
3000_EFGH_XXXXXXX.csv
3000_EFGH_YYYYYYY.csv
3000_EFGH_XYXYZYZ.csv
...
3
votes
5answers
112 views
Look if a folder has some files of certain extention
Lets say I have a file structure:
$ cd /home/Desktop
$ ls -d */
Abc/ Qwe/ Zxc/ Rty/
$
Now I want to iterate through every directory and look if they have any .pdf files.
Could some one please ...
1
vote
2answers
48 views
Shell script to Capture the file name and size in csv file and add header on that file
I have a number of zip files in a certain folder. I want to capture file name and the size of the files in a CSV format in day wise and put it in crontab so I can report on a daily basis, and then ...
2
votes
2answers
142 views
Any way in Bash to write to a file every X seconds without closing it?
The hardware watchdog on my system needs a 0 written to /dev/watchdog at less than 60 seconds interval or it will fire. The file handle must be kept open however or the watchdog is then disabled.
...
3
votes
2answers
165 views
Read all files in folder and subfolders - progress and size
Command I have is:
time find . -type f -print -exec cp {} /dev/null \;
This command finds all files in current folder and subfolders, print the name of each file and copy each of them to /dev/null. ...
1
vote
4answers
93 views
How do i get the latest file from a list of files in a particular directory
I need to get the latest file from a list of files in a particular directory.
When I run the script the first time I've copied the list of files in a particular directory to another directory.
From ...
3
votes
1answer
83 views
Automatically detect when a file has reached a size limit
I would like to send an email when a file reach a certain size limit.
The only way I thought of doing this is by doing a cronjob which will check the file size and send the email if the file is ...
1
vote
1answer
46 views
How to Test if a file has characters in it?
So i have a part of this code and U want it to output "No such player" if only the names file is empty, i've tried using the test -s command but it gives an output of 0 even if the file is empty or ...
1
vote
1answer
109 views
Unreadable backup directory on a USB drive
The title pretty much sums it up. I was editing a script I wrote some time ago to automatically backup the contents of my Raspberry Pi SD card, and in the course of editing, I missed a "/", and so ...
1
vote
2answers
72 views
Create file with specific formatting from directory contents
I am using Solaris and csh.
In $home/test there are five files: a.txt, b.txt, c.txt, d.txt and e.txt.
If I run
% find $home/test/ -type f -print > ../filenames.txt
that file will look like:
...
1
vote
2answers
334 views
Remove oldest folders + files (50GB) from a folder when share/HD reaches 95% full capacity
I have a big share (~5TB) that is getting full.
Now I want to make a script that deletes data from 2 specified folders. But this need to be the oldest files/folders and it need to stop when ~50GB has ...
1
vote
1answer
253 views
Delete all jpg in a folder that are smaller than specific width/heigth [duplicate]
I have restored with photorec about 7.500 jpg's. I have moved them all in one folder. A big portion of them is thumbnails. But i can't just go on and delete lets say all of them that are smaller than ...
3
votes
3answers
116 views
Delete files except n files with the “bigger” name?
I want to create a shell script that deletes old release files except last n files. In other words, only mantain last n releases when I deploy a new release.
File names have this format:
...
1
vote
1answer
69 views
How to FILTER the files with filename and then DELETE the OLDEST file from there? [duplicate]
I create and keep the following automated backup files e.g.:
fruits_29-12-2013.gz
fruits_30-12-2013.gz
fruits_31-12-2013.gz
sweets_01-12-2013.gz
sweets_02-12-2013.gz
sweets_03-12-2013.gz
.. ...
3
votes
3answers
445 views
Bash script to delete a file called index.html recursively
I need a bash script (not sure how to write the actual .sh file) which I could set to be run by cron every minute and that would delete files with the name index.html that are in a specific directory ...
0
votes
3answers
390 views
How to write a Java Program / Shell Script combination such that you can call the Java program as a remote command and yet supply a local file?
This is related to How to execute a remote command on a local file?
I wrote a simple Java program that prints the first line of a file -
import java.io.BufferedReader;
import ...
6
votes
2answers
210 views
Copying one file to multiple directories
I have a file that I want to copy to another 60 directories.
The best way I can think of doing this is by making a bash script that has instructions to every folder like this:
cp script.sh ...
0
votes
0answers
61 views
Editing metadata with bash
I have a bunch of photos(jpeg, bmp, png) that I have arranged in such a manner that the metadata is in html form in a separate file.
I would like create some script to read this html file and edit ...
8
votes
3answers
12k views
File extensions for unix shell scripts
On wikipedia, the article for .sh says:
For the .sh file extension type, see Bourne shell.
How about other unix shells?
I know that the shebang is used inside the file to indicate an ...
2
votes
2answers
216 views
Distributing thousands of files over subfolders
I have a folder A with hundreds of thousands of files. I would like to move these files to new subfolders S_i, with, say, 100 files in each (the last folder may have less than 100 files)
In other ...
2
votes
2answers
87 views
Shell Scripting: how to use part of the file path as the file name?
I have a group of directories, each containing exactly 1 jpeg image, like so-
/psds/folder1/image.jpg
/psds/someotherfolder/picture.jpg
/psds/yetanotherfolder/thumbnail.jpg
What is the appropriate ...
2
votes
2answers
52 views
How to list all the files which were not created on Thursday
I need to delete old backups but I only want to keep Thursday Backups and delete the rest of the backups.
Give me some kungfu tips. I'm on RHEL if that makes a difference.
2
votes
5answers
264 views
Delete all files in directories except those whose path are listed in a file
Given the following files:
data/A/a.txt
data/B/b.pdf
...
date/P/whatever.log
...
data/Z/z.jpg
I would like to delete all files in the data/A/, data/B/, ..., data/Z/ directories except those files ...
9
votes
2answers
1k views
Fastest way to concatenate files
I've got 10k+ files totaling over 20GB that I need to concatenate into one file.
Is there a faster way than
cat input_file* >> out
?
The preferred way would be a bash command, Python is ...
4
votes
1answer
97 views
measure amount of data read from /dev/random
background
I have written a collection of bash scripts (most of them in German only yet but if you are interested; download the archive not the single scripts) which help users create high-quality ...
0
votes
1answer
41 views
Capture Error of LS to file [duplicate]
#!/bin/sh
if [ $(ls sample01.log | wc -l) = 1 ]
then
echo "File Found" > lsOutput.log
else
echo "File Not Found" > lsOutput.log
fi
But if sample01.log is not already existing my code already ...
2
votes
5answers
2k views
Get the newest file from directory structure year/month/date/time
I store backups of databases in a directory structure
year/month/day/time/backup_name
an example would be
basics_mini/2012/11/05/012232/RATIONAL.0.db2inst1.NODE0000.20110505004037.001
...
1
vote
4answers
238 views
move file by list in file
I have a file the contain filenames, for example:
/tmp/list.txt (it is with the spaces at the start of each line):
/tmp/file.log
/app/nir/home.txt
/etc/config.cust
I want, using one line, ...
9
votes
2answers
202 views
How to start tailing a file that has not been yet created
I use tail to monitor the progress of jobs that I know will write their progress to disk. Almost always, I know which file they will create before they start running (the jobs are dispatched by a ...
4
votes
4answers
202 views
Keeping the number of files in the folder constant by deleting old files
I'm trying to create a script and run it in crontab every 5 min, so that the number of files in a folder always remain 50000. If there are more, I want the script to delete the old files.
...
4
votes
3answers
5k views
How do I append text to the beginning and end of multiple text files in Bash?
I have a directory full of text files. My goal is to append text to the beginning and end of all of them. The text that goes at the beginning and end is the same for each file.
Based on code I got ...
0
votes
5answers
246 views
On executable files in Linux [closed]
It is said that in linux, unlike Windows, there's not a clear border between executables and other files.
Well, in Windows, I write a C++ program, then it is precompiled, compiled and then linked to ...
4
votes
3answers
208 views
Parsing string token with bash
I have this output (from a previous command):
aaa something
bbb someother
ccc blabla
For each line, I would like to create a file whose name is the first token, and whose ...
-1
votes
1answer
61 views
Checking if folder exist using case/switch
Is it possible to use case to check if folders exist?
I have these folders. I need to check if they exist then do something afterwards, I have 5 folders I need to check, and if it does exist, I ...
2
votes
1answer
1k views
Create sub-directories and organize files by date
I have some directories of files copied from my security camera that I would like to organize into sub-directories by file date. So for example;
-rwxrwxrwx 0 root root 4935241 Jul 19 2012 ...
0
votes
1answer
94 views
In shell script, execute a command only if the source is newer than the target
I'm looking for a simplified version of this:
dep=0
if [ ! -e targetfile ]
then
dep=1
elif [ targetfile -nt sourcefile ]
then
dep=1
fi
if [ $dep -eq 0 ]
then
echo "Already up to date"
...
3
votes
2answers
343 views
How to find frequency of occurrences of strings contained in a file?
I have a file that contains a list of URLs of the form
EDIT
http://www.google.com/absd/siidfs/kfd837382$%^$&,
www.google.com,
google.com
yahoo.com/list/page/jhfjkshdjf...
I ...
0
votes
2answers
63 views
need help in making script [duplicate]
I want to automate one task in UNIX and make one script.
There is directory in which everyday 2 files comes and that files come anytime in between 10 pm to 1 am.
file name is ...
-1
votes
1answer
105 views
Select a range of files from directory structure /year/month/date.db
I have databases stored in the directory structure
year/month/date.db
an example would be
db/2013/10/15.db
I need to be able to select a range of these with a script ("dbSelect ...
3
votes
3answers
264 views
Command for taking a screenshot to a new file
I want to configure a global hotkey to take a new screenshot and save it, say, somewhere inside my home folder. I can take a screenshot with ImageMagick with this command:
import screenshot.jpg
...
1
vote
1answer
1k views
Run .sh file instead of opening it
I am using Zorin OS 7. I want to run a .sh file but I can't seem to be able to—it just opens in a text editor.
Also under RMB>open with there is no other option.
1
vote
4answers
1k views
Wait for multiple files to be finished downloading
I have the following script which checks if there is a file in a folder and if the file is stable (this is for large video file I am receiving).
#!/bin/bash
cdate1=$(date +%Y%m%d-%T)
...
