grep is a command-line tool for searching text patterns in files
-1
votes
1answer
34 views
Match and combine records in Bash [duplicate]
Consider two csv files:
$ cat given.csv
123,John
246,Paul
369,George
987,Ringo
$ cat family.csv
246,McCartney
123,Lennon
987,Starr
369,Harrison
Note that the lines are not ordered! How might I use ...
5
votes
3answers
104 views
I am trying to find a better/easier way to count alphabetic characters in a file or shell variable
I have a file containing the following text:
we are going to write something 1 2 3
wc tells me I have 1 line 9 words and 38 characters.
I'm looking to count the 26 letters only (a-z, no numbers or ...
2
votes
2answers
24 views
Gather job usage information on cluster
I am running simulations on a linux cluster shared by hundreds of other users. There is a job scheduler installed on the cluster that determines who runs where, and one of the scheduler commands ...
2
votes
2answers
68 views
Find characters in the file
I need to find lines in the text file that have at least one x and at least two ys.
I tried the following:
grep -E "x.*y{2}" file.txt
This method did not work. Is there another way to do it?
2
votes
2answers
23 views
Run grep or other commands on files on a web server
I have files on another domain. What's the best way to use commands on them like grep?
wget http://path/to/file.txt | grep search
However this doesn't work. I guess I can use curl but is there a ...
2
votes
3answers
70 views
grep to find words with all vowels
Using grep -E and regular expressions I need to find words containing all of a group of characters in no particular order. For instance a word containing all vowels (aeiou) however the vowels can ...
-1
votes
1answer
73 views
How to use grep to filter out lines starting with any of a set of keywords?
I have a large file (a chemical database), and I need to display only header records, which are defined as lines that don't start with: ATOM, CONNECT, HETATM, TER, or END. I'm supposed to use grep to ...
1
vote
1answer
37 views
Find files in multiple directories taken from list in a file?
FreeBSD 9.2 RELEASE p2
I have a file dirs.txt. In this file is a new line separated directory list like so:
/etc
/home
/home/goods/
I need to first find in all directory's files which have names ...
3
votes
2answers
71 views
Extract csv files from path to multiple files in bash
I have a files multiple file path for backup purpose ,now i want to filter it based on ".csv " fromat. I have tried this.
filesall=(/home/abc/allfiles/*)
files=$((${filesall[@]}|grep -F ".csv"))
...
1
vote
1answer
42 views
Store output from one command and process it for another
I am working on Unix command line. I have two files. I want to cat file1.txt and grep the output in file2.txt
File1.txt
123A
223A
143A
153A
183A
123J
123P
File2.txt:
123A (TYU)
223A (RUT)
143A ...
1
vote
4answers
47 views
Parsing complex text file using Unix commands
I have the following text structure which I would like to parse:
>Cluster 423
0 56aa, >HWI-ST1448:257:C3V2HACXX:1:1106:19087:2550.1... at 92.86%
1 64aa, ...
3
votes
4answers
129 views
Test if command accepts a specific option
What is the preferred way to test if a command takes an option? What are the caveats?
As a motivating example, at login my shell aliases grep to add several --exclude-dir options but this option is ...
2
votes
2answers
34 views
Use awk to find first occurrence
I have a log file that gets updated when my script runs. The script will insert "Start of script" text when it starts and "End of script" text when it finishes running. I am trying to capture the ...
2
votes
3answers
64 views
Count of several keywords on a site
I currently have the following command
wget -O - -q http_url_goes_here |
grep -Eci '(cart|shop|buy|order|store|shipping|products|price)'
It gives me a count of ALL occurences of each of the ...
-2
votes
2answers
54 views
Grep and cut the selected field
I am trying to cut the field if a line starts with a particular name,
cat $1|while read line
do
if [ "$1" = "custbills.cmp" ]; then
acc_no=`grep "^Custbills" $1 | cut -c29-43`
acc_type=`grep ...
1
vote
2answers
61 views
grep works fine in command line but returns nothing in script
I'm trying to write a small script to get me list of files that match certain criteria into a file.
#!/bin/sh
cd /var/www_data/patch/
grep --include=\*.{php,ini,conf,sh} -ril -P ...
3
votes
3answers
112 views
Replacing string in all files found by grep. Can't get it to work
I'm trying to do what title says.
So I find all needed files with grep: grep --include=\*.{php,ini,conf,sh} -ril -P "'([\d\w\-\_\.]+)(@domain.com)'" '/var/www_data/somepath/'
Now I assume it's ...
4
votes
4answers
140 views
extract lines according to a particular column
I have a CSV file like
CK,ck
XYZ,xyz,xyzs
ABC,abc,abcs
PQR,pqr,pqrs
LMN,lmn,
IJK,ijk,
I have to check if something is written in column 3 except whitespace, then display the whole line.the output ...
4
votes
4answers
43 views
regexp which matches all tokens independent of order
I have a quick (and hopefully simple) question about regexps. I'm trying to think of a regexp which matches all of a set of tokens irrespective of order.
So for example I have a file with the names ...
0
votes
1answer
27 views
Improve execution time for recursive md5sum check?
This recursive md5sum check for 40000 items of 11.8 GB takes 2 minutes:
ret=$(find "${target}"/ -name ".md5sum" -size +0 | while read aFile; do cd "${aFile%/*}"; md5sum -c ".md5sum"; done | grep -v ...
1
vote
1answer
37 views
ls and find command excluding a certain directory
I want to do this:
ls -altrhS 'find / -type d \( ! -name tmp -prune \) -size +10000k 2> /dev/null -print' | egrep -v 'ibd|MYD|MYI'
So I want to list, in that format, files of a specific size ...
0
votes
1answer
87 views
Grep a string with spaces from a file
#!/bin/bash
LIST=/errors_exception.txt
cd /test
for PATTERN in `cat $LIST`
do
for FILE in $(ls)
do
if zcat $FILE | grep -Fxq "$PATTERN"; then
echo "$PATTERN found ...
3
votes
3answers
184 views
Get the part of a line before the last slash
I'm trying to write a conky script that shows my MPD album art, a 'folder.jpg' in the album folder. My current plan is to use mpc -f %file%, which prints out the file name and path, and then cut out ...
5
votes
7answers
518 views
How to find a position of a character using grep?
I need to identify the postion of a character in string using grep command.
Example, the string is RAMSITALSKHMAN|1223333.
grep -n '[^a-zA-Z0-9\$\~\%\#\^]'
How do I find the position of | in the ...
-1
votes
2answers
35 views
Searching out a pattern from Logs
The format of the logs is in this manner:
Junk Junk Junk : Junk Junk Junk:IP/Port Junk Junk
I want to search using the IP and the output should be only the IP/Port part of each line in that log ...
2
votes
4answers
243 views
Only cat from specific line X (with a pattern) to other specific line Y (with a pattern)
A little extended problem from "cat line x to line y on a huge file":
I have a huge file (2-3 GB). I'd like to cat/print only from the line having "foo:" to the line having "goo:". Assume that "foo:" ...
5
votes
4answers
332 views
How to add a carriage return before every newline?
I have a file that only uses \n for new lines, but I need it to have \r\n for each new line. How can I do this?
For example, I solved it in Vim using :%s/\n/\r\n/g, but I would like to use a script ...
2
votes
2answers
31 views
Live replacement, while viewing log using LESS
It's very convenient to monitor logs using less command - you see what is going with your system as it happening. The bad thing is that my logs are optimized for grep tool: each atomic action is ...
0
votes
1answer
17 views
find file read it and search for specific identifier
I'm trying to find out in what files some specific identifiers are being used. I know the file's name and know the identifier, therefore I use the following command to achieve my desired result:
find ...
2
votes
5answers
152 views
Remove multiple lines after a pattern match but only after pattern match
I am trying to remove all instances of a pattern match from a file if it matches a pattern. If there is a match, the (complete) line with the matching pattern and the next line get removed.
The next ...
1
vote
2answers
58 views
grep contents of files based on a list of files
Running CentOS 6.5, qemu-kvm.
I have a script which builds a list of running VM's. I want to pull information from those .xml files of only the VM's that are running.
cat /dev/null > ...
8
votes
7answers
361 views
How can I “merge” patterns in a single line?
I am doing grep and sed and I get 2 lines of a file that I am interested in. How can I get these lines in a single line ending with the new line character?
Now I am getting:
pattern1
pattern2
...
0
votes
2answers
35 views
grep command. '^1' won't work
ttys000 -bash: cat n_modified.txt
1 calibre library
2 desktop
3 documents
4 downloads
5 library
6 movies
7 music
8 pictures
9 public
10 ...
0
votes
0answers
22 views
How to get ids from xml file into mysql?
I've got 8 xml files and need to do some work on these records in mysql. What is a good way to get these IDs into mysql?
<?xml version="1.0" encoding="utf-8"?>
<Records>
<Record>
...
2
votes
1answer
41 views
Grep does not seem to work properly for me
Command:
LC_ALL=C fgrep -f /root/inputfile.txt *.txt > outputfile.txt
inputfile contains this kind of stuff;
-name1:
-name2:
-othername:
*.txt (multiple files) contains things such as
...
3
votes
4answers
80 views
How to remove text matching specific patterns from a file
I want to compare two files to check for differences between them, fileA and fileB.
fileA is like a template file and fileB is the file which I want to compare to it. Anytime I find a difference I ...
2
votes
1answer
25 views
Get each column which contains multiple spaces?
My file:
subnet 172.25.10.0 netmask 255.255.255.0 {
option domain-name-servers 172.25.10.9, 8.8.8.8;
default-lease-time 300;
max-lease-time 7500;
range dynamic-bootp 172.25.10.10 172.25.10.30 ;
...
0
votes
1answer
37 views
Quote escaping struggle with grep and sed
I'm writing a bash script to extract data from html tags and I found this command in another thread : grep -o '<tr>.*</tr>' HTMLFILE | sed 's/\(<tr>\|<\/tr>\)//g' > NEWFILE, ...
-4
votes
1answer
84 views
What command in bash to search for this string?
file.txt contains:
aa=testing
sss=whoiam
bbb=findme
What command do I use to search for testing and print it?
Expected result:
# you search testing
4
votes
1answer
65 views
unexpected output with grep
I am using pyrit. For those who dont know, pyrit allows among other things to check if a wpa handshake key is valid:
pyrit -r file0.cap analyze
when a file does not contain a valid key, here is ...
3
votes
2answers
85 views
Getting the combined count of all occurences of a string under multiple directories?
I have a (hopefully) interesting problem that I could use some advice on. I have a system that's essentially used for storing logs. It has a directory structure like:
YYYY/MM/DD/hostname/
There are ...
4
votes
6answers
161 views
grep with a lot of files which contains a lot of lines?
Imagine we have a lot of huge(30000 line)files: a.2014-05-06, a.2014-05-07, a.2014-05-08 and so on.
I know that we can grep a line with word using this command:
grep "word" a.*
First I guess this ...
0
votes
0answers
26 views
Get only files specified in egrep
I could to like ask how to get only the files that contains or match with this command
[ "$(egrep -l 'GE.[100|120|140|159].' /home/test_dir/* xargs egrep -l 'EA.[NT|[HD|HS|QR].')" ];
My problem ...
4
votes
1answer
236 views
command: ls /etc | sort | grep d* is yielding no results but ls /etc | sort | grep p* lists entire directory
I am playing around with piping and grep tonight. I know that grep uses regex and that * means 0 or more occurrences of the preceding character. So the way I understand it is that if I do the ...
6
votes
1answer
304 views
find words with all vowels in order from a file
I have a large dictionary file with 300,000+ words in it and I'm trying to find all words with the vowels aeiou in that order and have only exactly 5 vowels. My current attempt does not seem to be ...
-3
votes
2answers
81 views
Extract certain column from CSV files [closed]
I have a directory with a group of CSV files. All files have the same column headers. I need to extract values in a certain column from all files.
The common part in files names is ...
0
votes
1answer
54 views
Print lines if pattern is not matched
Print lines of File 1 only if they don't contain patterns specified in File 2
Exemple:
$ cat File_1
L1 pattern1
L2 pattern pattern2
L3 pattern3 pattern
L4 pattern4
$ cat File_2
...
5
votes
2answers
254 views
How do you get fgrep to find the literal “--help”?
fgrep --help | fgrep "--help"
returns just the whole fgrep --help, how do I return just the lines that have the literal "--help" in them?
The quotes don't do anything, nor does \-\-help.
2
votes
1answer
27 views
Grep patterns in selected lines
How to keep rows containing pattern 1 only if the next line contains pattern 2 and starts with pattern 3 ?
Exemple: keep line starting with an A only if the next line starts with a B and contains ...
2
votes
2answers
68 views
Will grep go faster with line breaks?
I have some big files that I have changed into "standardized form", removing line breaks. I want to speed up greps on those files. I know that you can optimize grep by doing grep 'partofpattern' | ...
