Manipulation of text by programs, scripts, etc.
2
votes
4answers
43 views
How to remove part of a string
I keep reading the sed documentation and lots of posts but can't seem to figure this out. I have a large number of Java files. In those files are calls to a method that take the enumeration converted ...
1
vote
1answer
51 views
Replace pattern in file with pattern in second file
I want to replace part of a file's data, with data from another file.
Suppose file1 has data as is written below and file2 has some data I want to store and replace file1 data from file2 from ...
2
votes
2answers
20 views
Match from current line until a line that doesn't match a pattern
I really tried searching but could not find anything (it's hard to know what exactly to search for).
I know how to do this with sed: print from current line until the line that matches SOMETHING:
...
1
vote
1answer
34 views
How to write this replacement with condition
I want to replace now within my working directories the word -> with $\to$ if the word is not within verbatim environment.
Pseudocode
Replace all entriens of -> with $\to$ everywhere else but not
...
0
votes
3answers
44 views
Filter names from textfile
I have a file where there are names sitting in the first character position. I am trying to find a way to grep all the names. Example here I would want the names BUBBA and SUSAN listed.
BUBBA =
...
3
votes
2answers
61 views
How to write this pseudocode where condition
This question is extension of this question about listing questions of directories.
I get a problem that I need to understand the original section of the text.
Current output
where you see the ...
-1
votes
2answers
34 views
Using 'sed' to find and replace [duplicate]
I know this question has probably been answered before. I have seen many threads about this in various places, but the answers are usually hard to extract for me. I am looking for help with an ...
6
votes
6answers
319 views
Decoding URL encoding (percent encoding)
I want to decode URL encoding, is there any built-in tool for doing this or could anyone provide me with a sed code that will do this?
I did search a bit through unix.stackexchange.com and on the ...
7
votes
1answer
80 views
How to filter any part of description or option from manpage
I want to get output of any desired description or option from a man page.
Example: I want to get the description for the autoclean option from the apt-get man page:
Please suggest a command, ...
0
votes
1answer
36 views
How do I replace the '\' with '/' in file using the command line?
After grep line with AAA/BBB/CCC but the output file consists only the line as AAA"& #x5c;"BBB"& #x5c;"CCC..
How do I fix this?
2
votes
1answer
35 views
Read two text files, concatenate each line
I have two text files of the same length, in order: one of products, the other of comparison products. I'd like the output to be "product;comparison" for each line. Yes I could throw them in a ...
0
votes
1answer
57 views
Read text file and find unique records
I have a large text file with columns A, B, C, and D. How do I read the unique values for columns C and D and write those unique rows to a regular text file or in JSON format?
2
votes
4answers
55 views
how to print a new line in awk
I am trying to print collected data from a file where each set gets a new line (\n)
Code:
awk '/mail:|fullName:|uid:/{s=s", "$0} END{print substr(s,3)}' dump2.txt
Output now:
mail: ...
1
vote
2answers
69 views
grepping for multiple items
I have about 6 items I need extracted from and LDAP base dump file
fullName:
uid:
email:
...
the colon is required for the search, mainly because uid appears in a number of places in the file but ...
1
vote
3answers
101 views
sed + find value before word in line
How can I find the value before the word "free"?
top -n1 | grep Mem
Mem: 2054968k av, 2034120k used, 20848k free, 0k shrd, 186768k buff
First I tried
top -n1 | grep ...
-2
votes
1answer
45 views
Extract/print every 3rd occurence of pattern
I need help with extracting/printing lines until a stop pattern. This needs to happen after every 3rd occurrence of start pattern, i.e ERROR_FILE_NOT_FOUND and continue until the end of the file. ...
-2
votes
0answers
31 views
How can I change date to the previous month in the format mm/dd/yyyy [closed]
timestamp('10/01/2014 00:00:00','MM/DD/YYYY HH24:MI:SS') AND to_timestamp('10/31/2014 23:59:59','MM/DD/YYYY HH24:MI:SS')
How can I convert this file data into the previous month's data? For ...
-3
votes
0answers
34 views
Copying a number to a variable from a text file [closed]
I have a text file xyz.txt which contains only one number.
Now I have to extract that number into a variable, use the variable for checking something, increment it by 1 and store it in the same file ...
3
votes
1answer
41 views
Identify duplicate blocks of text within a file
Is there a convenient way to identify duplicate or near duplicate blocks of text within a file?
I want to use this for identifying code duplication. It looks like there are specialty programs with ...
3
votes
2answers
78 views
Select certain column of of each file, paste to a new file
I have 20 tab delimited files with the same number of rows. I want to select every 4th column of each file, pasted together to a new file. In the end, the new file will have 20 columns with each ...
2
votes
2answers
46 views
How to get grep exit code but print all lines?
I'd like to check whether a line printed by a command contains an error message, but I'd like to also print all the output from the command (for make logs). Is there some way to get all the output of ...
0
votes
1answer
26 views
Replace copyrights recursively [duplicate]
I have many files under the current directory.
Each file contains copyrights headers like,
#
# Copyright 2013 Company, Inc. All rights reserved. This software
# is property of Company, ...
0
votes
1answer
26 views
Why does my vim status line say “Obtaining ../”?
On the righthand side of my vim status line it says "Obtaining ../" and is highlighted yellow. Why does it say this?
The results of :set are:
:set
--- Options ---
cpoptions=BceFs history=1000 ...
1
vote
1answer
27 views
Perl one-liner for replacing values greater than a threshhold
I have a text file which contains 7 columns of floating point values (). I would like to use perl one-liner and find the values which are greater than a threshold in the 7th column. Then, I want to ...
0
votes
1answer
58 views
Very basic H/W question using pipe and grep
I have two text files, F1a.txt and F1b.txt, with essentially the same data: the driver's surname and their nationality. For example:
Hamilton GBR
Alonso SPA
I have concatenated these ...
9
votes
2answers
484 views
Tool in unix to subtract text files? [duplicate]
I have a large file composed of text fields separated by semicolons in the form of a large table. It has been sorted.
I have a smaller file composed of the same text fields. At some point, someone ...
1
vote
2answers
33 views
Extracting file name and string from multiple files
I have a lot of files (>100,000) from which I would like to extract a specific string and the filename itself. Files are organized like this:
Filename: sequence.php?ID=gi|90022703|ref|YP_528530.1|
...
-1
votes
1answer
36 views
replace pattern matching
I want to replace part of a file's data, with data from another file.
Suppose file1 has data as is written below and file2 has some data I want to store replace file1 data from file2 from starting ...
1
vote
3answers
51 views
Modify some files to add the file name
I have a bunch of text (hundreds of txt) inside a directory. Each of them has a unique filename. I want to insert filename of each file into the first line of respective files. How can I do that using ...
3
votes
2answers
116 views
Extract text including parens
I have some text like this:
Sentence #1 (n tokens):
Blah Blah Blah
[...
...
...]
( #start first set here
... (other possible parens and text here)
) #end first set here
(...)
(...)
Sentence #2 ...
6
votes
1answer
190 views
How do I print all but the Nth to last line in sed?
I'd like to do the complement / "opposite" of
sed 13q;d <file.txt
More generally, is it possible to do this sort of
complement/inverse/opposite in sed? Or only for regexes?
How do I print all ...
1
vote
3answers
45 views
Find a string in one section of a file with mutiple sections
How to sed/awk for a string contained in another string.
TESTVAR='
{
icon : "icons/773_l.png",
id : 80,
initialState : true,
isPng : false,
label : "Imagery",
opacity : 1,
requestType : ...
1
vote
3answers
169 views
“grep” the available space from “df” output
Hello I need to grep the output from df. Sadly awk is not an option (even though its the easy option) here I can only use grep.
Filesystem 1K-blocks Used Available Use% Mounted on
none ...
1
vote
1answer
44 views
How to Replace IP at Specific Line
I have a file (.htaccess) which contains below excerpt.
<Files wp-login.php>
order deny,allow
deny from all
allow from 45.152.35.2
</Files>
I need to replace 45.152.35.2 with my current ...
0
votes
1answer
22 views
filter fileds in a file, without constant record format
I have 3 files with millions of records each.
I'd like to filter those files in order to find some data more easily. Unfortunately, there is no common format from one record to other. For example:
...
1
vote
4answers
102 views
how to match the number with % from df -k command
in my bash script I want to print the use capacity of /var partition from df -k command
I do the following
df -k | grep var | awk '{print $5}'
the problem is that sometimes "use%" number ...
0
votes
2answers
31 views
Add space after 8 characters then add space after every 4 characters
Here is the sample input:
AbbigailAbieAbbyAbbi
Using sed, I have separated them into 4 characters but seems like I got a problem because I have to separate the first 8 characters first then add ...
-1
votes
1answer
53 views
Match and combine records in Bash [duplicate]
Consider two csv files:
$ cat given.csv
123,John
246,Paul
369,George
987,Ringo
$ cat family.csv
246,McCartney
123,Lennon
987,Starr
369,Harrison
Note that the lines are not ordered! How might I use ...
2
votes
5answers
115 views
Extract lines from a file containg From <str1> To <str2>
Let's says there is file "abc.txt" that contains a paragraph/lines:
Hello, how are you doing sir?
when are you going to arrive at the SBAHN platform to catch the train?
How can I extract all the ...
2
votes
1answer
28 views
Comparing delimited fields
I have two fields in a file, students and teachers. They're delimited by a semicolon and I want to find which single students have two different teachers.
jdoe;ateacher
jdoe;bteacher
jsmith;cteacher
...
0
votes
3answers
66 views
Combinatorics of letters and words - preferably bash, will accept perl or other [closed]
I am trying to write a shell script to generate all possible words in the English language less than 20 characters. I doubt there is any truly efficient way to do this other than to brute force some ...
0
votes
2answers
46 views
Convert two rows to two columns
I would like to convert every two rows to two columns using awk. Any help appreciated.
input.txt:
# Query: gi|11465907|ref|NC_001872.1| Chlamydomonas eugametos genome, complete genome
# 0 hits found
...
0
votes
3answers
133 views
bash find using variable
I have an issue I don't understand. It is simple and it should work, but it doesn't.
=EDITED exactly what I can see from terminal=
I have a list of filenames:
[molni@archlinux picasa_album]$ cat LIST
...
2
votes
2answers
19 views
Replace line names with set of new names without disturbing the rest of the file
I have a large protein sequence file where each sequence name is identified using > and the corresponding sequence in the following lines.
Example (ignore quotation marks):
>YAL003W EFB1 ...
-1
votes
3answers
96 views
How can I select columns based on a control file with invalid column numbers?
I have to generate the file dynamically from the source file based on the below control file.
control_file.txt
1,3,5,-1,8,-1,4
The control file contains the position of columns which I require ...
6
votes
2answers
262 views
Compare two files and print matches
Is there anyway to get this through Unix shell scripting?
I have a fileA with one column (1000 rows), and fileB with 26 columns(13000 rows).
I need to search each value of fileA with fileB and return ...
1
vote
0answers
23 views
Create files from templates, substitutions in middle of other words
Is there a way to convince m4 to replace a macro in the middle of a word?
I would like this file, day.m4:
define(Sat,Cat)dnl
Saturday
and this command:
m4 day.m4
to produce this output:
...
2
votes
3answers
45 views
Merging two tables including multiple ocurrence of column identifiers and unique lines
I asked a similar question yesterday (Merging two tables including multiple ocurrence of column identifiers) but ran into a problem with unique lines.
I would like to merge two tables based on column ...
1
vote
3answers
48 views
Replace word instances with its count attached to it
I have a file which contains word 'name' multiple times ( 250 times ).
I need to replace every instance of 'name' with its count attached to it as name_1, name_2, name_3....name_250.
Can I do this ...
4
votes
6answers
141 views
Sed — Replace first k instances of a word in the file
I want to replace only the first k instances of a word.
How can I do this?
Eg. Say file foo.txt contains 100 instances occurrences of word 'linux' .
I need to replace first 50 occurrences only.
