Manipulation of text by programs, scripts, etc.
0
votes
1answer
19 views
Find out on which line in text file is matching word
Is there any way to find out on which line of the text document is some word which is matching pattern for example with grep or something. Thanks.
0
votes
1answer
36 views
Read only specific lines from text file and save matches into variables [on hold]
I've got this problem.
I need to extract some words from text file, which I find by specific pattern in that text. For example:
/this/is/path:
file1.txt date 3
file2.txt date 2
/this/is/path2:
...
2
votes
1answer
64 views
How to cut away the end of a textfile after a specified line
I have == Changelog == in a textfile and I want to create a new file where this line and everything after it will be deleted.
I am sure the answer is here somewhere, I have tried to search, now my ...
1
vote
2answers
43 views
How to read only the second last line of a file
I have a client that updates/writes into myfile.csv arbitrarily.
I've written the following code, I left the MySQL snippet out:
while true
do
awk_variables_value_array=`tail -n2 myfile.csv | awk ...
1
vote
1answer
69 views
Bash: Looping through a string
I have a variable Vmac that stores values of multiple MAC addresses, collected from wmic call as follows:
Vmac=`wmic --delimiter="," --authentication-file=/path/to/file //IP-ADDR "Select ...
1
vote
2answers
39 views
Some characters disappear after processing a text file
I've a file named addresses.txt :
[email protected]
[email protected]
[email protected]
I'd like to echo "[email protected]" using for loop.
Here's what I did :
cat addresses.txt | ...
-1
votes
1answer
18 views
Remove line breaks in a FASTA file
I have a fasta file where the sequences are broken up with newlines. I'd like to remove the newlines. Here's an example of my file:
>accession1
ATGGCCCATG
GGATCCTAGC
>accession2
GATATCCATG
...
0
votes
0answers
28 views
match two files [duplicate]
I have 2 files. The first, fileA looks like
TCONS_00000066 XLOC_000030 - u q1:XLOC_000030|TCONS_00000066|0|0.000000|0.000000|0.000000|0.000000|-
TCONS_00000130 XLOC_000057 - u ...
1
vote
2answers
68 views
match first column of file a with paragraphs of file b
I have 2 files. The first, fileA looks like
TCONS_00000066 XLOC_000030 - u q1:XLOC_000030|TCONS_00000066|0|0.000000|0.000000|0.000000|0.000000|-
TCONS_00000130 XLOC_000057 - ...
1
vote
3answers
38 views
Remove duplicate entries from a CSV file
I've got a [csv] file with duplicate datum reprinted ie the same data printed twice. I've tried using sort's uniq
by sort myfile.csv | uniq -u however there is no change in the myfile.csv, also I've ...
1
vote
1answer
28 views
Replace a string in a text file using a shell script not working properly
I have a text file containing this:
0 0 -1 0
1 0 0 0
0 -1 0 0
1.5 0.0 1.0 1
and I want to replace the 1.0 to 2.0 so that it becomes:
0 0 -1 0
1 0 0 0
0 -1 0 0
1.5 0.0 2.0 1
so I use this ...
2
votes
5answers
173 views
How to reverse the lines between a pattern into another file
I have the following in the input file
#Start para
0 hello dq
1 world dq
2 welcomes dq
3 you dq
#Start para
0 how tq
1 are tq
2 you tq
#Start para
0 say dq
1 hello dq
2 to dq
3 the dq
4 world dq
I ...
1
vote
1answer
50 views
Shell : while read line nested
I've two documents: doc1.lst and doc 2.lst
I want to take the content of each line and put it as parameters for my SQL query.
I tried something like this, please correct me
file=doc1.lst
...
3
votes
3answers
131 views
Splitting a sequence into fixed width
I have a file like this which is a two-column tab-separated file.
CTGCAGTTTCCCCAAATGTGGGAAACTTGACTGTATAATTTGTGGCAGTGGTA a1
GATTTCCCCAAATGTGGGAAACTCACTCGGCAGGCGTTGATA a2
I want to get an output ...
1
vote
3answers
37 views
How to do find and replace in one field based on the value in the other field?
I have a file like this.
IMS00|20140101|Unix|Jan14
IMS01|20140201|Unix|Feb14
IMS02|20140301|Unix|Mar14
IMS03|20140101|Unix|Jan14
IMS04|20140201|Unix|Feb14
My criteria are,
if the column 1 value is ...
3
votes
3answers
28 views
Using sed to remove string or paragraph between delimiter
I would like to know who to remove a string or paragraph that are between ((( string )))
Lorem ipsum (((dolor sit amet))), consectetur adipiscing elit. Vestibulum aliquet fringilla est, dictum ...
4
votes
2answers
97 views
Regular expression to match sequences of alphanumerics
Any way using grep/awk/perl to match lines in the form
*.* = *.* (i.e. ac4df.bx5dfd8g = ce5def.dd5f7gdgf )
Where * means 0+ alphanumeric char?
2
votes
6answers
206 views
Replace \n with blank in a file
I want to replace \n with blank
Input file1
A\n
D\n
Output file2 I want
A
D
I tried below commands but not able to replace please do needful.
cat OUT | tr '\n' ' '
1
vote
2answers
20 views
Transform values in a line by first field
I was wondering if there is an easy way to do the following without writing a script.
Transform
1234,"a;b;d"
2345,"e;f;g;h"
to
1234,a
1234,b
1234,d
2345,e
2345,f
2345,g
2345,h
1
vote
3answers
55 views
Append based on line count in awk after pattern match
How can I append lines after a pattern match in awk based on how many lines they are after the pattern match.
What I have looks like this:
Stuff
PATTERN
a b c
a b c
a b c
ENDOFSECTION
Morestuff
I ...
2
votes
1answer
25 views
Match and delete lines with ~100 strings
I have a list of roughly 100 entries to be deleted from a csv-delimited file. They are already in another text file called 'tbd.txt;
My first thought is to write a bash for loop around 'sed -i' but ...
1
vote
1answer
43 views
Searching file for string surrounded by two other known string?
Question title may be kinda vague, but heres what im attempting to do.
I have a html file locally on my server which is changing fairly regularly. It has multiple occurrences of:
<p>Jumble of ...
3
votes
1answer
66 views
Bash scripting to scan files for words and create report
Ok yes this is a homework assignment BUT I am NOT looking to have the answers given to me.
The scenario is that I need a script that searches all my users home directories for bad words. I need the ...
0
votes
3answers
42 views
How can I capture the common characters between two strings
I'm looking to compare two strings and capture the common part e.g.
FILE0000010985.LOG
FILE0000010999.LOG
FILE0000011000.LOG
If I compare 1 to 2, I want the output to be ...
0
votes
3answers
42 views
I want to condense a list of ranges (from-to)
I have data involving codes assigned to ranges in the form of
From To Code
0 5 A
5 10 A
10 15 A
15 20 B
20 25 B
25 30 A
30 35 A
35 ...
2
votes
4answers
28 views
grep and print how many times my pattern in file 1 is present in file2
I have a file1 (list of my pattern) like this:
file1
Fatty_acid_degradation
Aminobenzoate_degradation
Amino_sugar_and_nucleotide_sugar_metabolism
Amoebiasis
and I have a file2 (list of all the ...
1
vote
1answer
32 views
Specify the type of field to modify in a file
I have a list of clients, "code", "name", "location", "etc"
and I want to make a function that asks the employee to give the client's code
and then the field he/she wants to change.
For example, ...
1
vote
1answer
56 views
Shell script runs diffrently based on working directory.
I have a script which runs differently based on current working directory.
Basically it processes an .ini file and takes parameters from it and runs mysql backup.
Script is running as root user.
...
2
votes
3answers
91 views
Find the number FN with awk
I have one document, and this document has several columns, like this:
,Flag2,,Flag4,Flag5,,,,,Flag10,Flag11,Flag12,Flag13
If I use awk to know the total number of fields, knowing the separator ...
1
vote
0answers
34 views
delete non important characters from command output
the version command in my Linux machines display the following output
version
Red.Hat.OS. release..........5.5
APP.Release.............4.2.0.0-02
how to remove the middle "." dot character ...
2
votes
2answers
35 views
How do I insert new columns into a .csv file?
Example Data:
"Monday","12345","Friday"
In the above file, I want to add a new column in between 12345 and Friday.
How can I do that ?
1
vote
3answers
40 views
Select and remove lines matching a pattern from a file
grep -Eri "drucken" app/views
app/views/meths/_form.html.erb: <li class="hidden-phone"><a onclick="javascript: print();" class="">Methode ...
2
votes
3answers
149 views
How to extract only a part of one line?
I want to extract the essid in a dump file from airodump-ng using grep.
The part where I want to extract looks like this:
<SSID first-time="Wed Feb 25 07:06:57 2015" last-time="Wed Feb 25 ...
1
vote
0answers
65 views
Sed regex printing into a file.txt
I'm connected to a MQTT stream, and I filter out the data by entering :
mosquitto_sub -d -t +/# 2>&1 |
sed -n "/PUBLISH/{s|.*\('.*',\).*|\1$(date),|;N;s/\n//;p}"
into the Ubuntu terminal. ...
4
votes
2answers
70 views
Use lines in a file to produce string and file name
I have a file, foo.txt, that has a folder name on each line:
folder_1
folder_2
folder_3
And I'd like to do something like this:
cat foo.txt | xargs -I {} echo 'function {}() { return stuff; }' ...
0
votes
1answer
32 views
looping through a file on 2 lines in shell
I have a file which looks like this:
>a
TCCACTCCACGC
>b
ACCTCCAG
I want to loop through the file in such a way that it takes into account 2 lines at a time i.e >a and its sequence and then ...
4
votes
2answers
55 views
How can set a row as column in unix [duplicate]
How can I set a row as column in Unix.
Example:
name : Keshav
sub : C++
branch: cse
DOB :22/09/1990
company:NONE
name : Vijay
sub : Java
branch: cse
DOB :22/09/1985
company:NONE
I want output ...
9
votes
4answers
458 views
How to remove duplicate characters?
If I am having a line as:
Thhiisss iisss mmyyy nameeee
I want to print this as:
This is my name
What is the unix command for this?
1
vote
1answer
63 views
Print lines between two patterns matching a condition in awk
How can I print lines between two patterns which meet a certain condition?
For instance for an input file partially containing the following:
Time %MEM %CPU %SWAP
00:05:02 7.3 ...
-1
votes
0answers
32 views
Count how many times a word occurs in a txt file with awk
Basically i'm trying to count all instances of certain words that occur in a text file then printing the result. It has to be in done using awk. Im not really sure where to start.
Any suggestions?
0
votes
1answer
28 views
Printing out range of a pattern with awk
Im trying to print out a section of a txt file using awk. Basically I want to print out the paragraph in the a txt file that begins with certain words all up to a blank line.Here's what I have so far:
...
-1
votes
0answers
23 views
target a specific part of code and change it
I have the following html code
<td style="color:#8C8C8C;font-size:10px;font-family:Arial,'Helvetica';text-align:center; padding:0 15px 0 15px;">Keep ensured your hat is fine.<br />
If ...
1
vote
2answers
49 views
print the output of 2 commands in 1 file on the same line
Thanks for looking at this.
I have a possible simple question, but I wasn't able to find any help so far on the internet.
I have a script that has mainly 2 commands that process output.
But both ...
1
vote
2answers
40 views
how to remove a multilined string/block of text pattern from a file? [duplicate]
I have a text file that has a multiple lined string of text I'd like to scan the file for and remove all instances that it finds of that multilined and potentially sometimes duplicate string.
example ...
1
vote
2answers
135 views
How can I remove a carriage return, add a time stamp and ignore some data from a live MQTT feed
I type mosquitto_sub -d -t +/# from the Ubuntu terminal to access the MQTT stream.
Real output from the live MQTT stream is this:
Sending PINGREQ
Received PINGRESP
Sending PINGREQ
Received PINGRESP
...
0
votes
1answer
24 views
how to change several piece of html code
I have several chunks of html code ,see below, in a html page that I need to change
Assurez-vous de bien recevoir tous nos messages en ajoutant [email protected] à votre carnet ...
1
vote
1answer
66 views
How to extract certain data from an MQTT stream
I type mosquitto_sub -d -t +/# from the Ubuntu terminal to access the MQTT stream.
However I would like to see only a specific set of data from the MQTT stream. I've added | grep -v PING so ...
2
votes
5answers
218 views
cut for key-value pairs
I am looking for an easy way to cut key-value pairs (where the key is unique and specified) from text, much like how cut can be used to cut a specified column in a CSV file. The keys I'm looking for ...
3
votes
3answers
46 views
sed command and formatting one line help
I need help turning these headers:
'>>tr|G1PEZ0|G1PEZ0_MYOLU Uncharacterized protein (Fragment) OS=Myotis lucifugus GN=SNCG PE=4 SV=1
into just this:
'>G1PEZ0_MYOLU
I've given up. I ...
0
votes
2answers
38 views
How to weave the words of a string into a block of strings in vim?
Given a string and a block of strings e.g.
String:
Use three words.
Block:
This is the first string of another block of strings.
This is the second string of another block of strings.
This is the ...
