awk merging 2 columns and adding an extra column to txt file

Question

I did this in the past without problems, but I can't this time and I don't understand why.....

My original files is

1002       10214
1002       10220
1002       10222
1002       10248
1002       10256

I need to make a new file where the 2 columns above are merged and add a second column with value 1

Desired output should look like this

100210214    1
100210220    1
100210222    1
100210248    1
100210256    1

I tried the below awk commands to first print the 2 columns into 1 into a tmp file, then adding the extra column with "1"

cat input.txt |  awk '{ print ($1$2)}' > tmp1.txt

cat tmp1.txt | awk ' {print $0, (1) }' > output.txt

While the first command seems working ok, the second does not

tmp1.txt (OK)

output.txt (not OK)

The "1"comes in the front of the first column, not sure why, even replacing the first 2 characters. Is it because the original input file is different (may be "space" was used instead of tab)?

`awk '{$1=$1$2;$2=1}1' file.txt` – Rafael Apr 05 '19 at 07:15 — Rafael, Apr 05 '19 at 07:15

RavinderSingh13 · Answer 1 · 2019-04-05T08:43:38.553

1

Could you please try following.

awk 'BEGIN{OFS="\t"} {sub(/\r$/,"");print $1 $2,"1"}'  Input_file

edited Apr 05 '19 at 08:43

answered Apr 05 '19 at 07:23

RavinderSingh13

130,504
14
57
93

does not work unless I do first dos2unix file – esse Apr 05 '19 at 07:34
Huh? The `gsub` does the same thing as `dos2unix`. – tripleee Apr 05 '19 at 08:30
@tripleee, sorry if I am wrong here, I thought it will remove all `\r` characters from line. – RavinderSingh13 Apr 05 '19 at 08:39
Well yes, if you can find a file where there are CR characters somewhere else than at the end of the line, this will do something slightly different than `dos2unix` – tripleee Apr 05 '19 at 08:41
@tripleee, sure sir, I have changed command to `sub(/\r$/,"")` now. – RavinderSingh13 Apr 05 '19 at 08:44
I was reacting to the OP's assertion that this "doesn't work" though. – tripleee Apr 05 '19 at 08:45

oguz ismail · Accepted Answer · 2019-04-05T07:23:40.270

0

This happens when input file has Windows line endings (i.e. \r\n). You can fix it using this command:

dos2unix file

and then get the desired output with this one:

awk '{$1=$1$2;$2=1}1' file

edited Apr 05 '19 at 07:23

answered Apr 05 '19 at 07:16

oguz ismail

1
16
47
69

1

It works, thank you! Windows line endings was definitely the problem – esse Apr 05 '19 at 07:24

awk merging 2 columns and adding an extra column to txt file

2 Answers2