Split file based on string delimiter in bash.how?

Question

I have this file.csv :

coordinate1,coordinate2,value1
11111,a1,65
11111,a2,32
22222,b1,39
22222,b3,55
33333,c5,12
33333,c9,16
coordinate1,coordinate2,value2
54656,a1,65
21342,a2,32
23543,b1,39
123123,b3,55
568568,c5,12
568568,c9,16
123123,b3,55
568568,c5,12
568568,c9,16
coordinate1,coordinate2,value3
23543,b1,39
123123,b3,55
568568,c5,12
568568,c9,16
123123,b3,55
23543,b1,39
123123,b3,55
568568,c5,12
568568,c9,16
123123,b3,55
11111,a1,65
11111,a2,32
22222,b1,39
22222,b3,55
33333,c5,12
33333,c9,16

Now I would like to split this file in 3 files , everyone whit only bloc of data

Es: 1° file
   coordinate1,coordinate2,value1
    11111,a1,65
    11111,a2,32
    22222,b1,39
    22222,b3,55
    33333,c5,12
    33333,c9,16

Es: 2° file
    coordinate1,coordinate2,value2
    54656,a1,65
    21342,a2,32
    23543,b1,39
    123123,b3,55
    568568,c5,12
    568568,c9,16
    123123,b3,55
    568568,c5,12
    568568,c9,16

score 22 · Answer 1 · answered Dec 01 '09 at 12:13

22

Blatantly stolen from this forum:

awk '/YOUR_TEXT_HERE/{n++}{print >"out" n ".txt" }' final.txt

should do the trick (replacing YOUR_TEXT_HERE, of course).

Replacing it with your conditions, and sending output to #file.txt with an input file of a.txt:

$ awk '/coordinate1,coordinate2,value?/{n++}{print > n "file.txt" }' a.txt
$ ls
1file.txt  2file.txt  3file.txt  a.txt
$ cat 1file.txt 
coordinate1,coordinate2,value1
11111,a1,65
11111,a2,32
22222,b1,39
22222,b3,55
33333,c5,12
33333,c9,16
$ cat 2file.txt 
coordinate1,coordinate2,value2
54656,a1,65
21342,a2,32
23543,b1,39
123123,b3,55
568568,c5,12
568568,c9,16
123123,b3,55
568568,c5,12
568568,c9,16
$ cat 3file.txt 
coordinate1,coordinate2,value3
23543,b1,39
123123,b3,55
568568,c5,12
568568,c9,16
123123,b3,55
23543,b1,39
123123,b3,55
568568,c5,12
568568,c9,16
123123,b3,55
11111,a1,65
11111,a2,32
22222,b1,39
22222,b3,55
33333,c5,12
33333,c9,16

answered Dec 01 '09 at 12:13

Mark Rushakoff

249,864
45
407
398

I tried this example. I get the following error: awk: syntax error at source line 1 context is /coordinate1,coordinate2,value?/{n++}{print > n >>> "file.txt" << – Raffi Khatchadourian Jun 04 '11 at 03:52
@RaffiKhatchadourian Which version of awk did you use? – Armali Jun 10 '13 at 07:29
@Armali awk version 20070501 – Raffi Khatchadourian Jun 10 '13 at 16:34
What if I would like split file in chunks containing x-times header (or some pattern)? – rackom Oct 22 '13 at 12:05
Is it possible to name the output files according to what `?` is? (e.g. `1`, `2`, `3` in this example) – confetti Oct 24 '18 at 09:55

score 6 · Answer 2 · answered Jul 07 '15 at 17:45

6

You could use csplit:

csplit file.txt /^c.*/ {*}

This syntax works on cygwin but haven't tried it elswhere.

answered Jul 07 '15 at 17:45

Spikolynn

4,067
2
37
44

score 2 · Answer 3 · answered Jun 11 '13 at 06:22

2

This differently quoted version of the other answer also works with Windows CMD:

awk "/coordinate1,coordinate2,value?/{n++}{print>n\"file.txt\"}" a.txt

answered Jun 11 '13 at 06:22

Armali

18,255
14
57
171

Split file based on string delimiter in bash.how?

3 Answers3

Linked