Count common prefixes by input value in python

Question

I have an input.txt file.

Information: The file 'U_1A/U_2A/U_3C/U_4D' will be found (TBD-001)
Information: The file 'U_1A/U_2A/U_3C/U_4D' will be found (TBD-001)
Information: The file 'U_1A/U_2A/U_3C/U_4D' will be found (TBD-001)
Information: The file 'U_1A/U_2B/U_3C/U_4D' will be found (TBD-001)
Information: The file 'U_1A/U_2C/U_3C/U_4D' will be found (TBD-001)
Information: The file 'U_1A/U_2C/U_3C/U_4A' will be found (TBD-001)
Information: The file 'U_1B/U_2A/U_3C/U_4B' will be found (TBD-001)
Information: The file 'U_1B/U_2B/U_3C/U_4D' will be found (TBD-001)
Information: The file 'U_1C/U_2B/U_3C/U_4A' will be found (TBD-001)
Information: The file 'U_1C/U_2B/U_3C/U_4D' will be found (TBD-001)

what I really want to do is counting the number of contents inside the single quote in descending order.

So, When I execute the python code, User should put certain number. and that input number means the depth of the hierarchy. for example, When I put 2, then the output should be like this

U_1A/U_2A : 3
U_1A/U_2C : 2
U_1C/U_2B : 2
U_1A/U_2B : 1
U_1B/U_2A : 1
U_1B/U_2B : 1

and when I put 3, the output be like this.

U_1A/U_2A/U_3C : 3
U_1A/U_2C/U_3C : 2
U_1C/U_2B/U_3C : 2
U_1A/U_2B/U_3C : 1
U_1B/U_2A/U_3C : 1
U_1B/U_2B/U_3C : 1

so on so forth.

In order to achieve this, I managed to sort out the list of the string inside '' by the following code.

text = open("input.txt", "r")

# Loop through each line of the file
for line in text:
    # Remove the leading spaces and newline character
    line = line.strip()
    #print(line)
    # Split the line into words
    words = line.split(' ')
    word = words[3]
    print (word)

Okay, you got the string. Now where is the part where you ask for the depth and split `word` on `/`? — OneCricketeer, Jun 07 '22 at 12:24
Thanks for the comment! that is the point that I want to ask.. can u give me any clue or example? — Parine, Jun 07 '22 at 12:25
You already know how to use split. Are you asking how to [read input as number](https://stackoverflow.com/questions/20449427/how-can-i-read-inputs-as-numbers)? — OneCricketeer, Jun 07 '22 at 12:28
Yes I wonder the way to read input as number with the lists.. I want to relate the number of '/' to that input to make output in descending order.. — Parine, Jun 07 '22 at 12:40

inquirer · Accepted Answer · 2022-06-07T16:15:15.310

You can do this quickly in pandas. Here the file is read, separated by spaces, and a dataframe is created. Each line is divided into an array by the separator '/', the specified number is taken in a loop and the unique values are counted. The array is then concatenated back into a string using join.

import pandas as pd

df = pd.read_csv('df2.txt', sep = ' ', header=None)

for i in range(1, 5):
    a = df[3].str.split("/").str[:i].str.join('/')
    print(a.value_counts())

Input

              0    1     2                      3     4   5      6          7
0  Information:  The  file  'U_1A/U_2A/U_3C/U_4D'  will  be  found  (TBD-001)
1  Information:  The  file  'U_1A/U_2A/U_3C/U_4D'  will  be  found  (TBD-001)
2  Information:  The  file  'U_1A/U_2A/U_3C/U_4D'  will  be  found  (TBD-001)
3  Information:  The  file  'U_1A/U_2B/U_3C/U_4D'  will  be  found  (TBD-001)
4  Information:  The  file  'U_1A/U_2C/U_3C/U_4D'  will  be  found  (TBD-001)
5  Information:  The  file  'U_1A/U_2C/U_3C/U_4A'  will  be  found  (TBD-001)
6  Information:  The  file  'U_1B/U_2A/U_3C/U_4B'  will  be  found  (TBD-001)
7  Information:  The  file  'U_1B/U_2B/U_3C/U_4D'  will  be  found  (TBD-001)
8  Information:  The  file  'U_1C/U_2B/U_3C/U_4A'  will  be  found  (TBD-001)
9  Information:  The  file  'U_1C/U_2B/U_3C/U_4D'  will  be  found  (TBD-001)

Output

'U_1A    6
'U_1C    2
'U_1B    2
Name: 3, dtype: int64
'U_1A/U_2A    3
'U_1A/U_2C    2
'U_1C/U_2B    2
'U_1B/U_2B    1
'U_1B/U_2A    1
'U_1A/U_2B    1
Name: 3, dtype: int64
'U_1A/U_2A/U_3C    3
'U_1C/U_2B/U_3C    2
'U_1A/U_2C/U_3C    2
'U_1B/U_2B/U_3C    1
'U_1B/U_2A/U_3C    1
'U_1A/U_2B/U_3C    1
Name: 3, dtype: int64
'U_1A/U_2A/U_3C/U_4D'    3
'U_1A/U_2C/U_3C/U_4D'    1
'U_1B/U_2A/U_3C/U_4B'    1
'U_1A/U_2C/U_3C/U_4A'    1
'U_1C/U_2B/U_3C/U_4A'    1
'U_1C/U_2B/U_3C/U_4D'    1
'U_1B/U_2B/U_3C/U_4D'    1
'U_1A/U_2B/U_3C/U_4D'    1

As far as I understand, you need to count bla1, bla2, bla3. That solution is the following, no loop is needed, specify the desired slice, in this case it is [:4].

a = df[3].str.split("/").str[:4].str.join('/').value_counts()
print(a)

If you need to skip an element, then the solution is somewhat more complicated. For example, you need: bla1, bla2 and bla4. Break each value into a separate column. We use fancy indexing to select necessary. In 'c' again glue back the selected elements and count.

b = df[3].str.split("/", expand=True)
c = b[[0, 1, 3]].apply(lambda row: '/'.join(row.values.astype(str)), axis=1)
print(c.value_counts())

Output

'U_1A/U_2A/U_4D'    3
'U_1A/U_2C/U_4A'    1
'U_1A/U_2B/U_4D'    1
'U_1C/U_2B/U_4D'    1
'U_1B/U_2A/U_4B'    1
'U_1A/U_2C/U_4D'    1
'U_1B/U_2B/U_4D'    1
'U_1C/U_2B/U_4A'    1

Thank you very much! It helped a lot. but the code seems to take all the 4th word(df[3]) of input lines.. What If the garbage lines such as ' bla1 bla2 bla3 bla4 bla5' inserted in certain row, then 'bla4' would also be poped out. how can I sort out this thing?? Thanks again — Parine, Jun 07 '22 at 14:17
This is all set in a loop, if you need up to the third word, then: for i in range(1, 4): Check and tell me, this what you wanted? — inquirer, Jun 07 '22 at 14:21
Okay.. for example, I am asking the case If a certain useless line such as 'bla1 bla2 bla3 bla4 bla5' inserted in the middle of the input.txt , Then, 'bla4' would be issued as well inside the output. however. I only need 'U_*' form of lines.. then How can I exclude such useless part? (but maintaining input.txt) But Again, You keep helping me a lot. thanks — Parine, Jun 07 '22 at 14:29
Okay then, How can I add one more condition in the first place? Condition : From input.txt , Only lines that contains 'will be found' would be considered — Parine, Jun 07 '22 at 14:41

Count common prefixes by input value in python

1 Answers1