How to read the data from a file and get the concordance output

Question

I have the code which will throw the output from the given string.

inputdata = "HELLO HELLO HELLO BOBBY WHAT ARE YOU DOING"
myDict = {}
linenum = 0

for word in inputdata.split():
    if not word in myDict:
        myDict[word] = []

    myDict[word].append(linenum)


print "%-15s %-15s" %("Word", "Frequency")
for key in sorted(myDict):
    print '%-15s: %-15d' % (key, len(myDict[key]))

the output would be

   Word            Frequency     
 ARE           : 1              
 BOBBY         : 1              
 DOING         : 1              
 HELLO         : 3              
 WHAT          : 1              
 YOU           : 1

But when I tried to replace the string with .txt file, Script was prompting the popup to enter the text instead of reading the data from the .txt file.

f = open(raw_input("eng.txt"), "r")
myDict = {}
linenum = 0

for word in f.split():
    if not word in myDict:
        myDict[word] = []

    myDict[word].append(linenum)


print "%-15s %-15s" %("Word", "Frequency")
for key in sorted(myDict):
    print '%-15s: %-15d' % (key, len(myDict[key]))

dont use raw_input, just do open("eng.txt","r") – R Nar Sep 23 '15 at 19:45 — R Nar, Sep 23 '15 at 19:45
I have tried the same, but it doesn't show any output – Prime Sep 23 '15 at 19:50 — Prime, Sep 23 '15 at 19:50

score 1 · Answer 1 · edited May 23 '17 at 11:59

1

f is a file resource in your example, not a string. You need to read from f. See here for example: How do I read a text file into a string variable in Python

Do something like the following to also deal with newline characters:

with open ("data.txt", "r") as myfile:
    f=myfile.read().replace('\n', '')

Also raw_input is for command prompt and is not useful in this situation.

edited May 23 '17 at 11:59

Community

1
1

answered Sep 23 '15 at 19:46

sunny

3,853
5
32
62

score 1 · Answer 2 · answered Sep 23 '15 at 21:13

Since you have c++ there:

std::istringstream inputdata("HELLO HELLO HELLO BOBBY WHAT ARE YOU DOING");

std::string word;
std::map<std::string, size_t> counts;

while (inputdata >> word)
    ++counts[word];

for (auto const &w : counts)
    std::cout << std::setw(15) << w.first << ": " << w.second << "\n";

Note that I've skipped producing/storing the line numbers since you didn't use them anyway. :-)

score 1 · Accepted Answer · edited May 23 '17 at 12:31

Notes:

raw_input method is used to get user input from prompt

Changes to your own code:

f = open("eng.txt", "r")
myDict = {}
linenum = 0

for word in f.read().split():
    if not word in myDict:
        myDict[word] = []
    myDict[word].append(linenum)

print "%-15s %-15s" %("Word", "Frequency")
for key in sorted(myDict):
    print '%-15s: %-15d' % (key, len(myDict[key]))

Simplified code using set default method of dictionary

Code1:

myDict = {}
linenum = 0
with open("eng.txt", "r") as f:
    for word in f.read().split():
        myDict.setdefault(word,[]).append(linenum)

print "%-15s %-15s" %("Word", "Frequency")
for key in sorted(myDict):
    print '%-15s: %-15d' % (key, len(myDict[key]))

Sample input:

was very very afraid can you help
me
me
me

Output :

Word            Frequency      
afraid         : 1              
can            : 1              
help           : 1              
me             : 3              
very           : 2              
was            : 1              
you            : 1

How to read the data from a file and get the concordance output

3 Answers3