How to find a word count and collect word and pass on url javascript

Question

I have fetched a text doc from an url and stored in the response.

I want to do 3 things here:-

1. Find count of words from the doc.
2. Collect details for top 3 words (order by word occurrences) and show synonyms and part of speech.

API :- https://dictionary.yandex.net/api/v1/dicservice.json/lookup Key :- something..

3. Show above top 3 word list results in json format

All should be in asynchronous way.

const fetch = require("node-fetch");

async function fetchTest() {
    let response = await

    fetch('http://norvig.com/big.txt')
        .then(response => response.text())
        .then((response) => {
            console.log(response)
        })
        .catch(err => console.log(err));

}

(async() => {
    await fetchTest();
})();

EDIT:-

const fetch = require("node-fetch");

async function fetchTest(responses) {
    let response = await

    fetch('http://norvig.com/big.txt')
        .then(response => response.text())
        .then((response) => {
            console.log(response); // ------------------> read text  from doc

            var words = response.split(/[ \.\?!,\*'"]+/);
            console.log(words);
                
               var array = Object.keys(words).map(function(key) {
                return { text: words[key], size: key };
                });

                console.log(array); //-----------------------> occurence count of words

                   var sortedKeys =  array.sort(function (a, b) {
                    return  b.size - a.size ;
                    });
                    var newarr = sortedKeys.slice(0, 10);
                    console.log(newarr); // --------------> top 10 text and occurence

                    var permittedValues = newarr.map(value => value.text);
                    console.log(permittedValues); //---------------> sorted key in array


                    fetch('https://dictionary.yandex.net/api/v1/dicservice.json/lookup?key=domething_&lang=en-en&text=in&callback=myCallback')
                        .then(responses => responses.text())
                        .catch(err => console.error(err));
                        console.log(this.responses);
                                             
                       
         })
        .catch(err => console.log(err));

}

(async() => {
    await fetchTest();
})();

Unable to do fetch API with json response to show synonyms and part of speech. Where am I going wrong ?

Answer 1

This sounds a lot like a homework question. If you look at the documentation for the lookup call:

https://tech.yandex.com/dictionary/doc/dg/reference/lookup-docpage/

it offers both an array of synonyms and the part of speech for free. which means you only need to determine the most used words.

It may not be the flashiest solution, but you can solve this in short order using a dictionary. Iterate once storing a count in a dictionary then order the key/value pairs by value and you have the solution. You'll have the top ten words and you have an api to provide the rest, with your current code showing how to async call the api.

Seems straight forward from there.