Node.js puppeteer - How to set navigation timeout?

Question

I'm using node.js and puppeteer to get some data. Some of the files I'm opening are quite large ... and then I get an error:

Error:

our error { TimeoutError: Navigation Timeout Exceeded: 30000ms exceeded
    at Promise.then (/project/node_modules/puppeteer/lib/NavigatorWatcher.js:74:21)
    at <anonymous> name: 'TimeoutError' }

How can I ignore it or set a higher timeout?

That's my script:

await page.goto('url'+tableCell04Val, {waitUntil: 'load'});

You can read the docs https://github.com/GoogleChrome/puppeteer/blob/master/docs/api.md#pagesetdefaultnavigationtimeouttimeout — katmanco, Sep 04 '18 at 09:59
@MuhammadUzair thanks for warning :) here is the up-to-date docs https://pptr.dev/api/puppeteer.page.setdefaultnavigationtimeout — katmanco, Jul 22 '22 at 08:37

James Gould · Accepted Answer · 2021-08-11T08:53:06.237

135

You can use timeout: 0 to disable timeout errors if you're loading a heavy page.

Use it in your page.goto like:

await page.goto('url'+tableCell04Val, {waitUntil: 'load', timeout: 0});

You can see the PR made to Pupeteer here which added the change, along with documentation and the unit tests that implement it.

edited Aug 11 '21 at 08:53

answered Sep 04 '18 at 09:56

James Gould

4,492
2
27
50

Its working for direct pages, but not for the oauth redirect pages. – MohanBabu Jan 14 '20 at 05:58
Do you have a solution for that @MohanBabu? – Anshuman Kumar Jul 21 '22 at 09:59
i cannot able to catch the flow. so reopen the same url and i was able to load the page successfully with catched token on the browser and installed some fonts causing the page blank. – MohanBabu Mar 05 '23 at 06:14

Juanmabs22 · Answer 2 · 2022-08-07T16:16:14.243

70

#UPDATE 2019 (still working 2022)

You can also change the page behaviour since V1.0.0:

page.setDefaultNavigationTimeout(0);

The param is the timeout in milliseconds.

References: https://pptr.dev/api/puppeteer.page.setdefaultnavigationtimeout

edited Aug 07 '22 at 16:16

answered Jun 20 '19 at 12:42

Juanmabs22

1,194
9
10

score 39 · Answer 3 · edited Jul 05 '21 at 14:27

There are two methods to handle the timeouts in Puppeteer:

a) page.setDefaultNavigationTimeout(timeoutInMiliseconds)

It affects the navigation-related functions:

•   page.goBack([options])
•   page.goForward([options])
•   page.goto(url[, options])
•   page.reload([options])
•   page.setContent(html[, options])
•   page.waitForNavigation([options])

b) page.setDefaultTimeout(timeoutInMiliseconds)

It affects all the previous navigation functions plus all the Waiting funtions:

•   page.waitFor(selectorOrFunctionOrTimeout[, options[, ...args]])
•   page.waitForFunction(pageFunction[, options[, ...args]])
•   page.waitForRequest(urlOrPredicate[, options])
•   page.waitForResponse(urlOrPredicate[, options])
•   page.waitForSelector(selector[, options])
•   page.waitForXPath(xpath[, options])

NOTE: page.setDefaultNavigationTimeout takes priority over page.setDefaultTimeout

In some situation, only .setDefaultTimeout( would work. I just spent half a day for this. — goodhyun, Apr 15 '23 at 08:27

score 11 · Answer 4 · answered Nov 21 '18 at 00:14

11

You can set timeout like this

await page.goto('url'+tableCell04Val, {waitUntil: 'load', timeout: 10000}).then(() => {
    console.log('success')
}).catch((res) => {
    console.log('fails', res)
})

answered Nov 21 '18 at 00:14

Henry

1,077
1
16
41

score 8 · Answer 5 · answered Mar 15 '20 at 15:51

8

await page.goto('url'+tableCell04Val, {  waitUntil: 'networkidle2',timeout: 0});

networkidle2 comes handy for pages that do long-polling or any other side activity.

Check https://github.com/puppeteer/puppeteer/issues/1552#issuecomment-350954419

answered Mar 15 '20 at 15:51

Rexben

339
4
13

score 8 · Answer 6 · answered Jun 07 '21 at 06:35

The default in puppeteer timeout is 30 seconds. To use custom timeouts, you can use the setDefaultNavigationTimeout and setDefaultTimeout methods or the timeout property in the options parameter. The wait time in all cases is specified in milliseconds.

await page.setDefaultNavigationTimeout(60000);

e.g.

const page = await browser.newPage();            
await page.setDefaultNavigationTimeout(60000); //timeout 60 seconds now

Pass 0 to disable the timeout

await page.setDefaultNavigationTimeout(0);

No need to `await` on timeout sets. They don't return promises. — ggorlen, Dec 03 '22 at 16:26

Mukesh · Answer 7 · 2022-02-01T11:50:25.973

-2

I got same error but not on directly using node.js application. I faced this issue when I was using MagePack installed on the Ubuntu server.

I fixed it by increasing the timeout in the following file /ur/local/lib/node_modules/magepack/node_modules/puppeteer/libTimeoutSettings.js

const DEFAULT_TIMEOUT = 30000

Note: It may not be perfect solution but it worked for me and fixed the issue which I was facing.

edited Feb 01 '22 at 11:50

answered May 12 '21 at 13:10

Mukesh

7,630
21
105
159

this is not a solution ... If the job is greater than the previous than it will agains say timeout – Ali Yar Khan Feb 01 '22 at 11:46
@AliYarKhan It may not be a proper solution but it worked in my case. – Mukesh Feb 01 '22 at 11:49
What happens when you reinstall the project in a different environment? You'd lose the hack. It's difficult to maintain such a code base. – andromeda May 26 '22 at 14:32
@andromeda I have already mentioned that it may not be a perfect solution but works for me. The node js is installed on the server and there is a Php application which uses a part of it for deployment process. All better solutions are welcome by me. – Mukesh May 27 '22 at 07:11

Node.js puppeteer - How to set navigation timeout?

7 Answers7

Linked