Lot of cURL requests stop the website execution

Question

I have a page that sent a cURL request for website to check their HTTP Status. (I have something like 6000 URLs to check)

Its work fine, but after 300-400 requests its stop the page with HTTP ERROR 500.

I try to do sleep function for 30 seconds every 100 cURL requests, its not help. I also increate the max_execution_time to 10000

Try limiting the number of requests per minute. Check https://dzone.com/articles/basic-api-rate-limiting — Praveen E, Feb 19 '19 at 10:10
@RiggsFolly its return me `HTTP ERROR 500` - this page wont work. — Dasmond, Feb 19 '19 at 10:13
@RiggsFolly Where I can find the error logs? the page its chrome error not my server error — Dasmond, Feb 19 '19 at 10:15

score -1 · Answer 1 · answered Feb 19 '19 at 10:42

-1

Try using crontab. For example, you have a PHP script with cURL request, set up cron that will execute that script exery minute (* * * * * *)

answered Feb 19 '19 at 10:42

Tair Adibek

How its different from sleep function? – Dasmond Feb 19 '19 at 10:43
Cron works in background mode, just try it - https://stackoverflow.com/a/30429555/10944735 – Tair Adibek Feb 19 '19 at 10:49

1 Answers1