Python: how to use lots of proxies in module REQUESTS

Question

I have some difficulties with module requests. It takes argument proxies. I saw in this question description on this module and I've understood, that it takes only one proxy from the dict. But if one proxy is blocked? I want to use dictionary with a lot of proxies, if one proxy is blocked, I want take another proxy, but how can I do that?

You are going to quickly run out of proxies, you may find using selenium with PhantomJs is a better option — Padraic Cunningham, Oct 20 '16 at 14:32

score 0 · Answer 1 · answered Oct 20 '16 at 10:37

0

Define list_of_proxies = [{proxy_0}, {proxy_1}, ...] and then paste them as needed r = requests.get(url, headers=headers, proxies = list_of_proxies[i]) where you set i according to the logic of your code.

answered Oct 20 '16 at 10:37

Nurjan

5,889
5
34
54

Thank you for the answer. I'll try it soon – Petr Petrov Oct 20 '16 at 10:44

score 0 · Answer 2 · answered Sep 12 '17 at 10:13

0

Define list of proxies and then use random.choice(list) function to call random choice from list and use in your code.

Thank you.

answered Sep 12 '17 at 10:13

user7365756

11
3

Python: how to use lots of proxies in module REQUESTS

2 Answers2