怎麼使用代理 IP?

[jackylau28]

怎麼使用代理 IP?

[baabaaox]

@jackylau28

ScrapyDouban/scrapy/douban/middlewares.py

Lines 11 to 15 in 89da58d

	class ProxyMiddleware(object):
	def process_request(self, request, spider):
	# curl https://m.douban.com/book/subject/26628811/ -x http://127.0.0.1:8081
	request.meta["proxy"] = "http://127.0.0.1:8081"

修改成你的代理地址

ScrapyDouban/scrapy/douban/settings.py

Lines 57 to 60 in 89da58d

	# DOWNLOADER_MIDDLEWARES = {
	# 'douban.middlewares.DoubanDownloaderMiddleware': 543,
	# }

在设置里面启用 douban.middlewares.ProxyMiddleware

[chengs2035]

这个代理的地址，要咋搭建呀？

[baabaaox]

@chengs2035 买代理 ip