图片爬虫，爬 http://www.girl-atlas.com 整个网站的图片
- gentoo 内核版本：3.14.14
- python 2.7.7
- requests 发送http请求，下载图片
- lxml 解析html文件
- grequests 基于gevent的异步http请求库，加快爬取速度
- get_image.py 每次发送一个请求
- get_image_gevent.py 每次发送五个请求
注：可以在get_images函数中修改图片存放目录
-
Notifications
You must be signed in to change notification settings - Fork 24
License
pein0119/girl-atlas-crawler
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
No description or website provided.
Topics
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published