This project provides several intermiate examples on how to write spiders to scrape data from webisites.
Compatible with: Python 2.7
There are three spider examples:
Douban spider:scrape information of books from a book recommendation website
IPSpider:scrape ips from xiciproxy.com. Those Ips.
JobSpider: scrape Job posting info from several websites.