kerou / ajax_crawler Goto Github PK
View Code? Open in Web Editor NEWThis project forked from heartfly/ajax_crawler
A flexible web crawler based on Scrapy for fetching most of Ajax or other various types of web pages. Easy to use: To customize a new web crawler-You just need to write a config file and run.
License: MIT License