A Scrapy based collection of crawlers aimed at downloading files from various web data portals.
Currently it includes spiders for https://data.gov.uk (CSV files) and http://webarchive.nationalarchives.gov.uk (CSV files - needs a search domain to be provided, e.g., http://webarchive.nationalarchives.gov.uk/search/result/?q=NHS%20hospitals&mime=CSV)
Documentation to be updated...