christopherrabotin / gofetch Goto Github PK
View Code? Open in Web Editor NEWAn incredibly fast web scraper which indexes content on AWS S3, used in production at Sparrho. Fetched nearly 22,000 sources in less than 20 minutes from the US-East datacenter.
License: MIT License