cnkang / sitemap-generator Goto Github PK
View Code? Open in Web Editor NEWA Python web crawler and sitemap generator. Crawls a domain recursively to a set depth and generates an XML sitemap for pages modified after a given date. Uses multi-threading for performance, ideal for SEO and site analysis.
License: MIT License