An app made as part of learning Django Rest Framework, asynchronous programming with Celery, and Docker. It serves as a Django API-based web scraper designed to extract headings from Wikipedia articles recursively. By providing a valid Wikipedia article URL, the application retrieves all headings from that article and extends its scraping functionality to articles referenced within the initial one. This recursive process continues until a specified limit of pages is reached. The scraped data is then returned in a structured format.
sohaib-50 / async-scraper Goto Github PK
View Code? Open in Web Editor NEWA Django-based API web scraper for extracting Wikipedia article headings recursively, utilizing Django Rest Framework, Celery for asynchronous tasks, and Docker for containerization.