t0n / dockerized-django-selenium-cralwer Goto Github PK
View Code? Open in Web Editor NEWConfigure sites to be crawled via simple django app (proxied with nginx, backed by postgres) and run tasks via celery that will parse websites with selenium/phantomjs. All parts in their own docker containers.