This is a project i did which i scraped the website, taking the name of the item, brand, and prices.
- Selenium
- Beautifulsoup
Before installing Selenium make sure you have the right driver installed for your browser. The browser i used was firefox so i was required to install geckodriver.
pip install Selenium
pip install Beautifulsoup
Clone your the resporsiry to your local enviroment.
git clone https://github.com/tobiolabode/Shopping_scraper.git
python main.py
The command line should print some results like this:
The program should also write an csv file of the contents.