Deals Scraper is a Canadian tool to find good deals on websites like Facebook Marketplace, Kijiji, Ebay, Amazon and Lespacs

• Zooming fast
• Price Range (Min, Max)
• Keywords exclusion
• Strict mode (must have the keywords you mentionned)
• Repeating every amount of time specified
• Easily add your own website if you know what you're doing

• Python

Clone the repo

  git clone https://github.com/JustSxm/Deals-Scraper.git

Install dependencies

  pip install -r requirement.txt

Edit the config file

[DEFAULT]
keywords = # the words you want to search for ex: airpods pro sealed
exclusions = # the words that will exclude ads ex: case
maxprice = # the max price of the item ex: 100
minprice = # the minimum price of the item ex: 10
enablefacebook = # if you want to enable facebook scraping ex: True
enablekijiji = # if you want to enable kijiji scraping ex: True
enableebay = # if you want to enable ebay scraping ex: True
enableamazon = # if you want to enable amazon scraping ex: True
enablelespacs = # if you want to enable lespacs scraping ex: True
strictmode = # if the title of the ads must contain atleast one keyword ex: True
facebookcityid = # https://www.facebook.com/places/Things-to-do-in-Toronto-Ontario/110941395597405/ ex: 110941395597405
; facebook use the id of the closest city to you for the searches, if not set it will return no ads
interval = 10
; every minutes the bot should scrape

Run the python script

  python main.py

Facebook uses a city to look around as it is not international, you can find the id by looking for your city on facebook and copy the id of their page. (usually facebook.com/..../place/id)

Facebook is a good website for scraping.

Kijiji is a good website for scraping

Ebay is an okay website for scraping

Since Amazon is a vast website, it is way harder to find new ads and to precise what we want, therefore you will most likely get garbage from it than what you're actually looking. It could be fine if you're looking for the cheapest price for a "popular" item

Amazon is a bad website for scraping

Lespacs is just like kijiji except it is more Quebec centered than Canada, therefore it can be a bad site for scraping if you are not from Quebec, otherwise it is a pretty good one

Outside of Quebec: Lespacs is a bad website for scraping

Inside of Quebec: Lespacs is a good website for scraping

This project was made with the help of scrapy

MIT