Deals Scraper is a Canadian tool to find good deals on websites like Facebook Marketplace, Kijiji, Ebay, Amazon and Lespacs
Deals Scraper is a Canadian tool to find good deals on websites like Facebook Marketplace, Kijiji, Ebay, Amazon and Lespacs
Clone the repo
git clone https://github.com/JustSxm/Deals-Scraper.git
Install dependencies
pip install -r requirement.txt
Open the config file (config.ini) and find the section named DEFAULT
[DEFAULT]
Keywords = airpods pro
Exclusions = case
StrictMode = False
Interval = 1
Open the config file (config.ini) and find the section named FACEBOOK
[FACEBOOK]
Enabled = True
CityId =
MinPrice = 0
MaxPrice = 1000
SortBy = distance_ascend
; best_match, price_ascend, price_descend, distance_ascend, creation_time_descend
To find your CityId:
After make sure to login to Facebook, this scraper uses your browser to scrape, it doesn't connect automatically.
Open the config file (config.ini) and find the section named Kijiji
[KIJIJI]
Enabled = True
CityUrl =
Identifier =
MinPrice = 20
MaxPrice = 100
Type = ownr
; ownr, delr, all
To find your CityId and Identifier:
Open the config file (config.ini) and find the section named Ebay
[EBAY]
Enabled = True
MinPrice = 20
MaxPrice = 100
The LesPACs configuration provided in this repository is not currently implemented due to the website either undergoing a rewrite or implementing security measures to prevent web scraping. Unfortunately, without more information from LesPACs themselves, it is not possible to provide an ETA for when the configuration will be functional again.
If you are looking to use the Amazon configuration in this repository, please note that it is not included in the current version and is not planned to be included in the future. This is due to the implementation of anti-scraping measures on the Amazon website, such as CAPTCHAs, which make it difficult or impossible to retrieve data using a web scraper. As such, the Amazon configuration provided in previous versions of the repository may no longer be functional.
Run the python script
python main.py
Facebook uses a city to look around as it is not international, you can find the id by looking for your city on facebook and copy the id of their page. (usually facebook.com/..../place/id)
Facebook is a good website for scraping.
Kijiji is a good website for scraping
Ebay is an okay website for scraping
Since Amazon is a vast website, it is way harder to find new ads and to precise what we want, therefore you will most likely get garbage from it than what you're actually looking. It could be fine if you're looking for the cheapest price for a "popular" item
Amazon is a bad website for scraping
Lespacs is just like kijiji except it is more Quebec centered than Canada, therefore it can be a bad site for scraping if you are not from Quebec, otherwise it is a pretty good one
Outside of Quebec: Lespacs is a bad website for scraping
Inside of Quebec: Lespacs is a good website for scraping
This project was made with the help of scrapy
README - ChatGPT