Woolies Salescraper

A basic Woolies grocery sale scraper, since who buys anything at full price nowadays?

This isn't really a scraper, since it uses a publicly available API. However this API doesn't have much in the way of public documentation so it's about as haphazard. This uses the /ui/product/detail endpoint to grab general price data for specific items. Using just the item's code (shown in the URL when online shopping) we can poll this data without any form of API key - which is weird, since the internet says you need one.

Usage

Using this tool is pretty easy. You just need to clone the repository and supply the file containing the item codes (see format below), as well as the desired ntfy.sh server if you have one.

git clone https://github.com/boxlegs/WooliesSalescraper.git
cd WooliesSalescraper
pip install -r requirements.txt
python3 scrape.py -u http://ntfy.sh codes.txt

InFile format

This is the format for the input file that contains codes. Codes should be listen line by line and under a group label. The group labels (e.g. [group]) are used to specify the ntfy topic endpoint. For example, notifications for items under [coffee] will be sent to https://ntfy.sh/coffee (or whatever ntfy server you've specified. Since this tool parses only the first space-delimited item per line, you can use comments to keep track of what each item code is, etc.

example codes.txt

[coffee]
254695
111111

[treats]  # Support for comments!
826731    # Red Doritos 

To Do

There are various improvements I'm considering to make this more customisable

• Custom ntfy tags for each topic
• Custom sale %-based notification thresholds - either global or per-item
• maybe support for Coles (assuming I can figure out their product API)