Updates September 15

PGrid

• Updated internal CLI to be able to take a screenshot of any running worker and save it locally. Helpful for debugging.
• Wasn’t able to determine what made Amazon detect the browser not being from australia, so gave up and updated the Amazon scraper to go into the location selector and input postcode and select Sydney when it detects that Amazon has set shipping location to be another country.
• Back to SSD classification, reran model and variant classification models. Found variant classification didn’t set ignore reasons for anything. Reorganised classification models to be able to return a few specific decisions including ignoring a model and removing existing classification to rerun the whole classification process for that item again. This ended up causing unit test issues and found some code quality issues related to this as well. Ended up rewriting the entire variant stage classification file as well as its tests. This ended up touching a lot of other files and took a bit of time. Seemed important to fix code quality issues though.
• Cleaned up old classification session tracking columns and functionality
• Wrote a prompt and CLI command for Claude to review classification sessions. Not quite properly functional yet.
• Work in progress on updating Amazon/eBay search based scraping to be even more distributed and have workers do a few searches each. At the moment one worker searches through all items for a category and this times out for SSDs. While doing these edits, making the whole thing a bit more robust and handle different regions.