Updates November 24

PGrid

• New landing page design live
• To put new landing page live, synced up all local SSD classification done up to prod. This resulted in groups of 3k and 4k single page crawl jobs being queued for eBay scraping in AUS and USA. Disabled USA single page scraping. Added new worker from green3 server. Updated to ignore classified SSDs from ignored SSD models.
• Fixed bug with eBay scraping for multilistings where there was incorrect out of stock and price parsing
• Added CLI command to manually fail a generic item and refresh the ClickHouse materialised view.
• Added filtering for the SSD table
• With the new SSD table, found there were quite a few results where e.g. were classified as 4TB variant but were pointing to the 1TB variant. This was due to specific Amazon items being inactive and then redirecting elsewhere. Added ASIN redirect checking in the Amazon generic scraper
• Started on new CPU classification using the DB backed architecture from SSD classification.