Updates June 23

PGrid

• Investigated a bug with amazon gpu scraper where all cards were going in and out of stock at the same time after a scraping job was complete. Was due to different servers (US and AU) running tasks and not using proxy so usa servers would get out of stock for all results. Updated logging for gpu scraping.
• Added new metrics to track generic item snapshots every hour:
  • number of snapshots added
  • number of items set as failed
  • number of snapshots out of stock
• Migrated next js app to include a region part in the first section of the url in preparation of using the pgrid.app domain. Lots of little errors doing this.
• Added a cloudflare worker that serves that static files from the nextjs build. Using a worker allows server side region selecting based on IP in the future and redirecting to au region from .com.au now.
• Added pgrid.app domain to ses, added cloudflare email receiving + gmail sending from pgrid.app domain
• Migrated pgrid.com.au to pgrid.app
• Fixed bug with gpu timerseries data display where it would miss some snapshots from the day before current day due to usage of daily lowest gpu price table
• Added local dev ssd table including new elements on the table like pills and bars for easier data skimming