Updates Nov 11

Homeless helper app

• Converted an existing “Inner Brisbane food locations” guide from images into a spreadsheet using Claude. Issues on having a spreadsheet format that can be converted into JSON for slightly complicated schedules like “first tuesday of the month”. Ignored for now.
• Got google sheets data into csv by making the sheet public and then requesting a csv version of it. Finally something easy from google
• Wrote csv parser into the format for the app
• Updated app to use a new format for data, got sheet data displaying but filters not working so are hidden.

PGrid

• In preparation for black friday I thought I would implement a “current deals” section at the top which would show which GPUs are currently at all time low prices. Doing this query required doing price history queries of all gpus for months and that ended up taking nearly 1 minute. Indexes weren’t cutting it. This is also a bottleneck for current builds which are sometimes reaching 5 minutes. Ended up creating a cached table which has the daily cheapest price for each GPU. reduced query times significantly
• Added the current all time low section for GPUs
• Migrating all servers to use nomad and all workers to be deployed from nomad. Before it was a homemade script that would rsync code up to all servers, build docker images and run them. This provides a bit more stability and makes sure all servers are running the same versions, using same env vars/config.
• Updated github actions to do migrations, build multiarch images and nomad deployment
• Added node exporter to get some graphs on grafana about servers. Works through node exporter -> otel collector -> influxdb -> grafana. Seems a bit ridiculous but wasnt hard to get working.
• Current issue with nomad worker deployment is that the graceful exit doesnt work so if a job is running, it will get killed before finishing.