Updates June 22

PGrid

• item enrichment progress
  • fixed bug where item enrichment tasks were put on dbops meaning only one worker would be doing them and it would be doing browser tasks which is not what dbops worker is for
  • debugging item queue getting stuck. this was due to Nomad starting a new deployment of workers while an enrichment task was running, causing the job to be stuck in progress and enrichment tasks to be done such that only 1 can run at a time. updated base worker file to handle this better.
  • lots of iterating to get bhphoto item enrichment working. includes being able to download images from them bypassing their checks for images.
  • fixed newegg crawler for enrichment
  • updated computer alliance crawler to support single page scraping + item enrichment
  • added support for item enrichment from ebay
• work in progress on adding monitor support
  • model specs search verifiers needed iteration #todo
• signed up for opencode go and ran evals for 4 of their best models. some of the base data being evaluated against didn’t seem 100% correct so some of the match rates aren’t fully correct.
  • moved to using mimo v2.5 pro for hard classification tasks. seems ok.
  • added new skill + cli commands to allow an agent like codex to review recent classification tasks instead of me looking at email outputs. from testing codex found the number of classifications to review would be too much. updated to be able to select samples and it CLI outputs a TSV file which seems better than JSON for tokens.
• hitting rate limits for open router deep seek flash so wrote an update to use gpt5 mini free tokens and fallback to deepseek flash if out of free
• added live browser debugging for production workers. currently its only on a test worker.
• added support for having ad hoc test workers to run on nomad cluster to be able to do live testing without using production workers.
• updated cli to show opencode + cursor usage as well
• little work on cleaning up agents.md and adding new ones for subfolders
• a bunch of work done related to proxies this week. due to having issues for item enrichment using just nordvpn proxy
  • tried a new VPN called Mysterium which has support for residential IPs. but after paying for a year, their admin panel is limited, no city selection, no Linux support. got codex to try reverse engineer their Chrome extension from which it was able to get a remote proxy auth process for. did a deployment for this and a bunch of testing. found a lot of AU IP addresses were just from basic data centres like DigitalOcean. USA IPs seemed to be a bit better quality but still didn’t seem to be residential. based on this i asked for a refund.
  • added support for agents to be able to do a test deployment of nord_proxy on the nomad cluster to live test updates
  • fixed some issues with purevpn to get that working again. not deployed yet