Updates July 20
PGrid
- continued work on classification and specs search
- updated all verification agents in agent mode to also be able to return ‘reclassify’ outcome
- running classification and specs search across all categories autonomously. getting ai agents to review and stop at issues. stopping is becoming a bit less common
- there was an issue with kingston KCP memory being incorrectly grouped under ValueRAM. went through it with ai, fixed prompts and created new ram models for this
- fixed monitor listings being matched to similar but different model codes
- fixed ram specs searches keeping variants under the wrong parent model
- updated ram model identity rules so manufacturer-defined RGB versions are treated as different models
- moved cellular capability from laptop variants to subvariants after finding otherwise identical wifi and 5g skus. kept subvariant classification out of scope for now so laptop variant specs searches could resume
- started work on simplifying ssd variant classification prompts and a new eval harness to test the changes
- added a non-interactive pipeline health command for agents running classification and specs search
- shows queue counts, failures and where items are stopped in the pipeline
- shared queue selection logic with the specs search runner so both report the same work
- found cpu specs search could merge PRO and non-PRO models before doing research
- found cpu specs search was different from other categories and started investigating how to make agents more reliably detect this kind of workflow difference
- updated specs search finalizers to allow removing unsupported optional specs instead of rejecting the correction
- worked on crawler and worker reliability
- fixed mwave enrichment images to download through the browser session
- added single page crawling and item enrichment support for jw
- fixed scorptec listing crawls getting stuck on cloudflare challenge pages
- added amazon product descriptions to item enrichment to help specs search identify reseller modified laptops
- centralised crawler job priorities and added proxy ip history to make retailer blocks easier to investigate
- moved production codex authentication into nomad so it can be refreshed without a full deployment, cleaned up the different local and production authentication paths
- updated browser debug feature flag to be enabled only for specific sites
- continued work on catalog images
- ran supervised image selection for 109 laptop variants, getting ai to review each batch and stopping after repeated issues with primary image choices and incomplete galleries
- improved image selection and added compact review outputs to allow agents to review larger batches
- started prototyping automatic background removal for laptop images, using simple background removal where possible and BiRefNet for harder images
- continued work on deals
- added a skill for agents to find deals by comparing similar products instead of only looking at price history
- updated the homepage deals section and started a deal alerts signup design. kept the signup hidden for now
- started a reusable reference library for making pgrid videos
- got ai to analyse a reference video frame by frame to try to extract patterns that could be used in new videos like animations and meme usage
- worked on a new design system for slideshows as i didn’t like the basic white design from before
