Updates Aug 12

PGrid

• Got ebay listings with coupons working.
• Slightly annoying process on getting listings:
  • search ebay for each gpu chip
  • take top 15 results from sellers above x ratings
  • for each result:
    • check if memory can be parsed from title
    • use ai to check if the result title is actually a gpu
    • use ai to check if the result title is the gpu being searched
    • add that result to an unverified gpus table. once its in that table, i have a cli to quickly check the results and move each card listing to a verified table. will probably automate this but want 100% correct classification.
  • after its been successfully classified, normal scraping of price and coupons runs for each listing
• Fixed bug with timezones for price snapshots where it would show utc dates which can make the graph show prices for the wrong day if the price scraping was done before 10am
• deployed ebay links with affiliate code
• wrote script to do a discord notification if there is a decent price decrease. will use to post to ozbargain as marketing method
• started and finished amazon scraper. Amazon has a lot of gpus. only scraping the first page for each of the gpu chips in my db, leads to 1300 results. refining that down with ai + filtering functions leads to nearly 600 gpus. Initially made a mistake with scraping where i missed the brand name so had to write an extra function to scrape again and update existing rows with the brand name.
• fixing some bugs and did manual validation of the 400ish gpus from amazon.
• added a bulk gpu price snapshot function. Usually everyday the scraper would check prices by going to the individual url of each gpu and checking the price. But now I have the ability to get prices for each gpu just from the search results in amazon and from the gpu listing page on computer alliance. the other sites still have their individual urls visited for now
• Looked at where some other sites selling gpus are getting links from. submitted pgrid to productreview.com.au. Need to do more of this
• Joined 2 pc building facebook groups with intent to share pgrid.
• Added structured data in gpu page headers to allow google to have rich search results showing price range of gpus
• deployed amazon links with affiliate code

Law statement of claim matrix app

• more experimentation with prompts in order to try and get 100% accuracy in converting pdf scanned pages into structured data with paragraph numbers, text formatting (underlines, strikethroughs) correctly identified. had success with a recursive prompt where the ai looks at 2 pages at a time, converting image to text for the current page and fixing previous mistakes with conversion for the last page. I also get it to summarise and classify each paragraph.