Updates March 16

PGrid

• bug with ebay refactor, 11k+ single page ebay scrape jobs were queued.
  • found and fixed a bug related to ebay single page jobs. had to refactor job args to take item ids instead of urls since duplicate urls could be in the database in different categories
  • updated amazon single page scraping to use same style item id input
• updated audit cli to be able to run all categories in one go, and to allow an ai agent to non interactively view and make decisions on audit items
• ebay scraper fixes
  • coupons on top of the page were not getting parsed properly, added a specific dom based parser if the usual methods of finding coupons failed
  • added support for ebay ‘product’ pages which are different to the typical item pages i have been scraping for australia. these product pages are redirect destinations for some item pages in ebay usa.
  • debugging work done to figure out why coupons are sometimes parsed and sometimes not. this was a bug found from the recently added deal section where an ebay deal would mean the item gets more frequent scraping and all ebay deals kept going in and out of being an active deal due to the coupon parsing issue. this hasnt been fixed.
  • added handling of ebay sold out pages
  • added region based seller rating filtering. in aus its sellers over 1k, in usa its sellers over 5k only.
• fix bhphoto scraper. it was giving completely wrong prices. eg instead of $100.00 it would parse $10000. for some reason multiple sessions of ai audits ignored this and even added filters to show current price through a post processing step
• added gpu filters based on user request